CN105930533B

CN105930533B - Multimedia programming methods of exhibiting and device

Info

Publication number: CN105930533B
Application number: CN201610442472.1A
Authority: CN
Inventors: 钱凯
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd; Tencent Cloud Computing Beijing Co Ltd
Priority date: 2016-06-17
Filing date: 2016-06-17
Publication date: 2019-03-08
Anticipated expiration: 2036-06-17
Also published as: CN105930533A

Abstract

The present invention relates to a kind of multimedia programming methods of exhibiting, belong to smart home field.The described method includes: multimedia play equipment receives the food materials information from refrigerator, the food materials that the food materials information is used to indicate the food materials stored in the refrigerator or is removed in the refrigerator, inquire multimedia programming corresponding with the food materials information, the multimedia programming inquired is shown, i.e. multimedia play equipment is searched for automatically according to the food materials stored or be removed in refrigerator and shows corresponding multimedia programming, user's manual search is not needed, to simplify manual steps, user time is saved.

Description

Multimedia programming methods of exhibiting and device

Technical field

The present invention relates to smart home field, in particular to a kind of multimedia programming methods of exhibiting and device.

Background technique

With enriching constantly for network video resource, the video program for cooking class is also more and more, and user stays indoors just It can learn various culinary art skills.

In the prior art, when user wants production food, phase can be searched in a network according to oneself existing food materials The video program of the culinary art class of pass.For example, when user wants production food, it is found that existing food materials are tomato and egg, then it can be with Keyword " tomato " and " egg " are manually entered in the search engine page, search engine searches for the key with input from network The relevant search result of word simultaneously shows that user selects some video program of program request from search result.

In the implementation of the present invention, it is found by the applicant that the prior art has the following problems:

When user wants program request relevant to existing food materials video program, needs actively to carry out web search and result is selected The manual operation such as select, manual steps are relatively complicated, waste user time.

Summary of the invention

In order to when solving that user wants relevant to the existing food materials video program of program request in the prior art, need active into The problem of manual operation such as row web search and result selection, manual steps are relatively complicated, waste user time, the present invention Embodiment provides a kind of multimedia programming methods of exhibiting and device, technical solution are as follows:

In a first aspect, providing a kind of multimedia programming methods of exhibiting, it is used in multimedia play equipment, the method packet It includes:

Receive from refrigerator food materials information, the food materials information be used to indicate the food materials stored in the refrigerator or The food materials being removed in the refrigerator；

Inquire multimedia programming corresponding with the food materials information；

The multimedia programming inquired is shown.

Second aspect provides a kind of media program methods of exhibiting, in refrigerator, which comprises

Food materials information is obtained, the food materials information is used to indicate quilt in the food materials stored in the refrigerator and the refrigerator At least one of food materials of taking-up；

The food materials information is sent to multimedia play equipment, so as to multimedia play equipment inquiry and the food The corresponding multimedia programming of material information, and the multimedia programming inquired is shown.

The third aspect provides a kind of multimedia programming displaying device, is used in multimedia play equipment, described device packet It includes:

Information receiving module, for receiving the food materials information from refrigerator, the food materials information is used to indicate the ice The food materials being removed in the food materials or the refrigerator stored in case；

Enquiry module, for inquiring multimedia programming corresponding with the food materials information；

Display module, for being shown to the multimedia programming inquired.

Fourth aspect provides a kind of media program displaying device, in refrigerator, described device to include:

Data obtaining module, for obtaining food materials information, the food materials information is used to indicate the food stored in the refrigerator At least one of the food materials being removed in material and the refrigerator；

Information sending module, for the food materials information to be sent to multimedia play equipment, so that the multimedia is broadcast Equipment query multimedia programming corresponding with the food materials information is put, and the multimedia programming inquired is opened up Show.

Technical solution provided in an embodiment of the present invention can include the following benefits:

Multimedia play equipment is by receiving the food for being used to indicate the food materials stored in refrigerator or being removed in the refrigerator The food materials information of material is inquired multimedia programming corresponding with the food materials information and is shown, is i.e. multimedia play equipment root It searches for and shows corresponding multimedia programming automatically according to the food materials stored or be removed in refrigerator, do not need user's manual search, To simplify manual steps, user time is saved.

It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not It can the limitation present invention.

Detailed description of the invention

The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention Example, and be used to explain the principle of the present invention together with specification.

Fig. 1 is the schematic diagram of implementation environment according to the present invention；

Fig. 2 is a kind of flow chart of multimedia programming methods of exhibiting shown according to an exemplary embodiment；

Fig. 3 is a kind of flow chart of multimedia programming methods of exhibiting shown according to an exemplary embodiment；

Fig. 4 is a kind of flow chart of multimedia programming methods of exhibiting shown according to an exemplary embodiment；

Fig. 5 is a kind of flow chart of the multimedia programming methods of exhibiting shown according to another exemplary embodiment；

Fig. 6 is the block diagram that a kind of multimedia programming shown according to an exemplary embodiment shows device；

Fig. 7 is the block diagram that a kind of multimedia programming shown according to an exemplary embodiment shows device；

Fig. 8 is the structural schematic diagram of the electronic equipment provided according to an exemplary embodiment.

Specific embodiment

Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all embodiments consistented with the present invention.On the contrary, they be only with it is such as appended The example of device and method being described in detail in claims, some aspects of the invention are consistent.

Fig. 1 is the schematic diagram of implementation environment according to the present invention.The implementation environment may include: refrigerator 110 and more Apparatus for media playing 120.

Multimedia play equipment 120 can be smart television, projector and speaker etc. with multimedia programming energy The smart home device of power, alternatively, multimedia play equipment 120 is also possible to smart phone, tablet computer, E-book reader And the Intelligent mobile equipments such as PC, alternatively, multimedia play equipment is also possible to smart phone, Intelligent bracelet and intelligence It can intelligent wearable device of the glasses with multimedia programming ability.

Refrigerator 110 is connected with multimedia play equipment 120 by wired or wireless network, also, refrigerator 110 and more matchmakers Body playback equipment 120 can also carry out data communication by mutual connection.Optionally, the multimedia play equipment 120 Internet can also be accessed by wired or wireless network, and obtains multimedia program data from interconnection net side.For example, refrigerator 110 and multimedia play equipment 120 can be connected respectively with network access equipment (wireless router or home gateway), and lead to It crosses the network access equipment and establishes wired or wireless network connection.Also, multimedia play equipment 120 is also set by network insertion Standby access internet.

In the following, the technical solution provided each embodiment of the present invention is introduced by taking implementation environment shown in FIG. 1 as an example And explanation.

Fig. 2 is a kind of flow chart of multimedia programming methods of exhibiting shown according to an exemplary embodiment, and this method can For in the multimedia play equipment 120 in implementation environment shown in Fig. 1.As shown in Fig. 2, the multimedia programming methods of exhibiting can To comprise the following steps:

Step 201, the food materials information from refrigerator is received, which is used to indicate the food materials stored in the refrigerator Or the food materials being removed in the refrigerator.

Step 202, multimedia programming corresponding with the food materials information is inquired.

Step 203, the multimedia programming inquired is shown.

In conclusion multimedia programming methods of exhibiting provided in an embodiment of the present invention, multimedia play equipment pass through reception It is used to indicate the food materials information of the food materials stored in refrigerator or the food materials being removed in the refrigerator, inquiry and the food materials information phase Corresponding multimedia programming is simultaneously shown, i.e., multimedia play equipment is searched automatically according to the food materials stored or be removed in refrigerator Rope simultaneously shows corresponding multimedia programming, does not need user's manual search, so that manual steps are simplified, when saving user Between.

Fig. 3 is a kind of flow chart of multimedia programming methods of exhibiting shown according to an exemplary embodiment, and this method can For in the refrigerator 110 in implementation environment shown in Fig. 1.As shown in figure 3, the multimedia programming methods of exhibiting may include as follows Several steps:

Step 301, food materials information is obtained, which is used to indicate in the food materials stored in the refrigerator and the refrigerator At least one of food materials being removed.

Step 302, which is sent to multimedia play equipment, so that the multimedia play equipment is inquired and should The corresponding multimedia programming of food materials information, and the multimedia programming inquired is shown.

In conclusion multimedia programming methods of exhibiting provided in an embodiment of the present invention, refrigerator obtain automatically and are used to indicate this The food materials information for the food materials stored or be removed in refrigerator, and food materials information is sent to multimedia play equipment, by multimedia Playback equipment is inquired multimedia programming corresponding with the food materials information and is shown, i.e., multimedia play equipment is according to refrigerator Corresponding multimedia programming is searched for automatically and shown to middle storage or the food materials being removed, and user's manual search is not needed, thus simple Change manual steps, saves user time.

Fig. 4 is a kind of flow chart of multimedia programming methods of exhibiting shown according to an exemplary embodiment, and this method can For in implementation environment shown in Fig. 1.As shown in figure 4, being used to indicate the food stored in refrigerator with the food materials information that refrigerator obtains For material, which may include the following steps:

Step 401, refrigerator acquires the first image of refrigerator inside by built-in image acquisition units, which is When refrigerator doors the last time of the refrigerator closes, the image of the refrigerator inside.

In embodiments of the present invention, refrigerator inside can be set one or more image acquisition units and (for example take the photograph As head), which can be used for acquiring single image (such as photographing mode of camera), can be used for acquiring Short-sighted frequency (such as video recording mode of camera), i.e., above-mentioned first image can be single image, be also possible to several views Frequency image, alternatively, being also possible to one section of video.The number of image acquisition units and setting position in refrigerator are according to refrigerator Storage structures depending on, as long as each image acquisition units acquired image in refrigerator can include storage all in refrigerator Object location, the embodiment of the present invention is without limitation.

Refrigerator inside is usually provided with headlamp, which opens when refrigerator doors are opened, and after refrigerator doors closing Extinguish, in embodiments of the present invention, when refrigerator doors are closed, refrigerator first controls Image Acquisition list before control headlamp extinguishes First image of member acquisition refrigerator inside after the completion of first Image Acquisition, then controls headlamp extinguishing.

In addition, have some refrigerators may comprising two or more refrigerator doors, and each refrigerator doors it is corresponding mutually every From storage space, when some refrigerator doors in two or more refrigerator doors are opened and close, refrigerator can To acquire image by the corresponding image acquisition units of refrigerator doors that this is opened and closes, meanwhile, refrigerator also obtains other This refrigerator doors being unopened is in upper primary opening and image that while closing acquires, the refrigerator doors that this is opened and is closed The image of corresponding image acquisition units acquisition, and, other refrigerator doors that this is unopened are in upper primary opening and close When the image that acquires be retrieved as above-mentioned first image.

For example, certain type refrigerator has fresh-keeping chamber and refrigerating chamber Liang Ge material storage room, there are a refrigerator doors in each material storage room, when with The refrigerator doors of fresh-keeping chamber are opened at family, take out or storage food materials after, when the refrigerator doors of fresh-keeping chamber are closed, in refrigerator with fresh-keeping chamber The corresponding camera of refrigerator doors acquires fresh-keeping indoor image, meanwhile, refrigerator also obtains the corresponding camera shooting of refrigerator doors of refrigerating chamber The image that is acquired when upper primary user opens and closes the refrigerator doors of refrigerating chamber of head, and take the photograph the refrigerator doors of fresh-keeping chamber are corresponding As head, the corresponding camera of refrigerator doors of this fresh-keeping indoor image and refrigerating chamber that acquire is opened simultaneously in upper primary user The image acquired when closing the refrigerator doors of refrigerating chamber is as the first image.

Step 402, which is retrieved as food materials information by refrigerator, and food materials information is sent to multimedia and is set It is standby.

Wherein, refrigerator is by the wired or wireless connection between multimedia play equipment, using the first image as food Material information is sent to multimedia play equipment.

For example, in a kind of possible realizations scene, refrigerator passes through Wi-Fi connection to wireless router, meanwhile, multimedia Playback equipment (such as smart television) is also by Wi-Fi connection to wireless router, after refrigerator obtains the first image, by this first Image is sent to wireless router, is transmitted to multimedia play equipment by wireless router.

Step 403, multimedia play equipment carries out image recognition to first image, to determine the food stored in the refrigerator The mark of material.

Wherein, multimedia play equipment can locally carry out image recognition, for example, multimedia play equipment can pass through Image recognition algorithm pair based on SIFT (Scale-invariant feature transform, Scale invariant features transform) First image is identified, to determine the mark for the food materials stored in refrigerator.

Alternatively, the first image can also be sent to cloud server by multimedia play equipment, identified by cloud server First image, and the mark for the food materials stored in the determining refrigerator of identification is returned into multimedia play equipment.

Wherein, the mark of food materials can be the title of food materials, alternatively, the mark of the food materials is also possible to the number of food materials.

Step 404, multimedia play equipment is inquired according to the mark for the food materials stored in the refrigerator and is stored in the refrigerator The corresponding multimedia programming of food materials.

Multimedia play equipment can inquire locally stored multimedia programming, for example, multimedia play equipment is local It is stored with multimedia programming relevant to food materials, and each multimedia programming and the corresponding storage of the mark of relevant food materials, it is more After apparatus for media playing identifies the mark for determining the food materials in refrigerator, inquired according to the mark of the food materials identified local corresponding The multimedia programming of storage.

Alternatively, multimedia play equipment can also inquire multimedia programming to cloud server, i.e., deposited in cloud server Multimedia programming relevant to food materials is stored up, and each multimedia programming and the mark of relevant food materials are corresponding, multimedia After equipment identifies the mark for determining the food materials in refrigerator, the mark for the food materials that will identify that is sent to cloud server, cloud Server corresponds to the multimedia programming of storage, and the multimedia programming that will be inquired according to the mark inquiry of the food materials identified (or the essential information of multimedia programming, such as profile information and address link) it is sent to multimedia play equipment.

Alternatively, multimedia play equipment can also be from the corresponding multimedia section of food materials stored in search refrigerator in network Mesh, for example, when the title for being identified as food materials of food materials, multimedia play equipment can (for example search be drawn by search system Hold up), with the multimedia programming in entitled keyword search the whole network or appointed website of food materials.

Wherein, which can be the programs such as video or audio, specifically, the multimedia programming can be one A cooking course.

Step 405, multimedia play equipment is shown the multimedia programming inquired.

Wherein, when multimedia play equipment is shown the multimedia programming inquired, the multimedia can be first shown The corresponding recommendation message of program, the recommendation message are used to recommend to play the multimedia programming to user, and user disappears for the recommendation Breath is determined play operation, and when playing multimedia programming to determine, multimedia play equipment plays the multimedia programming.

Optionally, in order to improve the recommendation effect of multimedia programming, in embodiments of the present invention, multimedia play equipment can To show the corresponding recommendation message of multimedia programming at the appointed time section.

Wherein, above-mentioned designated time period can be user or developer is pre-set in multimedia play equipment Period, specifically, multimedia play equipment can show above-mentioned recommendation message in the time that user may cook, for example, more Apparatus for media playing can be with 6:30~7:30 in the morning, noon 10:30~11:30, these three times of evening 17:30~18:30 Section shows recommendation message.

Alternatively, above-mentioned designated time period is also possible to the period that multimedia play equipment voluntarily determines, wherein multimedia Playback equipment voluntarily determines that the mode of designated time period can have following two:

1) multimedia play equipment obtains the status information of designated equipment, when the status information of designated equipment indicates that this is specified When equipment is currently running, determine that a preset length period after current time is the designated time period.

Wherein, which can be the culinary art electrical appliance such as electromagnetic oven, micro-wave oven, smoke exhaust ventilator or electric cooker and sets Standby, designated equipment connects multimedia play equipment by wired or wireless network, and periodically to multimedia play equipment report It lodges a complaint with state, when multimedia play equipment determines designated equipment starting according to the status information of designated equipment, it is believed that user It is cooking, can show recommendation message at this time.

2) multimedia play equipment obtains the type information of the corresponding food of multimedia programming, and the type information of the food is used The type of the food involved in instruction multimedia programming, multimedia play equipment is according to the class of the corresponding food of multimedia programming Type information determines designated time period.

Wherein, when multimedia play equipment inquiry multimedia programming, the profile information of available multimedia programming, and from The type of food involved in multimedia programming is obtained in profile information.

In embodiments of the present invention, the type of food can be wheaten food class, cooking class, broth class etc., due to Morning Afternoon Evening The type of corresponding food of eating is typically different, and therefore, in method shown in the embodiment of the present invention, multimedia play equipment can root The designated time period for showing recommendation message is determined according to the type of the corresponding food of the multimedia programming inquired, for example, working as more matchmakers When the type of the corresponding food of body segment mesh is wheaten food class, multimedia play equipment determines that designated time period is 6:30~7 in morning: 30, when the type of the corresponding food of multimedia programming is cooking class or broth class, when multimedia play equipment determines specified Between section be noon 10:30~11:30 and evening 17:30~18:30.

Specifically for example, by taking multimedia play equipment is smart television as an example, user opens refrigerator doors and stores food into refrigerator Material, and when refrigerator is closed, refrigerator shoots the image of refrigerator inside by camera, and the image taken is sent to intelligence TV, smart television carry out image recognition to the image that refrigerator sends over, and obtain the title (ratio for the food materials stored in refrigerator Such as, entitled egg and the tomato of food materials are determined), and obtained according to the title of the food materials from server or searched for from network The corresponding cooking video of the food materials, for example, the cooking video got has the cooking video and tomato egg noodle of tomato egg drop soup Cooking video.

Smart television is also communicated with culinary art electrical appliance equipment such as electromagnetic oven, micro-wave oven, smoke exhaust ventilator or electric cookers, and is obtained Take it is each culinary art electrical appliance equipment status information, when according to culinary art electrical appliance equipment status information determine some culinary art electricity consumption Device opening of device, for example, when detecting that electromagnetic oven is opened, it is believed that user may use the food materials in refrigerator to make food at this time Object can show recommendation information at this time, to prompt user that can play the cooking video or tomato egg noodle of tomato egg drop soup Cooking video.

Alternatively, smart television determines the class of the corresponding food of two cooking videos according to the profile information of two cooking videos Type is respectively broth class (tomato egg drop soup) and wheaten food class (tomato egg noodle), then smart television can be with 6:30~7:30 in the morning Period in, show the recommendation information of cooking video corresponding to tomato egg face, and 10:30~11:30 and evening at noon In the period of upper 17:30~18:30, the recommendation information of the corresponding cooking video of tomato egg drop soup is shown.

First image is sent to multimedia play equipment as food materials information using refrigerator by above scheme of the embodiment of the present invention For be illustrated, and in alternatively possible implementation, image recognition can also be carried out to the first image by refrigerator, with Determine the mark of food materials stored in refrigerator, the mark for the food materials stored in the refrigerator that will identify that is retrieved as food materials information, And it is sent to multimedia play equipment, multimedia play equipment is directly according to the inquiry of the mark for the food materials stored in refrigerator and refrigerator The corresponding multimedia programming of the food materials of middle storage.Wherein, refrigerator carries out the process and multimedia of image recognition to the first image The process that playback equipment carries out image recognition to the first image is similar, and details are not described herein again.

In conclusion multimedia programming methods of exhibiting provided in an embodiment of the present invention, refrigerator obtain automatically and are used to indicate this The food materials information for the food materials stored in refrigerator, and food materials information is sent to multimedia play equipment, by multimedia play equipment It inquires corresponding with food materials information multimedia programming to be simultaneously shown, i.e. multimedia play equipment in refrigerator according to storing Corresponding multimedia programming is searched for automatically and shown to food materials, does not need user's manual search, so that manual steps are simplified, Save user time.

Fig. 5 is a kind of flow chart of the multimedia programming methods of exhibiting shown according to another exemplary embodiment, this method It can be used in implementation environment shown in Fig. 1.It is removed as shown in figure 5, being used to indicate in refrigerator with the food materials information that refrigerator obtains Food materials for, which may include the following steps:

Step 501, during opening and closing refrigerator doors the last time of refrigerator, refrigerator is adopted by built-in image Collect unit acquisition refrigerator inside the second image and third image, the second image be refrigerator doors open when, refrigerator inside image, Third image be refrigerator doors close when, refrigerator inside image.

Unlike embodiment corresponding from Fig. 4, in embodiments of the present invention, the refrigerator of simultaneously closing refrigerator is opened in user During door, the image of refrigerator inside is acquired when refrigerator opens refrigerator doors and when refrigerator doors are closed respectively.For example, at this In inventive embodiments, when refrigerator doors are opened, image acquisition units acquisition ice is immediately controlled after control headlamp extinguishes in refrigerator Image inside case is as the first image, and when refrigerator doors are closed, refrigerator first controls Image Acquisition before control headlamp extinguishes Unit acquires the image of refrigerator inside as third image, after the completion of the third Image Acquisition, then controls headlamp extinguishing.

The case where for including two or more refrigerator doors, it is corresponding that refrigerator only needs to acquire the refrigerator doors being opened The second image and third image.

Step 502, second image and third image are retrieved as food materials information by refrigerator, and food materials information are sent to more Apparatus for media playing.

Second image and third image are sent to the process and above-mentioned Fig. 4 corresponding embodiment of multimedia play equipment by refrigerator In step 402 it is similar, details are not described herein again.

Step 503, multimedia play equipment carries out image recognition to second image and third image, to determine the refrigerator In the mark of food materials that is removed.

Specifically, the process of the mark for the food materials that multimedia play equipment identification is removed can be such that

Multimedia play equipment carries out image recognition to the second image, deposits in refrigerator when determining that the refrigerator doors of refrigerator are opened The mark for the food materials put, and image recognition is carried out to third image, it is stored in refrigerator when determining that the refrigerator doors of refrigerator are closed The mark of food materials, the mark for the food materials stored in refrigerator when finally being opened according to the refrigerator doors of refrigerator and the refrigerator doors of refrigerator The mark for the food materials stored in refrigerator when closing determines the mark for the food materials being removed in refrigerator.

Wherein, the mark for the food materials stored in refrigerator when being opened with refrigerator doors forms first identifier set and refrigerator doors The mark for the food materials stored in refrigerator when closing forms second identifier set, and multimedia play equipment can will be present in the first mark Know set, and is not present in mark of the mark of second identifier set as the food materials being removed in refrigerator.

For example, multimedia play equipment goes out refrigerator doors according to the second image recognition when opening, the food materials stored in refrigerator It is identified as food materials mark 1 and food materials mark 2, when going out refrigerator doors according to third image recognition and closing, the food materials that store in refrigerator It is identified as food materials mark 1 and food materials mark 3, then multimedia play equipment can determine being identified as the food materials being removed in refrigerator Food materials mark 2.

Further, user, for a certain food materials, may only take out one therein when taking out food materials from refrigerator Material is shared the meal, and remaining food materials is put back into refrigerator, in this case, multimedia play equipment is when carrying out image recognition, also Food materials amount in available image, and combination food materials amount determines the mark for the food materials being removed in refrigerator.

Specifically, multimedia play equipment can carry out image recognition to the second image, to determine that the refrigerator doors of refrigerator are beaten The food materials amount for the food materials stored in refrigerator when the mark and refrigerator doors for the food materials stored in refrigerator when opening are opened is (for example, food materials Amount can be the volume of food materials)；Multimedia play equipment carries out image recognition to third image, to determine that the refrigerator doors of refrigerator are closed The food materials amount for the food materials stored in refrigerator when the mark and refrigerator doors for the food materials stored in refrigerator when closing are closed；Last more matchmakers The mark for the food materials stored in refrigerator when body playback equipment is opened according to the refrigerator doors of refrigerator and the refrigerator of food materials amount and refrigerator The mark and food materials amount for the food materials stored in refrigerator when door is closed, determine the mark of food materials being removed in refrigerator.

Wherein, the mark for the food materials stored in refrigerator when being opened with refrigerator doors forms first identifier set and refrigerator doors The mark for the food materials stored in refrigerator when closing forms second identifier set, and multimedia play equipment can will be present in the first mark Know set, and is not present in the mark of second identifier set, and exist simultaneously in first identifier set and second identifier collection, and The mark of corresponding food materials amount reduction, the mark as the food materials being removed in refrigerator.

For example, multimedia play equipment goes out refrigerator doors according to the second image recognition when opening, the food materials stored in refrigerator It is identified as food materials mark 1 and food materials mark 2, corresponding food materials amount is 1 (i.e. 1 volume unit) and 2, according to third image When identifying that refrigerator doors are closed, the food materials that are identified as of the food materials stored in refrigerator identify 1 and food materials mark 3, corresponding food Material amount is 0.5 and 1, then multimedia play equipment can determine that the food materials that are identified as the food materials being removed in refrigerator identify 1 and food Material mark 2.

Similar, multimedia play equipment can locally carry out image recognition, can also be by the second image and third figure As being sent to cloud server, identified by cloud server.

Step 504, multimedia play equipment is according to the inquiry of the mark for the food materials being removed in the refrigerator and quilt in the refrigerator The corresponding multimedia programming of the food materials of taking-up.

The process of the corresponding multimedia programming of food materials being removed in multimedia play equipment inquiry refrigerator with above-mentioned Fig. 4 pairs Answer the process for inquiring the corresponding multimedia programming of food materials stored in refrigerator in embodiment similar, details are not described herein again.

Step 505, multimedia play equipment is shown the multimedia programming inquired.

Optionally, in embodiments of the present invention, when food materials are taken out from refrigerator due to user, it is likely to carry out quickly Food production, therefore, in embodiments of the present invention, multimedia play equipment can also show that multimedia programming is corresponding at once and push away Message is recommended, or plays the multimedia programming inquired at once.

Similar, above scheme of the embodiment of the present invention is sent the second image and third image as food materials information using refrigerator It, can also be by refrigerator to the second figure to being illustrated for multimedia play equipment, and in alternatively possible implementation Image recognition is carried out as the mark of the food materials store in refrigerator when image recognition determines that refrigerator doors are opened, and to third image Determine the mark for the food materials stored in refrigerator when refrigerator doors are closed, the mark for the food materials stored in refrigerator when opening according to refrigerator doors And the mark for the food materials stored in refrigerator when refrigerator doors closing determines the mark for the food materials being removed in refrigerator, by quilt in refrigerator The mark of the food materials of taking-up is retrieved as food materials information.

Optionally, refrigerator can also carry out image recognition to the second image, refrigerator when determining that the refrigerator doors of refrigerator are opened The food materials amount for the food materials stored in refrigerator when the mark and refrigerator doors of the food materials of middle storage are opened；Figure is carried out to third image As identification, when the mark and refrigerator doors of the food materials stored in refrigerator when determining that the refrigerator doors of refrigerator are closed are closed in refrigerator The food materials amount of the food materials of storage；The mark and food materials amount for the food materials stored in refrigerator when finally being opened according to the refrigerator doors of refrigerator, And the mark and food materials amount of food materials that the refrigerator doors of refrigerator are stored in refrigerator when closing, determine the food materials being removed in refrigerator Mark.

Above-mentioned refrigerator is to the process and multimedia play equipment of the second image and third image progress image recognition to second Image is similar with the third image progress process of image recognition, and details are not described herein again.

In conclusion multimedia programming methods of exhibiting provided in an embodiment of the present invention, refrigerator obtain automatically and are used to indicate this The food materials information for the food materials being removed in refrigerator, and food materials information is sent to multimedia play equipment, it is set by multimedia For future reference to ask multimedia programming corresponding with the food materials information and be shown, i.e., multimedia play equipment is taken according in refrigerator Corresponding multimedia programming is searched for automatically and shown to food materials out, does not need user's manual search, to simplify manual operation Step saves user time.

It should be noted that refrigerator is obtained by the image acquisition units of refrigerator inside in the above embodiment of the present invention The food materials information of the food materials information stored in refrigerator or the food materials being removed, in practical applications, refrigerator can also pass through it Its mode obtains the food materials information for the food materials stored or be removed in refrigerator.For example, operation panel can be set in refrigerator, use Family can input the food materials information for the food materials stored or be removed in refrigerator in operation panel, and refrigerator obtains user and operating The food materials information inputted in panel.

Following is apparatus of the present invention embodiment, can be used for executing embodiment of the present invention method.For apparatus of the present invention reality Undisclosed details in example is applied, embodiment of the present invention method is please referred to.

Referring to FIG. 6, it illustrates the block diagrams that a kind of multimedia programming shown in an exemplary embodiment shows device.It should Multimedia programming shows that device can be embodied as more matchmakers in implementation environment shown in Fig. 1 by way of hardware or soft or hard combination Body playback equipment 120 it is all or part of.The multimedia programming shows that device may include:

Information receiving module 601, for receiving the food materials information from refrigerator, the food materials information is used to indicate described The food materials being removed in the food materials or the refrigerator stored in refrigerator；

Enquiry module 602, for inquiring multimedia programming corresponding with the food materials information；

Display module 603, for being shown to the multimedia programming inquired.

Optionally, when the food materials information is used to indicate the food materials stored in the refrigerator, the food materials information includes First image, the first image be the refrigerator refrigerator doors the last time close when, the refrigerator inside image；

The enquiry module 602, comprising:

First recognition unit, for carrying out image recognition to the first image, with the food stored in the determination refrigerator The mark of material；

First query unit, for being stored according in the mark inquiry for the food materials stored in the refrigerator and the refrigerator The corresponding multimedia programming of food materials.

Optionally, when the food materials information is used to indicate the food materials being removed in the refrigerator, the food materials packet Include second image and third image collected in the process of refrigerator doors the last time opening and closing of the refrigerator, described the Two images be the refrigerator doors open when, the refrigerator inside image, the third image be the refrigerator doors close when, institute State the image of refrigerator inside；

The enquiry module 602, comprising:

Second recognition unit is beaten for carrying out image recognition to second image with the refrigerator doors of the determination refrigerator The mark for the food materials stored in the refrigerator when opening；

Third recognition unit is closed for carrying out image recognition to the third image with the refrigerator doors of the determination refrigerator The mark for the food materials stored in the refrigerator when closing；

First determination unit, the mark for the food materials stored in the refrigerator when for being opened according to the refrigerator doors of the refrigerator The mark for the food materials that the refrigerator doors of knowledge and the refrigerator are stored in the refrigerator when closing, determines and is removed in the refrigerator Food materials mark；

Second query unit, for being inquired according to the mark for the food materials being removed in the refrigerator and being stored in the refrigerator The corresponding multimedia programming of food materials.

Optionally, the display module 603, for showing the corresponding recommendation of the multimedia programming at the appointed time section Message.

In conclusion multimedia programming provided in an embodiment of the present invention shows that device, multimedia play equipment pass through reception It is used to indicate the food materials information of the food materials stored in refrigerator or the food materials being removed in the refrigerator, inquiry and the food materials information phase Corresponding multimedia programming is simultaneously shown, i.e., multimedia play equipment is searched automatically according to the food materials stored or be removed in refrigerator Rope simultaneously shows corresponding multimedia programming, does not need user's manual search, so that manual steps are simplified, when saving user Between.

Referring to FIG. 7, it illustrates the block diagrams that a kind of multimedia programming shown in an exemplary embodiment shows device.It should Multimedia programming shows that device can be embodied as the refrigerator in implementation environment shown in Fig. 1 by way of hardware or soft or hard combination 110 it is all or part of.The multimedia programming shows that device may include:

Data obtaining module 701, for obtaining food materials information, the food materials information is used to indicate to be stored in the refrigerator At least one of the food materials being removed in food materials and the refrigerator；

Information sending module 702, for the food materials information to be sent to multimedia play equipment, so as to the multimedia Playback equipment inquires multimedia programming corresponding with the food materials information, and opens up to the multimedia programming inquired Show.

Optionally, when the food materials information is used to indicate the food materials stored in the refrigerator, the data obtaining module 701, comprising: the first acquisition unit and first acquisition unit；Alternatively, the acquisition module, comprising: the first acquisition unit, the 4th Recognition unit and second acquisition unit；

First acquisition unit, it is described for acquiring the first image by the image acquisition units built in the refrigerator First image be the refrigerator refrigerator doors the last time close when, the refrigerator inside image；

The first acquisition unit, for the first image to be retrieved as the food materials information；

4th recognition unit, for carrying out image recognition to the first image；

The second acquisition unit, the food materials stored in the refrigerator for identifying the 4th recognition unit Mark is retrieved as the food materials information.

Optionally, when the food materials information is used to indicate the food materials being removed in the refrigerator, the acquisition of information mould Block 701, comprising: the second acquisition unit and third acquiring unit；Alternatively, the data obtaining module, comprising: the second acquisition is single Member, the 5th recognition unit, the 6th recognition unit, the second determination unit and the 4th acquiring unit；

Second acquisition unit, for leading to during the opening and closing of refrigerator doors the last time of the refrigerator Cross that image acquisition units built in the refrigerator acquire the second image and third image, second image are that the refrigerator doors are beaten When opening, the image of the refrigerator inside, the third image be the refrigerator doors close when, the refrigerator inside image；

The third acquiring unit, for second image and the third image to be retrieved as the food materials information；

5th recognition unit determines that the refrigerator doors open when institute for carrying out image recognition to second image State the mark for the food materials stored in refrigerator；

6th recognition unit determines that the refrigerator doors close when institute for carrying out image recognition to the third image State the mark for the food materials stored in refrigerator；

Second determination unit, the marks of the food materials stored in the refrigerator when for being opened according to the refrigerator doors with And the mark of food materials stored when closing in the refrigerator of the refrigerator doors determines the mark for the food materials being removed in the refrigerator；

4th acquiring unit is believed for the mark for the food materials being removed in the refrigerator to be retrieved as the food materials Breath.

In conclusion multimedia programming provided in an embodiment of the present invention shows that device, refrigerator obtain automatically and be used to indicate this The food materials information for the food materials stored or be removed in refrigerator, and food materials information is sent to multimedia play equipment, by multimedia Playback equipment is inquired multimedia programming corresponding with the food materials information and is shown, i.e., multimedia play equipment is according to refrigerator Corresponding multimedia programming is searched for automatically and shown to middle storage or the food materials being removed, and user's manual search is not needed, thus simple Change manual steps, saves user time.

The embodiment of the present invention also provides a kind of multimedia programming display systems, which may include that refrigerator and multimedia are broadcast Equipment is put, the connection type in the system between refrigerator and multimedia play equipment can refer to implementation environment shown in FIG. 1.

Wherein, which is used to execute all or part of step in method shown in Fig. 2, alternatively, holding The all or part of step executed in method shown in row Fig. 4 or Fig. 5 by multimedia play equipment.

The refrigerator is used to execute all or part of step in method shown in Fig. 3, alternatively, executing side shown in Fig. 4 or Fig. 5 The all or part of step executed in method by refrigerator.

Referring to FIG. 8, the structural schematic diagram of the electronic equipment provided it illustrates an exemplary embodiment of the invention.This public affairs Opening the electronic equipment in embodiment may include one or more following component parts: for executing computer program instructions with complete At the processor of various processes and method, for information and storage program instruction random access memory (RAM) and read-only storage Device (ROM), for storing data with the memory of information, I/O equipment, interface, antenna etc..Specifically:

Electronic equipment 800 may include RF (Radio Frequency, radio frequency) circuit 810, memory 820, input unit 830, display unit 840, sensor 850, voicefrequency circuit 860, WiFi (wireless fidelity, Wireless Fidelity) module 870, the components such as processor 880, power supply 882, camera 890.It will be understood by those skilled in the art that electronics shown in Fig. 8 Device structure does not constitute the restriction to electronic equipment, may include components more more or fewer than diagram, or combine certain Component or different component layouts.

It is specifically introduced below with reference to each component parts of the Fig. 8 to electronic equipment 800:

RF circuit 810 can be used for receiving and sending messages or communication process in, signal sends and receivees, particularly, by base station After downlink information receives, handled to processor 880；In addition, the data for designing uplink are sent to base station.In general, RF circuit packet Include but be not limited to antenna, at least one amplifier, transceiver, coupler, LNA (Low Noise Amplifier, low noise Amplifier), duplexer etc..In addition, RF circuit 810 can also be communicated with network and other equipment by wireless communication.The nothing Any communication standard or agreement, including but not limited to GSM (Global System of Mobile can be used in line communication Communication, global system for mobile communications), GPRS (General Packet Radio Service, general packet without Line service), CDMA (Code Division Multiple Access, CDMA), WCDMA (Wideband Code Division Multiple Access, wideband code division multiple access), LTE (Long Term Evolution, long term evolution), electronics Mail, SMS (Short Messaging Service, short message service) etc..

Memory 820 can be used for storing software program and module, and processor 880 is stored in memory 820 by operation Software program and module, thereby executing the various function application and data processing of electronic equipment 800.Memory 820 can It mainly include storing program area and storage data area, wherein storing program area can be needed for storage program area, at least one function Application program (such as sound-playing function, image player function etc.) etc.；Storage data area can be stored according to electronic equipment 800 Use created data (such as audio data, phone directory etc.) etc..In addition, memory 820 may include that high speed is deposited at random Access to memory, can also include nonvolatile memory, a for example, at least disk memory, flush memory device or other easily The property lost solid-state memory.

Input unit 830 can be used for receiving the number or character information of input, and generate the user with electronic equipment 800 Setting and the related key signals input of function control.Specifically, input unit 830 may include touch panel 831 and other Input equipment 832.Touch panel 831, also referred to as touch screen collect the touch operation of user on it or nearby and (for example use Family uses the behaviour of any suitable object or attachment on touch panel 831 or near touch panel 831 such as finger, stylus Make), and corresponding attachment device is driven according to preset formula.Optionally, touch panel 831 may include touch detection dress It sets and two parts of touch controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect touch operation and bring Signal, transmit a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and it is turned It changes contact coordinate into, then gives processor 880, and order that processor 880 is sent can be received and executed.Furthermore, it is possible to Touch panel 831 is realized using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves.In addition to touch panel 831, input unit 830 can also include other input equipments 832.Specifically, other input equipments 832 may include but unlimited In one of physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc. or It is a variety of.

Display unit 840 can be used for showing information input by user or the information and electronic equipment that are supplied to user 800 various menus.Display unit 840 may include display panel 841, optionally, can use LCD (Liquid Crystal Display, liquid crystal display), the forms such as OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) come Configure display panel 841.Further, touch panel 831 can cover display panel 841, when touch panel 831 is detected at it On or near touch operation after, send processor 880 to determine the type of touch event, be followed by subsequent processing device 880 according to touching The type for touching event provides corresponding visual output on display panel 841.Although in fig. 8, touch panel 831 and display surface Plate 841 is the input and input function for realizing electronic equipment 800 as two independent components, but in some embodiments In, can be integrated by touch panel 831 and display panel 841 and that realizes electronic equipment 800 output and input function.

Electronic equipment 800 may also include at least one sensor 850, such as gyro sensor, magnetic induction sensor, light Sensor, motion sensor and other sensors.Specifically, optical sensor may include ambient light sensor and close sensing Device, wherein ambient light sensor can adjust the brightness of display panel 841 according to the light and shade of ambient light, and proximity sensor can When electronic equipment 800 is moved in one's ear, display panel 841 and/or backlight are closed.As a kind of motion sensor, accelerate Spending sensor can detect the size of (generally three axis) acceleration in all directions, can detect that size and the side of gravity when static To, can be used to identify electronic equipment posture application (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), vibration Identify correlation function (such as pedometer, percussion) etc.；Barometer, the hygrometer, temperature that can also configure as electronic equipment 800 The other sensors such as meter, infrared sensor, details are not described herein.

Voicefrequency circuit 860, loudspeaker 861, microphone 862 can provide the audio interface between user and electronic equipment 800. Electric signal after the audio data received conversion can be transferred to loudspeaker 861, be converted by loudspeaker 861 by voicefrequency circuit 860 For voice signal output；On the other hand, the voice signal of collection is converted to electric signal by microphone 862, is connect by voicefrequency circuit 860 Audio data is converted to after receipts, then by after the processing of audio data output processor 880, is sent to through RF circuit 810 such as another One electronic equipment, or audio data is exported to memory 820 to be further processed.

WiFi belongs to short range wireless transmission technology, and electronic equipment 800 can help user to receive and dispatch by WiFi module 870 Email, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 8 WiFi module 870 is shown, but it is understood that, and it is not belonging to must be configured into for electronic equipment 800, it completely can root It is omitted according in the range for needing the essence disclosed in not changing.

Processor 880 is the control centre of electronic equipment 800, utilizes various interfaces and the entire electronic equipment of connection Various pieces by running or execute the software program and/or module that are stored in memory 820, and are called and are stored in Data in reservoir 820 execute the various functions and processing data of electronic equipment 800, to carry out whole prison to electronic equipment Control.Optionally, processor 880 may include one or more processing units；Preferably, processor 880 can integrate application processor And modem processor, wherein the main processing operation system of application processor, user interface and application program etc., modulatedemodulate Processor is adjusted mainly to handle wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor In 880.

Electronic equipment 800 further includes the power supply 882 (such as battery) powered to all parts, it is preferred that power supply can lead to Cross power-supply management system and processor 880 be logically contiguous, thus by power-supply management system realize management charging, electric discharge and The functions such as power managed.

Camera 890 is generally by groups such as camera lens, imaging sensor, interface, digital signal processor, CPU, display screens At.Wherein, camera lens is fixed on the top of imaging sensor, can change focusing by manually adjusting camera lens；Imaging sensor It is equivalent to " film " of traditional camera, is the heart of camera collection image；Interface is used for camera using winding displacement, plate to plate Connector, spring connection type are connect with electronic equipment mainboard, and the image of acquisition is sent to the memory 820；Number Signal processor is handled by image of the mathematical operation to acquisition, and the analog image of acquisition is converted to digital picture and is led to It crosses interface and is sent to memory 820.

Although being not shown, electronic equipment 800 can also be including bluetooth module etc., and details are not described herein.

Electronic equipment 800 in addition to including one or more processor 880, further include have memory and one or Multiple programs, one or more program are stored in memory, and are configured to be held by one or more processor Row.Processor 880 executes said one or multiple programs to realize multimedia programming exhibition shown in each embodiment of the present invention Show all or part of step of method.

In the present invention, above-mentioned electronic equipment 800 can be implemented as the refrigerator 110 or more in implementation environment shown in Fig. 1 Apparatus for media playing 120.

Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to of the invention its Its embodiment.This application is intended to cover any variations, uses, or adaptations of the invention, these modifications, purposes or Person's adaptive change follows general principle of the invention and including the undocumented common knowledge in the art of the present invention Or conventional techniques.The description and examples are only to be considered as illustrative, and true scope and spirit of the invention are by following Claim is pointed out.

It should be understood that the present invention is not limited to the precise structure already described above and shown in the accompanying drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present invention is limited only by the attached claims.

Claims

1. a kind of multimedia programming display systems, which is characterized in that the system comprises: multimedia play equipment and refrigerator；

The refrigerator is sent to the multimedia play equipment, the food for obtaining food materials information, and by the food materials information At least one of the food materials that material information is used to indicate the food materials stored in the refrigerator and is removed in the refrigerator；

The multimedia play equipment, for receiving the food materials information from the refrigerator, inquiry is believed with the food materials The corresponding multimedia programming of manner of breathing；It determines designated time period, and shows the multimedia programming pair in the designated time period The recommendation message answered, the recommendation message play the multimedia programming for recommending；When detecting to the recommendation message When determining play operation, the multimedia programming is shown；

Wherein, when the food materials information is used to indicate the food materials stored in the refrigerator, the acquisition food materials information, comprising:

When the refrigerator contains at least two refrigerator doors, and any one refrigerator doors at least two refrigerator doors are opened And when closing, it is opened by this and the corresponding image acquisition units of refrigerator doors closed acquires image；

Other refrigerator doors that this is unopened are obtained in upper primary opening and image that while closing acquires；

The image and other this of the corresponding image acquisition units acquisition of the refrigerator doors that this is opened and is closed are not beaten The refrigerator doors opened are in upper primary opening and image that while closing acquires is retrieved as the first image；

The first image is retrieved as the food materials information；

Wherein, the determining designated time period, comprising:

The status information for obtaining designated equipment, when the status information of the designated equipment indicates that the designated equipment is currently running When, determine that a preset length period after current time is the designated time period, the designated equipment is culinary art electricity Device equipment；Alternatively,

The status information for obtaining designated equipment, when the status information of the designated equipment indicates that the designated equipment is currently running When, determine that a preset length period after current time is the designated time period, and obtain the multimedia section The type information of the corresponding food of mesh determines the specified time according to the type information of the corresponding food of the multimedia programming Section, the designated equipment are cooking appliance equipment, and the type information of the food is used to indicate involved in the multimedia programming Food type.

2. a kind of multimedia programming methods of exhibiting, which is characterized in that in multimedia play equipment, which comprises

The food materials information from refrigerator is received, the food materials information is used to indicate the food materials stored in the refrigerator or described The food materials being removed in refrigerator；

It determines designated time period, and shows the corresponding recommendation message of the multimedia programming in the designated time period, it is described Recommendation message plays the multimedia programming for recommending；It is right when detecting the determination play operation to the recommendation message The multimedia programming is shown；

Wherein, when the food materials information is used to indicate the food materials stored in the refrigerator, the food materials information includes the first figure Picture, the first image is to contain at least two refrigerator doors in the refrigerator, and any one at least two refrigerator doors When a refrigerator doors are opened and close, this is opened and the image of the corresponding image acquisition units acquisition of the refrigerator doors closed, And other refrigerator doors that this is unopened are in upper primary opening and image that while closing acquires；

Wherein, the determining designated time period, comprising:

3. according to the method described in claim 2, it is characterized in that, being stored when the food materials information is used to indicate in the refrigerator Food materials when, the food materials information includes the first image；

It is described to inquire multimedia programming corresponding with the food materials information, comprising:

Image recognition is carried out to the first image, with the mark for the food materials stored in the determination refrigerator；

Multimedia section corresponding with the food materials stored in the refrigerator is inquired according to the mark for the food materials stored in the refrigerator Mesh.

4. according to the method described in claim 2, it is characterized in that, being taken when the food materials information is used to indicate in the refrigerator When food materials out, the food materials information includes that the process that opens and closes in refrigerator doors the last time of the refrigerator is collected Second image and third image, second image be the refrigerator doors open when, the refrigerator inside image, the third Image be the refrigerator doors close when, the refrigerator inside image；

Image recognition is carried out to second image, the food stored in the refrigerator when opening with the refrigerator doors of the determination refrigerator The mark of material；

Image recognition is carried out to the third image, the food stored in the refrigerator when closing with the refrigerator doors of the determination refrigerator The mark of material；

The mark for the food materials stored in the refrigerator when being opened according to the refrigerator doors of the refrigerator and the refrigerator doors of the refrigerator The mark for the food materials stored in the refrigerator when closing determines the mark for the food materials being removed in the refrigerator；

Multimedia corresponding with the food materials stored in the refrigerator is inquired according to the mark for the food materials being removed in the refrigerator Program.

5. a kind of media program methods of exhibiting, which is characterized in that in refrigerator, which comprises

Food materials information is obtained, the food materials information is used to indicate the food materials stored in the refrigerator and is removed in the refrigerator At least one of food materials；

The food materials information is sent to multimedia play equipment, so that multimedia play equipment inquiry is believed with the food materials The corresponding multimedia programming of manner of breathing at the appointed time shows the corresponding recommendation message of the multimedia programming in section, when detecting When to the determination play operation of the recommendation message, the multimedia programming is shown, the recommendation message is for recommending Play the multimedia programming；The designated time period is that the multimedia play equipment is indicated in the status information of designated equipment A preset length period after the current time determined when the designated equipment is currently running；Alternatively, when described specified Between section be the multimedia play equipment when the status information of designated equipment indicates that the designated equipment is currently running determine A preset length period and the designated time period after current time are the multimedia play equipments according to institute The type information for stating multimedia programming corresponding food, which determines, to be obtained；The designated equipment is cooking appliance equipment, the food The type information of object is used to indicate the type of food involved in the multimedia programming；

The first image is retrieved as the food materials information.

6. according to the method described in claim 5, it is characterized in that, being taken when the food materials information is used to indicate in the refrigerator When food materials out, the acquisition food materials information, comprising:

During opening and closing refrigerator doors the last time of the refrigerator, pass through the Image Acquisition list built in the refrigerator When member acquisition the second image and third image, second image are that the refrigerator doors are opened, the image of the refrigerator inside, institute State third image be the refrigerator doors close when, the refrigerator inside image；

Second image and the third image are retrieved as the food materials information；Alternatively, carrying out figure to second image The mark for the food materials stored in the refrigerator when determining that the refrigerator doors are opened as identifying, and image is carried out to the third image Identify the mark for determining the food materials stored in the refrigerator when refrigerator doors are closed, ice when opening according to the refrigerator doors The mark for the food materials that the mark for the food materials stored in case and the refrigerator doors are stored in the refrigerator when closing determines the ice The mark for the food materials being removed in the refrigerator is retrieved as the food materials information by the mark for the food materials being removed in case.

7. a kind of multimedia programming shows device, which is characterized in that in multimedia play equipment, described device to include:

Information receiving module, for receiving the food materials information from refrigerator, the food materials information is used to indicate in the refrigerator The food materials being removed in the food materials of storage or the refrigerator；

Display module shows that the multimedia programming is corresponding for determining designated time period, and in the designated time period Recommendation message, the recommendation message play the multimedia programming for recommending；When detecting the determination to the recommendation message When play operation, the multimedia programming is shown；

Wherein, the display module is also used to:

8. device according to claim 7, which is characterized in that stored when the food materials information is used to indicate in the refrigerator Food materials when, the food materials information includes the first image；

The enquiry module, comprising:

First recognition unit, for carrying out image recognition to the first image, with the food materials stored in the determination refrigerator Mark；

First query unit, for according to the food materials stored in the mark inquiry for the food materials stored in the refrigerator and the refrigerator Corresponding multimedia programming.

9. device according to claim 7, which is characterized in that taken when the food materials information is used to indicate in the refrigerator When food materials out, the food materials information includes that the process that opens and closes in refrigerator doors the last time of the refrigerator is collected Second image and third image, second image be the refrigerator doors open when, the refrigerator inside image, the third Image be the refrigerator doors close when, the refrigerator inside image；

The enquiry module, comprising:

Second recognition unit, for carrying out image recognition to second image, when being opened with the refrigerator doors of the determination refrigerator The mark for the food materials stored in the refrigerator；

Third recognition unit, for carrying out image recognition to the third image, when being closed with the refrigerator doors of the determination refrigerator The mark for the food materials stored in the refrigerator；

First determination unit, the mark for the food materials stored in the refrigerator when for being opened according to the refrigerator doors of the refrigerator, with And the mark of food materials that the refrigerator doors of the refrigerator are stored in the refrigerator when closing, determine the food materials being removed in the refrigerator Mark；

Second query unit, for according to the food stored in the mark inquiry for the food materials being removed in the refrigerator and the refrigerator The corresponding multimedia programming of material.

10. a kind of media program shows device, which is characterized in that in refrigerator, described device to include:

Data obtaining module, for obtaining food materials information, the food materials information be used to indicate the food materials stored in the refrigerator with And at least one of food materials being removed in the refrigerator；

Information sending module, for the food materials information to be sent to multimedia play equipment, so that the multimedia is set It is for future reference to ask multimedia programming corresponding with the food materials, the corresponding recommendation of the multimedia programming is at the appointed time shown in section Message is shown the multimedia programming when detecting the determination play operation to the recommendation message, the recommendation Message plays the multimedia programming for recommending；The designated time period is the multimedia play equipment in designated equipment Status information indicates a preset length period after the current time determined when the designated equipment is currently running；Or Person, status information of the designated time period for the multimedia play equipment in designated equipment are indicating the designated equipment A preset length period and the designated time period after the current time determined when operation are that the multimedia is broadcast Put what equipment was obtained according to the determination of the type information of the corresponding food of the multimedia programming；The designated equipment is cooking appliance Equipment, the type information of the food are used to indicate the type of food involved in the multimedia programming；

Wherein, when the food materials information is used to indicate the food materials stored in the refrigerator, the data obtaining module is used for:

The first image is retrieved as the food materials information.

11. device according to claim 10, which is characterized in that when the food materials information is used to indicate quilt in the refrigerator When the food materials of taking-up, the data obtaining module, comprising: the second acquisition unit and third acquiring unit；Alternatively, the information obtains Modulus block, comprising: the second acquisition unit, the 5th recognition unit, the 6th recognition unit, the second determination unit and the 4th obtain single Member；

Second acquisition unit, for passing through institute during the opening and closing of refrigerator doors the last time of the refrigerator It states the image acquisition units built in refrigerator and acquires the second image and third image, second image is that the refrigerator doors are opened When, the refrigerator inside image, the third image be the refrigerator doors close when, the refrigerator inside image；

5th recognition unit, for carrying out ice when image recognition determines that the refrigerator doors are opened to second image The mark for the food materials stored in case；

6th recognition unit, for carrying out ice when image recognition determines that the refrigerator doors are closed to the third image The mark for the food materials stored in case；

Second determination unit, the mark for the food materials stored in the refrigerator when for being opened according to the refrigerator doors and institute The mark for stating the food materials stored in the refrigerator when refrigerator doors are closed determines the mark for the food materials being removed in the refrigerator；

4th acquiring unit, for the mark for the food materials being removed in the refrigerator to be retrieved as the food materials information.