WO2020054609A1 - Heat cooking device - Google Patents

Heat cooking device Download PDF

Info

Publication number
WO2020054609A1
WO2020054609A1 PCT/JP2019/035169 JP2019035169W WO2020054609A1 WO 2020054609 A1 WO2020054609 A1 WO 2020054609A1 JP 2019035169 W JP2019035169 W JP 2019035169W WO 2020054609 A1 WO2020054609 A1 WO 2020054609A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
heated
image recognition
candidates
candidate
Prior art date
Application number
PCT/JP2019/035169
Other languages
French (fr)
Japanese (ja)
Inventor
志奇 黄
貞平　匡史
幸　裕弘
Original Assignee
パナソニックＩｐマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックＩｐマネジメント株式会社 filed Critical パナソニックＩｐマネジメント株式会社
Priority to CN201980003781.0A priority Critical patent/CN111183317A/en
Priority to JP2019569854A priority patent/JP7403044B2/en
Publication of WO2020054609A1 publication Critical patent/WO2020054609A1/en

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
    • F24C7/00—Stoves or ranges heated by electric energy
    • F24C7/04—Stoves or ranges heated by electric energy with heat radiated directly from the heating element
    • F24C7/043—Stoves
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
    • F24C15/00—Details
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
    • F24C7/00—Stoves or ranges heated by electric energy
    • F24C7/02—Stoves or ranges heated by electric energy using microwaves
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00—Heating by electric, magnetic or electromagnetic fields
    • H05B6/02—Induction heating
    • H05B6/10—Induction heating apparatus, other than furnaces, for specific applications
    • H05B6/12—Cooking devices

Definitions

  • the present disclosure relates to a cooking device.
  • microwave ovens have a radiation heating function and a steam heating function in addition to the microwave heating function.
  • a heating cooker has a cooking menu suitable for the food material to be heated, and performs heating suitable for the type of food (rice, milk, vegetables, etc.) selected by the cooking menu button. There are models that can do this.
  • a heating cooker having a camera arranged in a heating chamber and automatically heating the object according to the type of an object to be heated specified by image recognition.
  • heating suitable for the object to be heated can be automatically performed without the user selecting the type of the object to be heated.
  • Patent Document 1 In order to solve this problem, the following heating cooker has been proposed (for example, see Patent Document 1).
  • the heating cooker described in Patent Literature 1 extracts, for example, three candidates from a large number of candidates for an object to be heated based on the result of image recognition, and displays the candidates in the order of the certainty of the recognition. The user selects one of the displayed candidates using a selection button or the like.
  • Patent Literature 1 The heating cooker described in Patent Literature 1 has a large number of candidates for the object to be heated even when there is no object to be heated in the heating chamber or when a foreign substance (a non-food item such as a dish) is contained in the heating chamber. Extract and display some candidates.
  • Patent Literature 1 when machine learning such as deep learning is used for image recognition, the cooking device described in Patent Literature 1 always uses some of a large number of objects to be heated based on some certainty. Extract and display candidates.
  • the heating cooker described in Patent Literature 1 may perform unnecessary heating or display unnecessary candidates every time.
  • the present disclosure provides a heating cooker that does not perform heating and does not display unnecessary candidates when an object to be heated is not arranged in a heating chamber or when a foreign object is placed in the heating chamber. With the goal.
  • a heating cooker includes a heating cooker, a photographing unit, an image recognition unit, an adjustment unit, and a display unit.
  • the heating cooking unit heats the object to be heated.
  • the imaging unit captures an image of the object to be heated.
  • the image recognition unit performs image recognition on the image of the object to be heated, and extracts a plurality of candidates for the object to be heated based on the likelihood. Further, the image recognition unit determines that the object to be heated is not disposed in the heating cooking unit and that the object to be heated is a foreign substance.
  • the adjustment unit adjusts the display order of the plurality of candidates extracted by the image recognition unit.
  • the display unit displays a plurality of candidates in the display order adjusted by the adjustment unit. Further, the display unit, when the image recognition unit determines that the object to be heated is not disposed in the heating cooking unit, or when the image recognition unit determines that the object to be heated is a foreign substance, Don't show suggestions for
  • the heating cooker according to this aspect can prevent unnecessary heating and display of unnecessary candidates when an object to be heated is not arranged in the heating chamber or when a foreign object is placed in the heating chamber. it can.
  • FIG. 1 is a block diagram illustrating a configuration of the heating cooker according to the embodiment.
  • FIG. 2 is a block diagram illustrating a configuration of a microwave oven with an oven function, which is a heating cooker according to the embodiment.
  • FIG. 3 is a diagram illustrating an example of a candidate list stored in the candidate storage unit.
  • FIG. 4 is a diagram illustrating an example of a selection history table stored in the history storage unit.
  • FIG. 5 is a flowchart of cooking control in the heating cooker according to the embodiment.
  • FIG. 6 is a flowchart for extracting candidates in cooking control.
  • FIG. 7 is a diagram illustrating a first example of a candidate extraction result.
  • FIG. 8 is a diagram illustrating a second example of a candidate extraction result.
  • FIG. 1 is a block diagram illustrating a configuration of the heating cooker according to the embodiment.
  • FIG. 2 is a block diagram illustrating a configuration of a microwave oven with an oven function, which is a heating cooker according to the embodiment
  • FIG. 9 is a diagram illustrating a third example of a candidate extraction result.
  • FIG. 10 is a flowchart of adjusting the display order in the cooking control.
  • FIG. 11 is a diagram illustrating an example of a display screen of the display unit in the heating cooker according to the embodiment.
  • FIG. 12 is a flowchart of saving the selection history in the cooking control.
  • FIG. 13 is a block diagram illustrating a configuration of a heating cooker according to a first modification of the embodiment.
  • FIG. 14 is a block diagram illustrating a configuration of a heating cooker according to a second modification of the embodiment.
  • FIG. 15 is a block diagram illustrating a configuration of a heating cooker according to a third modification of the embodiment.
  • the heating cooker according to the first aspect of the present disclosure includes a heating cooking unit, an imaging unit, an image recognition unit, an adjustment unit, and a display unit.
  • the heating cooking unit heats the object to be heated.
  • the imaging unit captures an image of the object to be heated.
  • the image recognition unit performs image recognition on the image of the object to be heated, and extracts a plurality of candidates for the object to be heated based on the likelihood. Further, the image recognition unit determines that the object to be heated is not disposed in the heating cooking unit and that the object to be heated is a foreign substance.
  • the adjustment unit adjusts the display order of the plurality of candidates extracted by the image recognition unit.
  • the display unit displays a plurality of candidates in the display order adjusted by the adjustment unit. Further, the display unit, when the image recognition unit determines that the object to be heated is not disposed in the heating cooking unit, or when the image recognition unit determines that the object to be heated is a foreign substance, Don't show suggestions for
  • the image recognition unit may include, when a numerical value indicating the likelihood of the most probable candidate is lower than a predetermined threshold. It is determined that the object to be heated is a foreign substance.
  • the image recognition unit may determine that the object to be heated is a foreign substance when the most probable candidate among the plurality of candidates is a foreign substance. judge.
  • the heating cooker according to the fourth aspect of the present disclosure further includes a presentation unit in addition to the first aspect.
  • the presentation unit determines a candidate for the object to be heated. Is not extracted.
  • the presentation unit is the display unit.
  • the display unit displays a candidate for the object to be heated. A message is displayed indicating that is not extracted.
  • the presentation unit is a speaker.
  • the speaker When the image recognition unit determines that the object to be heated is not arranged in the heating cooking unit, or when the image recognition unit determines that the object to be heated is a foreign substance, the speaker outputs a candidate for the object to be heated. Outputs audio indicating that it does not exist.
  • the heating cooker in addition to the first aspect, includes an operation unit configured to allow a user to select one candidate from among a plurality of candidates, and as selection history information, And a history storage unit that stores the plurality of candidates in association with the one candidate.
  • the adjustment unit determines the display order of the plurality of candidates based on the selection history information.
  • the heating cooker according to the eighth aspect of the present disclosure further includes a clock unit that measures the current time, in addition to the seventh aspect.
  • the history storage unit stores, as selection history information, a selection time period in which the one candidate is selected and a selection frequency at which the one candidate is selected in the selection time period.
  • the history storage unit stores a display order of a plurality of candidates when the one candidate is selected.
  • the adjustment unit extracts the selection history information having the same selection time zone and the highest selection frequency from the selection history information, The display order of a plurality of candidates is determined according to the extracted selection history information.
  • the history storage unit is provided in an external server.
  • the heating cooking unit has a heating chamber configured to accommodate an object to be heated.
  • the heating cooking unit is disposed below the top plate and a top plate configured to place an object to be heated. And an induction heating coil.
  • FIG. 1 is a block diagram illustrating a configuration of the heating cooker 1.
  • the cooking device 1 includes a cooking unit 10, an imaging unit 20, a control unit 30, a storage unit 40, an operation unit 50, and a display unit 60.
  • the storage unit 40 includes a candidate storage unit 41 and a history storage unit 42.
  • FIG. 2 is a block diagram showing a configuration of a microwave oven with an oven function, which is the cooking device 1.
  • the cooking device 1 is a microwave oven having an oven function and having a heating chamber 11.
  • the heating chamber 11 has an inner box 12a that divides the heating chamber 11, and an outer box 12b that surrounds the inner box 12a.
  • a door 13 is provided on the front surface of the heating chamber 11 so as to cover the front opening of the heating chamber 11.
  • the heating cooking unit 10 has a magnetron (not shown) that oscillates microwaves, and has a microwave heating function of heating the object to be heated 2 accommodated in the heating chamber 11 by microwaves.
  • the cooking unit 10 has a radiation heating function using a radiation heater 14 in addition to the microwave heating function.
  • the image capturing unit 20 is a camera that captures an image of the object 2 placed in the heating chamber 11 as, for example, a color still image.
  • the photographing unit 20 includes an image sensor such as a CCD (Charge Coupled Device) image sensor and a CMOS (Complementary Metal-Oxide Semiconductor) image sensor.
  • the photographing unit 20 is provided above the side wall of the inner box 12a.
  • the control unit 30 is configured by a microcomputer, and includes an image recognition unit 31, an adjustment unit 32, and a clock unit 33.
  • the image recognizing unit 31 performs image recognition on the image captured by the capturing unit 20 to determine whether the heating target 2 is disposed in the heating cooking unit 10.
  • Image recognition in the image recognition unit 31 is performed using machine learning. Deep learning or artificial intelligence can be used as machine learning for image recognition.
  • the image recognition unit 31 compares the image inside the heating chamber 11 photographed by the photographing unit 20 with the image inside the heating chamber 11 when the object to be heated 2 does not exist in the heating chamber 11. By doing so, it is determined whether or not the article 2 to be heated is placed in the heating chamber 11.
  • the image recognizing unit 31 further performs image recognition on the image captured by the capturing unit 20 to extract a plurality of candidates for the object to be heated 2 in order of likelihood.
  • the image recognizing unit 31 recognizes a shape, a color tone, a color, and the like of the object to be heated 2 from an image inside the heating chamber 11 captured by the capturing unit 20.
  • the image recognition unit 31 compares this result with the candidate list stored in the candidate storage unit 41.
  • the image recognizing unit 31 extracts some candidates relating to the object to be heated 2 in descending order of certainty based on the correlation between the candidate images registered in the candidate list and the images photographed by the photographing unit 20. .
  • three candidates are extracted as an extraction candidate C1, an extraction candidate C2, and an extraction candidate C3.
  • Probability is represented by a numerical value from 0% to 100%. The higher the numerical value indicating the certainty, the higher the possibility that the candidate matches the object to be heated 2 arranged in the heating chamber 11.
  • the candidate list includes not only foods that can be candidates for the object to be heated 2 but also foreign substances that do not need to be heated, such as dishes and plastic containers. That is, in the candidate list, foreign matter is also included as a candidate for the object to be heated 2.
  • the candidate storage unit 41 stores the candidates in the candidate list as image data in advance by machine learning or the like.
  • data on candidates in the candidate list is information including, for example, shape and color.
  • the candidate storage unit 41 may store the information that has been subjected to the machine learning again, including the information added later, as a candidate in the candidate list.
  • the image recognizing unit 31 determines that the object to be heated 2 is a foreign substance when the most probable candidate is a foreign substance among the plurality of candidates extracted by comparing the image recognition result with the candidate list.
  • the image recognizing unit 31 determines that the object to be heated 2 is a foreign object when the numerical value indicating the probability of the most probable candidate among the plurality of candidates extracted by the image recognition is lower than a predetermined threshold. Good.
  • the image recognition unit 31 compares the result of the image recognition with the candidate list, and determines that there is no candidate for the object to be heated 2 in the candidate list, it determines that the object to be heated 2 is a foreign substance. Is also good.
  • the adjustment unit 32 adjusts the display order of the plurality of candidates extracted by the image recognition unit 31. Specifically, the adjustment unit 32 determines the display order of the plurality of candidates based on the selection history information stored in the history storage unit 42.
  • the user selects one candidate from the plurality of candidates adjusted by the adjustment unit 32 and displayed on the display unit 60 using the operation unit 50.
  • the history storage unit 42 stores a plurality of past candidates extracted by the image recognition unit 31 and one candidate selected by the operation unit 50 in association with each other as selection history information.
  • the operation unit 50 may be constituted by mechanical buttons or a touch panel.
  • the touch panel may constitute the display unit 60.
  • the touch panel forms an operation display unit.
  • the history storage unit 42 stores the selection history information described in the selection history table. Specifically, the history storage unit 42 stores the display order of a plurality of candidates when one candidate (“selected heating target” illustrated in FIG. 4) is selected by the operation unit 50.
  • the history storage unit 42 stores the three candidates extracted by the image recognition unit 31 as history candidates M1, M2, and M3.
  • the history storage unit 42 stores, in addition to the history candidates M1, M2, and M3, one candidate selected by the operation unit 50, a selected time zone in which the selection was performed, and the one candidate in the selected time zone.
  • the selection frequency to be selected is stored as selection history information.
  • the adjustment unit 32 extracts the selection history information having the same selection time zone and the highest selection frequency from the selection history information, and determines the display order of a plurality of candidates according to the extracted selection history information.
  • the clock unit 33 measures the current time, and specifies the selected time zone in which one of the candidates has been selected by the operation unit 50 based on the current time.
  • the history storage unit 42 stores the selected time period.
  • the display unit 60 displays a plurality of candidates in the display order adjusted by the adjustment unit 32.
  • the display unit 60 includes a liquid crystal panel or the like.
  • the display unit 60 displays the items selected by the operation of the cooking menu button and the like, the determined heating conditions (output, temperature, time, etc.), the cooking menu, the start button, and the cancel button.
  • the driving state may be displayed.
  • the display unit 60 functions as a presentation unit. In this case, the display unit 60 does not display the candidate for the object to be heated 2, but instead displays a message indicating that no candidate for the object to be heated 2 is extracted.
  • FIG. 5 is a flowchart of the cooking control in the heating cooker 1.
  • the photographing unit 20 photographs the inside of the heating chamber 11, and the image recognition unit 31 performs image recognition on this image. Then, it is determined whether the article to be heated 2 is placed in the heating chamber 11 or not.
  • the storage unit 40 previously stores, as a reference image, an image inside the heating chamber 11 when the object 2 to be heated does not exist in the heating chamber 11.
  • the image recognition unit 31 compares the reference image with the image inside the heating chamber 11 by image recognition to determine whether or not the article 2 to be heated is placed in the heating chamber 11.
  • the display unit 60 displays a candidate for the object to be heated 2. Without this, the cooking control ends. That is, cooking is not performed. At this time, the display unit 60 displays a message indicating that the article 2 to be heated does not exist in the heating chamber 11. The display unit 60 may display a message indicating that no candidate relating to the object to be heated 2 is extracted.
  • step S10 the image recognition unit 31 extracts a candidate.
  • FIG. 6 is a flowchart for extracting candidates in cooking control.
  • the image recognition unit 31 performs image recognition on an image captured by the imaging unit 20, and identifies a plurality of candidates for the object 2 to be heated. Extract based on
  • the image recognition unit 31 includes an image of the inside of the heating chamber 11 captured by the capturing unit 20 and an image of a candidate registered in a candidate list (see FIG. 3) stored in the candidate storage unit 41. Compare with As a result of comparing the two images, the image recognition unit 31 recognizes a candidate having a higher correlation as a more likely candidate. The image recognition unit 31 extracts a plurality of candidates for the object to be heated 2 based on the likelihood.
  • step S22 the image recognizing unit 31 sets the three candidates with the highest likelihood as the extraction candidates C1, C2, and C3 in order of likelihood.
  • FIG. 7 shows an example of the extraction result. In the example shown in FIG. 7, asparagus, spinach, and broccoli are extracted as extraction candidates C1, C2, and C3, respectively.
  • step S30 the image recognizing unit 31 determines whether the object to be heated 2 is a foreign substance.
  • the image recognition unit 31 determines that the object to be heated 2 is not a foreign substance.
  • This threshold is, for example, 40%.
  • the extraction candidate C1 is asparagus, not a foreign substance, and the numerical value (99.8%) indicating the certainty of the extraction candidate C1 exceeds a predetermined threshold (40%). If there is, the image recognition unit 31 determines that the extraction candidate C1 is not a foreign substance.
  • the image recognition unit 31 determines that the object to be heated 2 is a foreign substance.
  • the image recognition unit 31 determines that the heating target 2 is a foreign substance. As shown in FIG. 9, for example, even if the extraction candidate C1 is an eggplant, if the numerical value (30.5%) indicating the certainty of the extraction candidate C1 is lower than a predetermined threshold (40%), image recognition is performed. The unit 31 determines that the extraction candidate C1 is a foreign substance.
  • the cooking control ends without displaying any candidate for the object to be heated 2 on the display unit 60. That is, cooking is not performed.
  • the display unit 60 displays a message indicating that the object to be heated 2 is not a food material but a foreign substance.
  • the display unit 60 may display a message indicating that no candidate relating to the object to be heated 2 is extracted.
  • step S40 the adjusting unit 32 causes the display order of the plurality of candidates for the object to be heated 2 extracted by the image recognition unit 31 to be displayed. To adjust.
  • FIG. 10 is a flowchart of adjusting the display order in the cooking control.
  • the adjustment unit 32 reads the selection history table (see FIG. 4) from the history storage unit 42.
  • step S42 the adjustment unit 32 includes a row in the selection history table in which the history candidates M1, M2, and M3 are the same as the extraction candidates C1, C2, and C3, respectively, and the current time is included in the selected time zone. It is determined whether or not.
  • step S43 adjustment unit 32 extracts “selected heating target” in the row with the highest selection frequency in the selection history table.
  • the adjusting unit 32 sets the “selected object to be heated” as the display candidate D1, and sets the other two candidates in the row as display candidates D2 and D3 in order of likelihood. This completes the adjustment of the display order.
  • step S45 the adjustment unit 32 sets the extraction candidates C1, C2, and C3 as the display candidates D1, D2, and D3. This completes the adjustment of the display order.
  • step S50 the display unit 60 displays a plurality of candidates for the object to be heated 2 in the display order adjusted by the adjustment unit 32. Specifically, display candidates D1, D2, and D3 are displayed on display unit 60.
  • the display unit 60 when asparagus, spinach, and broccoli are extracted as extraction candidates C1, C2, and C3, respectively, and set as display candidates D1, D2, and D3, respectively, the display unit 60 becomes as shown in FIG. To be displayed. As shown in FIG. 11, the display unit 60 displays the photos and names of asparagus, spinach, and broccoli in order of numerical values indicating certainty.
  • control unit 30 determines whether or not the type of object to be heated 2 has been determined. Specifically, the user operates the operation unit 50 to select one candidate from the plurality of candidates for the object to be heated 2 displayed on the display unit 60. In response to this selection, control unit 30 determines that the type of object to be heated 2 has been determined.
  • step S70 the control unit 30 stores the selection history. While the type of the object to be heated 2 is not determined (NO in step S60), the processing in step S60 is repeated.
  • FIG. 12 is a flowchart of saving the selection history in the cooking control.
  • the control unit 30 reads a selection history table (see FIG. 4) from the history storage unit 42 in order to save the selection history.
  • step S72 the control unit 30 includes a row in the selection history table in which the history candidates M1, M2, and M3 are the same as the extraction candidates C1, C2, and C3, respectively, and the current time is included in the selected time zone. It is determined whether or not.
  • control unit 30 increases a numerical value indicating the frequency of selection of the row by one.
  • control unit 30 adds a new row to the selection history table and sets an initial value in that row. Specifically, history candidates M1, M2, and M3 are set as extraction candidates C1, C2, and C3, respectively. “Selected heating target” is set to the type of the heating target selected by the user. The selected time zone is set based on the current time. The selection frequency is set to 1. This completes the cooking control in the heating cooker 1.
  • image recognition unit 31 determines that heated object 2 is not arranged in heating cooking unit 10, or image recognition unit 31 determines that heated object 2 is a foreign substance.
  • the display unit 60 does not display a candidate for the object to be heated 2.
  • image recognition unit 31 determines that heated object 2 is not arranged in heating cooking unit 10, or image recognition unit 31 determines that heated object 2 is a foreign substance.
  • the display unit 60 displays a message indicating that no candidate relating to the object to be heated 2 is extracted. Thereby, the user can easily recognize the situation at that time.
  • FIG. 13 is a block diagram showing a configuration of a heating cooker 1A according to a first modification of the present embodiment.
  • the storage unit 40 is provided in the external server 100.
  • the heating cooker 1A communicates with the server 100 via a communication line such as the Internet, and reads and writes information stored in the storage unit 40.
  • This modification has the same configuration as that of the above-described embodiment except for the storage unit 40, and achieves the same effects as the above-described embodiment.
  • FIG. 14 is a block diagram showing a configuration of a heating cooker 1B according to a second modification of the present embodiment.
  • the cooking device 1B further includes a speaker 70 in addition to the configuration of the above embodiment.
  • the speaker 70 constitutes a presentation unit together with the display unit 60.
  • the heating cooker 1B notifies the user by voice using the speaker 70 that no candidate relating to the object to be heated 2 is extracted.
  • the speaker 70 outputs a sound indicating that the object to be heated does not exist in the heating chamber 11 or a sound indicating that the object to be heated 2 is not a food material but a foreign substance.
  • This modification has the same configuration as that of the above-described embodiment except for the speaker 70, and has the same effect as that of the above-described embodiment.
  • FIG. 15 is a block diagram showing a configuration of a heating cooker 1C according to a third modification of the present embodiment.
  • the heating cooker 1C of this modification is a kitchen provided with an IH (Induction Heating) cooking heater.
  • IH Induction Heating
  • the cooking device 1 ⁇ / b> C includes a cooking unit 10 ⁇ / b> C, an imaging unit 20, a control unit 30, a storage unit 40, an operation unit 50, a display unit 60, and a range hood 80.
  • the heating cooking unit 10 ⁇ / b> C includes a top plate 15 on which the object to be heated 2 is placed, and an induction heating coil 16 disposed below the top plate 15.
  • a kettle and a frying pan as the object to be heated 2 are placed on the top plate 15.
  • the photographing unit 20 is arranged on the range hood 80 and photographs the object to be heated 2 placed on the top plate 15.
  • the display unit 60 is arranged on the near side on the top plate 15.
  • This modification has the same configuration as that of the above-described embodiment except for the heating and cooking unit 10C, and achieves the same effects as the above-described embodiment.
  • the display unit 60 displays three candidates for the object to be heated 2.
  • the display unit 60 may display one, two, or four or more candidates for the object to be heated 2.
  • control unit 30 is configured by a microcomputer.
  • the control unit 30 is not limited to a microcomputer. However, if a programmable microcomputer is used, the processing content can be easily changed, and the degree of freedom in design can be increased.
  • control unit 30 may be configured by a logic circuit.
  • the control unit 30 may be composed of one or more elements.
  • each control item may be implemented by the plurality of elements. In this case, it can be considered that these plural elements correspond to one control unit.
  • the present disclosure is applicable to heating cookers such as microwave ovens, IH cooking heaters, and rice cookers.

Abstract

This heat cooking device comprises a heat cooking unit, an imaging unit, an image recognition unit, an adjustment unit, and a display unit. The heat cooking unit heats a heating object. The imaging unit captures an image of the heating object. The image recognition unit extracts a plurality of candidates pertaining to the heating object on the basis of the degree of certainty by performing image recognition on the image of the heating object. The adjustment unit adjusts the display order for the plurality of candidates extracted by the image recognition unit. The display unit displays the plurality of candidates in the display order adjusted by the adjustment unit. If the image recognition unit determines that no heating object is placed in the heat cooking unit, or if the image recognition unit determines that the heating object is a foreign object, then the display unit does not display a candidate pertaining to the heating object. According to this embodiment, it is possible to prevent unwanted heating and the display of an unwanted candidate.

Description

加熱調理器Cooker
　本開示は加熱調理器に関する。 The present disclosure relates to a cooking device.
　従来、電子レンジには、マイクロ波加熱機能に加えて、輻射加熱機能、スチーム加熱機能を備えたものがある。このような加熱調理器には、被加熱物である食材に適した調理メニューを有し、調理メニューボタンにより選択された被加熱物の種類（ごはん、牛乳、野菜など）に適した加熱を行うことができる機種がある。 Conventionally, some microwave ovens have a radiation heating function and a steam heating function in addition to the microwave heating function. Such a heating cooker has a cooking menu suitable for the food material to be heated, and performs heating suitable for the type of food (rice, milk, vegetables, etc.) selected by the cooking menu button. There are models that can do this.
　近年、加熱室内に配置されたカメラを有し、画像認識により特定された被加熱物の種類に応じて自動的に加熱を行う加熱調理器が提案されている。上記従来の加熱調理器により、使用者が被加熱物の種類を選択することなく、その被加熱物に適した加熱を自動的に行うことができる。 In recent years, there has been proposed a heating cooker having a camera arranged in a heating chamber and automatically heating the object according to the type of an object to be heated specified by image recognition. With the above-described conventional heating cooker, heating suitable for the object to be heated can be automatically performed without the user selecting the type of the object to be heated.
　しかしながら、上記従来の加熱調理器は、画像認識による被加熱物の特定が不正確な場合、その被加熱物に適した加熱を行うことができない。 However, the above-mentioned conventional cooking device cannot perform heating suitable for the object to be heated when the identification of the object to be heated by the image recognition is inaccurate.
　この問題を解決するために、以下の加熱調理器が提案されている（例えば、特許文献１参照）。特許文献１に記載の加熱調理器は、画像認識の結果に基づいて被加熱物に関する多数の候補から例えば三つの候補を抽出するとともに、その認識の確からしさの順にそれらの候補を表示する。使用者は、選択ボタンなどを用いて、表示された候補から一つを選択する。 加熱 In order to solve this problem, the following heating cooker has been proposed (for example, see Patent Document 1). The heating cooker described in Patent Literature 1 extracts, for example, three candidates from a large number of candidates for an object to be heated based on the result of image recognition, and displays the candidates in the order of the certainty of the recognition. The user selects one of the displayed candidates using a selection button or the like.
　これにより、画像認識の結果が必ずしも正確でなくても、被加熱物に適した加熱を行うことができる。 (4) Thus, even if the result of the image recognition is not always accurate, it is possible to perform heating suitable for the object to be heated.
特開２０１４－２０２４１４号公報JP 2014-202414 A
　特許文献１に記載の加熱調理器は、加熱室内に被加熱物が無い場合、または、加熱室内に異物（皿などの食品でないもの）が収容された場合でも、被加熱物の多数の候補からいくつかの候補を抽出して表示する。 The heating cooker described in Patent Literature 1 has a large number of candidates for the object to be heated even when there is no object to be heated in the heating chamber or when a foreign substance (a non-food item such as a dish) is contained in the heating chamber. Extract and display some candidates.
　特に、画像認識のためにディープラーニング（Deep Learning）などの機械学習を利用すると、特許文献１に記載の加熱調理器は、何らかの確からしさに基づいて、必ず被加熱物の多数の候補からいくつかの候補を抽出して表示する。 In particular, when machine learning such as deep learning is used for image recognition, the cooking device described in Patent Literature 1 always uses some of a large number of objects to be heated based on some certainty. Extract and display candidates.
　このため、特許文献１に記載の加熱調理器は、不要な加熱を行ったり、不要な候補を毎回表示したりする可能性がある。 Therefore, the heating cooker described in Patent Literature 1 may perform unnecessary heating or display unnecessary candidates every time.
　本開示は、加熱室内に被加熱物が配置されていない場合、または、加熱室内に異物が載置された場合、加熱を行わず、かつ、不要な候補を表示しない加熱調理器を提供することを目的とする。 The present disclosure provides a heating cooker that does not perform heating and does not display unnecessary candidates when an object to be heated is not arranged in a heating chamber or when a foreign object is placed in the heating chamber. With the goal.
　本開示の一態様の加熱調理器は、加熱調理部と、撮影部と、画像認識部と、調整部と、表示部とを備える。加熱調理部は、被加熱物を加熱する。 加熱 A heating cooker according to one embodiment of the present disclosure includes a heating cooker, a photographing unit, an image recognition unit, an adjustment unit, and a display unit. The heating cooking unit heats the object to be heated.
　撮影部は、被加熱物の画像を撮影する。画像認識部は、被加熱物の画像に対して画像認識を行うことで、被加熱物に関する複数の候補を確からしさに基づいて抽出する。さらに、画像認識部は、被加熱物が加熱調理部に配置されていないこと、および、被加熱物が異物であることを判定する。 The imaging unit captures an image of the object to be heated. The image recognition unit performs image recognition on the image of the object to be heated, and extracts a plurality of candidates for the object to be heated based on the likelihood. Further, the image recognition unit determines that the object to be heated is not disposed in the heating cooking unit and that the object to be heated is a foreign substance.
　調整部は、画像認識部により抽出された複数の候補の表示順序を調整する。表示部は、調整部により調整された表示順序で複数の候補を表示する。さらに、表示部は、画像認識部が、被加熱物が加熱調理部に配置されていないと判定した場合、または、画像認識部が、被加熱物が異物であると判定した場合、被加熱物に関する候補を表示しない。 (4) The adjustment unit adjusts the display order of the plurality of candidates extracted by the image recognition unit. The display unit displays a plurality of candidates in the display order adjusted by the adjustment unit. Further, the display unit, when the image recognition unit determines that the object to be heated is not disposed in the heating cooking unit, or when the image recognition unit determines that the object to be heated is a foreign substance, Don't show suggestions for
　本態様の加熱調理器は、加熱室内に被加熱物が配置されていない場合、または、加熱室内に異物が載置された場合、不要な加熱、および、不要な候補の表示を防止することができる。 The heating cooker according to this aspect can prevent unnecessary heating and display of unnecessary candidates when an object to be heated is not arranged in the heating chamber or when a foreign object is placed in the heating chamber. it can.
図１は、実施の形態に係る加熱調理器の構成を示すブロック図である。FIG. 1 is a block diagram illustrating a configuration of the heating cooker according to the embodiment. 図２は、実施の形態に係る加熱調理器であるオーブン機能付き電子レンジの構成を示すブロック図である。FIG. 2 is a block diagram illustrating a configuration of a microwave oven with an oven function, which is a heating cooker according to the embodiment. 図３は、候補記憶部に記憶された候補一覧表の一例を示す図である。FIG. 3 is a diagram illustrating an example of a candidate list stored in the candidate storage unit. 図４は、履歴記憶部に記憶された選択履歴表の一例を示す図である。FIG. 4 is a diagram illustrating an example of a selection history table stored in the history storage unit. 図５は、実施の形態に係る加熱調理器における調理制御のフローチャートである。FIG. 5 is a flowchart of cooking control in the heating cooker according to the embodiment. 図６は、調理制御における候補の抽出のフローチャートである。FIG. 6 is a flowchart for extracting candidates in cooking control. 図７は、候補の抽出結果の第１例を示す図である。FIG. 7 is a diagram illustrating a first example of a candidate extraction result. 図８は、候補の抽出結果の第２例を示す図である。FIG. 8 is a diagram illustrating a second example of a candidate extraction result. 図９は、候補の抽出結果の第３例を示す図である。FIG. 9 is a diagram illustrating a third example of a candidate extraction result. 図１０は、調理制御における表示順序の調整のフローチャートである。FIG. 10 is a flowchart of adjusting the display order in the cooking control. 図１１は、実施の形態に係る加熱調理器における表示部の表示画面の一例を示す図である。FIG. 11 is a diagram illustrating an example of a display screen of the display unit in the heating cooker according to the embodiment. 図１２は、調理制御における選択履歴の保存のフローチャートである。FIG. 12 is a flowchart of saving the selection history in the cooking control. 図１３は、実施の形態の第１の変形例に係る加熱調理器の構成を示すブロック図である。FIG. 13 is a block diagram illustrating a configuration of a heating cooker according to a first modification of the embodiment. 図１４は、実施の形態の第２の変形例に係る加熱調理器の構成を示すブロック図である。FIG. 14 is a block diagram illustrating a configuration of a heating cooker according to a second modification of the embodiment. 図１５は、実施の形態の第３の変形例に係る加熱調理器の構成を示すブロック図である。FIG. 15 is a block diagram illustrating a configuration of a heating cooker according to a third modification of the embodiment.
　本開示の第１の態様の加熱調理器は、加熱調理部と、撮影部と、画像認識部と、調整部と、表示部とを備える。加熱調理部は、被加熱物を加熱する。 加熱 The heating cooker according to the first aspect of the present disclosure includes a heating cooking unit, an imaging unit, an image recognition unit, an adjustment unit, and a display unit. The heating cooking unit heats the object to be heated.
　撮影部は、被加熱物の画像を撮影する。画像認識部は、被加熱物の画像に対して画像認識を行うことで、被加熱物に関する複数の候補を確からしさに基づいて抽出する。さらに、画像認識部は、被加熱物が加熱調理部に配置されていないこと、および、被加熱物が異物であることを判定する。 The imaging unit captures an image of the object to be heated. The image recognition unit performs image recognition on the image of the object to be heated, and extracts a plurality of candidates for the object to be heated based on the likelihood. Further, the image recognition unit determines that the object to be heated is not disposed in the heating cooking unit and that the object to be heated is a foreign substance.
　調整部は、画像認識部により抽出された複数の候補の表示順序を調整する。表示部は、調整部により調整された表示順序で複数の候補を表示する。さらに、表示部は、画像認識部が、被加熱物が加熱調理部に配置されていないと判定した場合、または、画像認識部が、被加熱物が異物であると判定した場合、被加熱物に関する候補を表示しない。 (4) The adjustment unit adjusts the display order of the plurality of candidates extracted by the image recognition unit. The display unit displays a plurality of candidates in the display order adjusted by the adjustment unit. Further, the display unit, when the image recognition unit determines that the object to be heated is not disposed in the heating cooking unit, or when the image recognition unit determines that the object to be heated is a foreign substance, Don't show suggestions for
　本開示の第２の態様の加熱調理器において、第１の態様に加えて、画像認識部は、複数の候補のうち、最も確からしい候補の確からしさを示す数値が所定の閾値よりも低い場合、被加熱物が異物であると判定する。 In the heating cooker according to the second aspect of the present disclosure, in addition to the first aspect, the image recognition unit may include, when a numerical value indicating the likelihood of the most probable candidate is lower than a predetermined threshold. It is determined that the object to be heated is a foreign substance.
　本開示の第３の態様の加熱調理器において、第１の態様に加えて、画像認識部は、複数の候補のうちの最も確からしい候補が異物である場合、被加熱物が異物であると判定する。 In the heating cooker according to the third aspect of the present disclosure, in addition to the first aspect, the image recognition unit may determine that the object to be heated is a foreign substance when the most probable candidate among the plurality of candidates is a foreign substance. judge.
　本開示の第４の態様の加熱調理器は、第１の態様に加えて、提示部をさらに備える。画像認識部が、被加熱物が加熱調理部に配置されていないと判定した場合、または、画像認識部が、被加熱物が異物であると判定した場合、提示部は、被加熱物に関する候補が抽出されないことを提示する。 加熱 The heating cooker according to the fourth aspect of the present disclosure further includes a presentation unit in addition to the first aspect. When the image recognition unit determines that the object to be heated is not arranged in the heating cooking unit, or when the image recognition unit determines that the object to be heated is a foreign substance, the presentation unit determines a candidate for the object to be heated. Is not extracted.
　本開示の第５の態様の加熱調理器において、第４の態様に加えて、提示部は上記表示部である。画像認識部が、被加熱物が加熱調理部に配置されていないと判定した場合、または、画像認識部が、被加熱物が異物であると判定した場合、表示部は、被加熱物に関する候補が抽出されない旨のメッセージを表示する。 に お い て In the heating cooker according to the fifth aspect of the present disclosure, in addition to the fourth aspect, the presentation unit is the display unit. When the image recognition unit determines that the object to be heated is not arranged in the heating cooking unit, or when the image recognition unit determines that the object to be heated is a foreign substance, the display unit displays a candidate for the object to be heated. A message is displayed indicating that is not extracted.
　本開示の第６の態様の加熱調理器において、第４の態様に加えて、提示部はスピーカである。画像認識部が、被加熱物が加熱調理部に配置されていないと判定した場合、または、画像認識部が、被加熱物が異物であると判定した場合、スピーカは、被加熱物に関する候補が存在しないことを示す音声を出力する。 に お い て In the heating cooker according to the sixth aspect of the present disclosure, in addition to the fourth aspect, the presentation unit is a speaker. When the image recognition unit determines that the object to be heated is not arranged in the heating cooking unit, or when the image recognition unit determines that the object to be heated is a foreign substance, the speaker outputs a candidate for the object to be heated. Outputs audio indicating that it does not exist.
　本開示の第７の態様の加熱調理器は、第１の態様に加えて、複数の候補の中から使用者が一つの候補を選択するように構成された操作部と、選択履歴情報として、複数の候補と当該一つの候補とを対応させて記憶する履歴記憶部と、をさらに備える。調整部は、選択履歴情報に基づいて、複数の候補の表示順序を決定する。 The heating cooker according to a seventh aspect of the present disclosure, in addition to the first aspect, includes an operation unit configured to allow a user to select one candidate from among a plurality of candidates, and as selection history information, And a history storage unit that stores the plurality of candidates in association with the one candidate. The adjustment unit determines the display order of the plurality of candidates based on the selection history information.
　本開示の第８の態様の加熱調理器は、第７の態様に加えて、現在時刻を計時する時計部をさらに備える。履歴記憶部は、選択履歴情報として、当該一つの候補の選択が行われた選択時間帯と、選択時間帯において当該一つの候補が選択される選択頻度とを記憶する。 The heating cooker according to the eighth aspect of the present disclosure further includes a clock unit that measures the current time, in addition to the seventh aspect. The history storage unit stores, as selection history information, a selection time period in which the one candidate is selected and a selection frequency at which the one candidate is selected in the selection time period.
　本開示の第９の態様の加熱調理器において、第７の態様に加えて、履歴記憶部は、当該一つの候補が選択されたときの複数の候補の表示順序を記憶する。 に お い て In the heating cooker according to the ninth aspect of the present disclosure, in addition to the seventh aspect, the history storage unit stores a display order of a plurality of candidates when the one candidate is selected.
　本開示の第１０の態様の加熱調理器において、第８の態様に加えて、調整部は、選択履歴情報の中から選択時間帯が同じで、選択頻度の最も高い選択履歴情報を抽出し、抽出された選択履歴情報に応じて複数の候補の表示順序を決定する。 In the heating cooker according to the tenth aspect of the present disclosure, in addition to the eighth aspect, the adjustment unit extracts the selection history information having the same selection time zone and the highest selection frequency from the selection history information, The display order of a plurality of candidates is determined according to the extracted selection history information.
　本開示の第１１の態様の加熱調理器において、第７の態様に加えて、履歴記憶部は外部のサーバに設けられる。 に お い て In the heating cooker according to the eleventh aspect of the present disclosure, in addition to the seventh aspect, the history storage unit is provided in an external server.
　本開示の第１２の態様の加熱調理器において、第１の態様に加えて、加熱調理部が、被加熱物を収容するように構成された加熱室を有する。 に お い て In the heating cooker according to the twelfth aspect of the present disclosure, in addition to the first aspect, the heating cooking unit has a heating chamber configured to accommodate an object to be heated.
　本開示の第１３の態様の加熱調理器において、第１の態様に加えて、加熱調理部が、被加熱物を載置するように構成されたトッププレートと、トッププレートの下方に配置された誘導加熱コイルとを有する。 In the heating cooker according to a thirteenth aspect of the present disclosure, in addition to the first aspect, the heating cooking unit is disposed below the top plate and a top plate configured to place an object to be heated. And an induction heating coil.
　以下、本開示の実施の形態について、図面を参照しながら説明する。以下に説明する実施の形態は本開示の一具体例である。本実施の形態で示される数値、構成、各ステップの処理内容、および、ステップの順序などは一例であって、本開示を限定するものではない。 Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The embodiment described below is a specific example of the present disclosure. The numerical values, the configuration, the processing content of each step, the order of the steps, and the like described in the present embodiment are merely examples, and do not limit the present disclosure.
　本実施の形態に係る加熱調理器１の構成について、図１、図２を用いて説明する。図１は、加熱調理器１の構成を示すブロック図である。図１に示すように、加熱調理器１は、加熱調理部１０と、撮影部２０と、制御部３０と、記憶部４０と、操作部５０と、表示部６０とを備える。記憶部４０は、候補記憶部４１と、履歴記憶部４２とを含む。 構成 The configuration of the cooking device 1 according to the present embodiment will be described with reference to FIGS. FIG. 1 is a block diagram illustrating a configuration of the heating cooker 1. As shown in FIG. 1, the cooking device 1 includes a cooking unit 10, an imaging unit 20, a control unit 30, a storage unit 40, an operation unit 50, and a display unit 60. The storage unit 40 includes a candidate storage unit 41 and a history storage unit 42.
　図２は、加熱調理器１であるオーブン機能付き電子レンジの構成を示すブロック図である。図２に示すように、本実施の形態において、加熱調理器１は、加熱室１１を備えたオーブン機能付き電子レンジである。 FIG. 2 is a block diagram showing a configuration of a microwave oven with an oven function, which is the cooking device 1. As shown in FIG. As shown in FIG. 2, in the present embodiment, the cooking device 1 is a microwave oven having an oven function and having a heating chamber 11.
　加熱室１１は、加熱室１１を区画する内箱１２ａと、内箱１２ａを囲う外箱１２ｂとを有する。加熱室１１の前面には、加熱室１１の前面開口を覆うように扉１３が設けられる。 The heating chamber 11 has an inner box 12a that divides the heating chamber 11, and an outer box 12b that surrounds the inner box 12a. A door 13 is provided on the front surface of the heating chamber 11 so as to cover the front opening of the heating chamber 11.
　加熱調理部１０は、マイクロ波を発振するマグネトロン（不図示）を有し、加熱室１１に収容された被加熱物２を、マイクロ波により加熱するマイクロ波加熱機能を有する。加熱調理部１０は、マイクロ波加熱機能に加えて、輻射ヒータ１４を用いた輻射加熱機能を備える。 The heating cooking unit 10 has a magnetron (not shown) that oscillates microwaves, and has a microwave heating function of heating the object to be heated 2 accommodated in the heating chamber 11 by microwaves. The cooking unit 10 has a radiation heating function using a radiation heater 14 in addition to the microwave heating function.
　撮影部２０は、加熱室１１内に載置された被加熱物２の画像を、例えばカラー静止画像として撮影するカメラである。撮影部２０は、例えば、ＣＣＤ（Charge Coupled Device）イメージセンサ、ＣＭＯＳ（Complementary Metal-Oxide Semiconductor）イメージセンサなどの撮像素子を備える。本実施の形態において、撮影部２０は、内箱１２ａの側壁の上部に設けられる。 The image capturing unit 20 is a camera that captures an image of the object 2 placed in the heating chamber 11 as, for example, a color still image. The photographing unit 20 includes an image sensor such as a CCD (Charge Coupled Device) image sensor and a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. In the present embodiment, the photographing unit 20 is provided above the side wall of the inner box 12a.
　制御部３０は、マイクロコンピュータで構成され、画像認識部３１と、調整部３２と、時計部３３とを含む。 The control unit 30 is configured by a microcomputer, and includes an image recognition unit 31, an adjustment unit 32, and a clock unit 33.
　画像認識部３１は、撮影部２０により撮影された画像に対して画像認識を行うことで、加熱調理部１０に被加熱物２が配置されているか否かを判断する。画像認識部３１における画像認識は、機械学習を利用して行われる。画像認識のための機械学習として、ディープラーニングまたは人工知能を用いることができる。 The image recognizing unit 31 performs image recognition on the image captured by the capturing unit 20 to determine whether the heating target 2 is disposed in the heating cooking unit 10. Image recognition in the image recognition unit 31 is performed using machine learning. Deep learning or artificial intelligence can be used as machine learning for image recognition.
　具体的には、画像認識部３１は、撮影部２０により撮影された加熱室１１の内部の画像と、加熱室１１に被加熱物２が存在しないときの加熱室１１の内部の画像とを比較することで、加熱室１１内に被加熱物２が載置されているか否かを判断する。 Specifically, the image recognition unit 31 compares the image inside the heating chamber 11 photographed by the photographing unit 20 with the image inside the heating chamber 11 when the object to be heated 2 does not exist in the heating chamber 11. By doing so, it is determined whether or not the article 2 to be heated is placed in the heating chamber 11.
　画像認識部３１は、さらに、撮影部２０により撮影された画像に対して画像認識を行うことで、被加熱物２に関する複数の候補を確からしさの順に抽出する。 The image recognizing unit 31 further performs image recognition on the image captured by the capturing unit 20 to extract a plurality of candidates for the object to be heated 2 in order of likelihood.
　具体的には、画像認識部３１は、撮影部２０により撮影された加熱室１１の内部の画像から、被加熱物２の形状、色調、色彩などを認識する。画像認識部３１は、この結果と候補記憶部４１に記憶された候補一覧表とを比較する。画像認識部３１は、候補一覧表に登録された候補の画像と、撮影部２０により撮影された画像との相関に基づいて、確からしさの高い順に被加熱物２に関するいくつかの候補を抽出する。本実施の形態では、三つの候補が抽出候補Ｃ１、抽出候補Ｃ２、抽出候補Ｃ３として抽出される。 Specifically, the image recognizing unit 31 recognizes a shape, a color tone, a color, and the like of the object to be heated 2 from an image inside the heating chamber 11 captured by the capturing unit 20. The image recognition unit 31 compares this result with the candidate list stored in the candidate storage unit 41. The image recognizing unit 31 extracts some candidates relating to the object to be heated 2 in descending order of certainty based on the correlation between the candidate images registered in the candidate list and the images photographed by the photographing unit 20. . In the present embodiment, three candidates are extracted as an extraction candidate C1, an extraction candidate C2, and an extraction candidate C3.
　確からしさは、０％～１００％の数値で表される。確からしさを示す数値が高いほど、その候補が、加熱室１１に配置された被加熱物２に一致する可能性が高い。 Probability is represented by a numerical value from 0% to 100%. The higher the numerical value indicating the certainty, the higher the possibility that the candidate matches the object to be heated 2 arranged in the heating chamber 11.
　図３に示すように、候補一覧表には、被加熱物２の候補となり得る食材だけでなく、皿、プラスチック製容器など、本来加熱する必要のない異物も含まれる。すなわち、候補一覧表には、異物も被加熱物２の候補として含まれる。 (3) As shown in FIG. 3, the candidate list includes not only foods that can be candidates for the object to be heated 2 but also foreign substances that do not need to be heated, such as dishes and plastic containers. That is, in the candidate list, foreign matter is also included as a candidate for the object to be heated 2.
　候補記憶部４１は、候補一覧表における候補を、機械学習などによって予め画像データとして記憶する。例えば、候補一覧表における候補に関するデータは、例えば形状および色を含む情報である。候補記憶部４１は、後で追加された情報を含めて再度機械学習を行ったものを候補一覧表における候補として記憶してもよい。 The candidate storage unit 41 stores the candidates in the candidate list as image data in advance by machine learning or the like. For example, data on candidates in the candidate list is information including, for example, shape and color. The candidate storage unit 41 may store the information that has been subjected to the machine learning again, including the information added later, as a candidate in the candidate list.
　画像認識部３１は、画像認識の結果と候補一覧表との比較により抽出された複数の候補のうち、最も確からしい候補が異物である場合、被加熱物２が異物であると判定する。 The image recognizing unit 31 determines that the object to be heated 2 is a foreign substance when the most probable candidate is a foreign substance among the plurality of candidates extracted by comparing the image recognition result with the candidate list.
　画像認識部３１は、画像認識により抽出された複数の候補のうち、最も確からしい候補の確からしさを示す数値が所定の閾値よりも低い場合、被加熱物２が異物であると判定してもよい。 The image recognizing unit 31 determines that the object to be heated 2 is a foreign object when the numerical value indicating the probability of the most probable candidate among the plurality of candidates extracted by the image recognition is lower than a predetermined threshold. Good.
　画像認識部３１は、画像認識の結果と候補一覧表とを比較した結果、候補一覧表に被加熱物２の候補が存在しないと判断した場合、被加熱物２が異物であると判定してもよい。 When the image recognition unit 31 compares the result of the image recognition with the candidate list, and determines that there is no candidate for the object to be heated 2 in the candidate list, it determines that the object to be heated 2 is a foreign substance. Is also good.
　調整部３２は、画像認識部３１により抽出された複数の候補の表示順序を調整する。具体的には、調整部３２は、履歴記憶部４２に記憶された選択履歴情報に基づいて、複数の候補の表示順序を決定する。 The adjustment unit 32 adjusts the display order of the plurality of candidates extracted by the image recognition unit 31. Specifically, the adjustment unit 32 determines the display order of the plurality of candidates based on the selection history information stored in the history storage unit 42.
　使用者は、調整部３２により調整され、表示部６０に表示された複数の候補の中から、操作部５０を用いて一つの候補を選択する。履歴記憶部４２は、画像認識部３１により抽出された過去の複数の候補と、操作部５０により選択された一つの候補とを対応させて選択履歴情報として記憶する。 The user selects one candidate from the plurality of candidates adjusted by the adjustment unit 32 and displayed on the display unit 60 using the operation unit 50. The history storage unit 42 stores a plurality of past candidates extracted by the image recognition unit 31 and one candidate selected by the operation unit 50 in association with each other as selection history information.
　操作部５０は、機械式のボタンで構成されてもよく、タッチパネルで構成されてもよい。タッチパネルが操作部５０を構成する場合、このタッチパネルが表示部６０を構成してもよい。この場合、このタッチパネルは操作表示部を構成する。 The operation unit 50 may be constituted by mechanical buttons or a touch panel. When the touch panel constitutes the operation unit 50, the touch panel may constitute the display unit 60. In this case, the touch panel forms an operation display unit.
　図４に示すように、履歴記憶部４２は、選択履歴表に記載された選択履歴情報を記憶する。具体的には、履歴記憶部４２は、操作部５０により一つの候補（図４に示す「選択された被加熱物」）が選択されたときの複数の候補の表示順序を記憶する。 履 歴 As shown in FIG. 4, the history storage unit 42 stores the selection history information described in the selection history table. Specifically, the history storage unit 42 stores the display order of a plurality of candidates when one candidate (“selected heating target” illustrated in FIG. 4) is selected by the operation unit 50.
　本実施の形態では、履歴記憶部４２は、画像認識部３１により抽出された三つの候補を履歴候補Ｍ１、Ｍ２、Ｍ３として記憶する。履歴記憶部４２は、履歴候補Ｍ１、Ｍ２、Ｍ３に加えて、操作部５０により選択された一つの候補と、その選択が行われた選択時間帯と、その選択時間帯においてその一つの候補が選択される選択頻度とを選択履歴情報として記憶する。 In the present embodiment, the history storage unit 42 stores the three candidates extracted by the image recognition unit 31 as history candidates M1, M2, and M3. The history storage unit 42 stores, in addition to the history candidates M1, M2, and M3, one candidate selected by the operation unit 50, a selected time zone in which the selection was performed, and the one candidate in the selected time zone. The selection frequency to be selected is stored as selection history information.
　調整部３２は、選択履歴情報の中から選択時間帯が同じで、選択頻度の最も高い選択履歴情報を抽出し、抽出された選択履歴情報に応じて複数の候補の表示順序を決定する。 The adjustment unit 32 extracts the selection history information having the same selection time zone and the highest selection frequency from the selection history information, and determines the display order of a plurality of candidates according to the extracted selection history information.
　時計部３３は現在時刻を計時し、現在時刻に基づいて操作部５０により一つの候補の選択が行われた選択時間帯を特定する。履歴記憶部４２は、この選択時間帯を記憶する。 (4) The clock unit 33 measures the current time, and specifies the selected time zone in which one of the candidates has been selected by the operation unit 50 based on the current time. The history storage unit 42 stores the selected time period.
　表示部６０は、調整部３２により調整された表示順序で複数の候補を表示する。表示部６０は、液晶パネルなどで構成される。表示部６０は、調理メニューボタンなどの操作により選択された項目、および、決定された加熱条件（出力、温度、時間など）、調理メニュー、スタートボタンおよび取り消しボタンの操作に基づく加熱調理器１の運転状態などを表示してもよい。 The display unit 60 displays a plurality of candidates in the display order adjusted by the adjustment unit 32. The display unit 60 includes a liquid crystal panel or the like. The display unit 60 displays the items selected by the operation of the cooking menu button and the like, the determined heating conditions (output, temperature, time, etc.), the cooking menu, the start button, and the cancel button. The driving state may be displayed.
　このように構成された加熱調理器１において、画像認識部３１が、被加熱物２が加熱調理部１０に配置されていないと判定した場合、または、画像認識部３１が、被加熱物２が異物であると判定した場合、表示部６０は提示部として機能する。この場合、表示部６０は、被加熱物２に関する候補を表示せず、その代わり、被加熱物２に関する候補が抽出されない旨のメッセージを表示する。 In the heating cooker 1 configured as described above, when the image recognition unit 31 determines that the object to be heated 2 is not arranged in the heating cooking unit 10, or when the image recognition unit 31 determines that the object to be heated 2 is When it is determined that the object is a foreign object, the display unit 60 functions as a presentation unit. In this case, the display unit 60 does not display the candidate for the object to be heated 2, but instead displays a message indicating that no candidate for the object to be heated 2 is extracted.
　次に、加熱調理器１における調理制御について説明する。図５は、加熱調理器１における調理制御のフローチャートである。図５に示すように、例えば、使用者がスタートボタンを押下した場合、ステップＳ１０において、撮影部２０が加熱室１１の内部を撮影し、画像認識部３１が、この画像に対して画像認識を行って、被加熱物２が加熱室１１内に載置されているか否かを判断する。 Next, cooking control in the heating cooker 1 will be described. FIG. 5 is a flowchart of the cooking control in the heating cooker 1. As shown in FIG. 5, for example, when the user presses the start button, in step S10, the photographing unit 20 photographs the inside of the heating chamber 11, and the image recognition unit 31 performs image recognition on this image. Then, it is determined whether the article to be heated 2 is placed in the heating chamber 11 or not.
　より具体的には、記憶部４０が、加熱室１１内に被加熱物２が存在していないときの加熱室１１の内部の画像を基準画像として予め記憶する。画像認識部３１が、この基準画像と加熱室１１の内部の画像とを画像認識により比較することで、加熱室１１内に被加熱物２が載置されているか否かを判断する。 More specifically, the storage unit 40 previously stores, as a reference image, an image inside the heating chamber 11 when the object 2 to be heated does not exist in the heating chamber 11. The image recognition unit 31 compares the reference image with the image inside the heating chamber 11 by image recognition to determine whether or not the article 2 to be heated is placed in the heating chamber 11.
　この結果、画像認識部３１が、被加熱物２が加熱調理部１０に配置されていないと判定した場合（ステップＳ１０でＮＯの場合）、表示部６０に被加熱物２に関する候補が表示されることなく、調理制御は終了する。すなわち、調理は行われない。このとき、表示部６０は、加熱室１１内に被加熱物２が存在しない旨のメッセージを表示する。表示部６０は、被加熱物２に関する候補が抽出されない旨のメッセージを表示してもよい。 As a result, when the image recognition unit 31 determines that the object to be heated 2 is not arranged in the heating cooking unit 10 (NO in step S10), the display unit 60 displays a candidate for the object to be heated 2. Without this, the cooking control ends. That is, cooking is not performed. At this time, the display unit 60 displays a message indicating that the article 2 to be heated does not exist in the heating chamber 11. The display unit 60 may display a message indicating that no candidate relating to the object to be heated 2 is extracted.
　画像認識部３１が、被加熱物２が加熱調理部１０に配置されていると判定した場合（ステップＳ１０でＹＥＳの場合）、ステップＳ２０において、画像認識部３１は、候補の抽出を行う。 (4) When the image recognition unit 31 determines that the object to be heated 2 is disposed in the heating cooking unit 10 (YES in step S10), in step S20, the image recognition unit 31 extracts a candidate.
　ここで、ステップ２０における候補の抽出について、図６を用いて説明する。図６は、調理制御における候補の抽出のフローチャートである。図６に示すように、候補の抽出のため、ステップＳ２１において、画像認識部３１が、撮影部２０により撮影された画像に対して画像認識を行い、被加熱物２に関する複数の候補を確からしさに基づいて抽出する。 Here, the extraction of candidates in step 20 will be described with reference to FIG. FIG. 6 is a flowchart for extracting candidates in cooking control. As shown in FIG. 6, in order to extract candidates, in step S21, the image recognition unit 31 performs image recognition on an image captured by the imaging unit 20, and identifies a plurality of candidates for the object 2 to be heated. Extract based on
　具体的には、画像認識部３１は、撮影部２０により撮影された加熱室１１の内部の画像と、候補記憶部４１に記憶された候補一覧表（図３参照）に登録された候補の画像とを比較する。画像認識部３１は、二つの画像を比較した結果、相関がより高い候補を、より確からしい候補として認識する。画像認識部３１は、その確からしさに基づいて被加熱物２に関する複数の候補を抽出する。 Specifically, the image recognition unit 31 includes an image of the inside of the heating chamber 11 captured by the capturing unit 20 and an image of a candidate registered in a candidate list (see FIG. 3) stored in the candidate storage unit 41. Compare with As a result of comparing the two images, the image recognition unit 31 recognizes a candidate having a higher correlation as a more likely candidate. The image recognition unit 31 extracts a plurality of candidates for the object to be heated 2 based on the likelihood.
　ステップＳ２２において、画像認識部３１は、確からしさの上位三つの候補を、確からしさの順に抽出候補Ｃ１、Ｃ２、Ｃ３に設定する。図７は、その抽出結果の一例を示す。図７に示す例では、アスパラガス、ほうれん草、ブロッコリが、それぞれ抽出候補Ｃ１、Ｃ２、Ｃ３として抽出される。 In step S22, the image recognizing unit 31 sets the three candidates with the highest likelihood as the extraction candidates C1, C2, and C3 in order of likelihood. FIG. 7 shows an example of the extraction result. In the example shown in FIG. 7, asparagus, spinach, and broccoli are extracted as extraction candidates C1, C2, and C3, respectively.
　図５に戻り、ステップＳ２０における候補の抽出の後、ステップＳ３０において、画像認識部３１が、被加熱物２が異物であるか否かを判定する。 Returning to FIG. 5, after the candidate is extracted in step S20, in step S30, the image recognizing unit 31 determines whether the object to be heated 2 is a foreign substance.
　具体的には、ステップＳ２０で抽出された複数の候補（抽出候補Ｃ１、Ｃ２、Ｃ３）のうち、最も確からしい候補（抽出候補Ｃ１）が異物でなく、かつ、最も確からしい候補の確からしさを示す数値が所定の閾値以上である場合、画像認識部３１は、被加熱物２が異物ではないと判定する。この閾値は例えば４０％である。 Specifically, among the plurality of candidates (extraction candidates C1, C2, C3) extracted in step S20, the most probable candidate (extraction candidate C1) is not a foreign substance, and the likelihood of the most probable candidate is determined. When the numerical value shown is equal to or greater than the predetermined threshold, the image recognition unit 31 determines that the object to be heated 2 is not a foreign substance. This threshold is, for example, 40%.
　図７に示すように、例えば、抽出候補Ｃ１がアスパラガスであって異物ではなく、かつ、抽出候補Ｃ１の確からしさを示す数値（９９．８％）が所定の閾値（４０％）を超えている場合、画像認識部３１は、抽出候補Ｃ１が異物ではないと判定する。 As shown in FIG. 7, for example, the extraction candidate C1 is asparagus, not a foreign substance, and the numerical value (99.8%) indicating the certainty of the extraction candidate C1 exceeds a predetermined threshold (40%). If there is, the image recognition unit 31 determines that the extraction candidate C1 is not a foreign substance.
　図８に示すように、抽出候補Ｃ１が皿である場合、画像認識部３１は、被加熱物２が異物であると判定する。 場合 As shown in FIG. 8, when the extraction candidate C1 is a dish, the image recognition unit 31 determines that the object to be heated 2 is a foreign substance.
　抽出候補Ｃ１の確からしさを示す数値が所定の閾値よりも低い場合、画像認識部３１は、被加熱物２が異物であると判定する。図９に示すように、例えば、抽出候補Ｃ１が茄子であっても、抽出候補Ｃ１の確からしさを示す数値（３０．５％）が所定の閾値（４０％）を下回っている場合、画像認識部３１は、抽出候補Ｃ１が異物であると判定する。 If the numerical value indicating the probability of the extraction candidate C1 is lower than a predetermined threshold, the image recognition unit 31 determines that the heating target 2 is a foreign substance. As shown in FIG. 9, for example, even if the extraction candidate C1 is an eggplant, if the numerical value (30.5%) indicating the certainty of the extraction candidate C1 is lower than a predetermined threshold (40%), image recognition is performed. The unit 31 determines that the extraction candidate C1 is a foreign substance.
　このように、被加熱物２が異物であると判定された場合（ステップＳ３０でＹＥＳの場合）、表示部６０に被加熱物２に関する候補が表示されることなく、調理制御が終了する。すなわち、調理は行われない。このとき、表示部６０は、被加熱物２が食材ではなく異物である旨のメッセージを表示する。表示部６０は、被加熱物２に関する候補が抽出されない旨のメッセージを表示してもよい。 As described above, when it is determined that the object to be heated 2 is a foreign substance (in the case of YES in step S30), the cooking control ends without displaying any candidate for the object to be heated 2 on the display unit 60. That is, cooking is not performed. At this time, the display unit 60 displays a message indicating that the object to be heated 2 is not a food material but a foreign substance. The display unit 60 may display a message indicating that no candidate relating to the object to be heated 2 is extracted.
　被加熱物２が異物ではないと判定された場合（ステップＳ３０でＮＯの場合）、ステップＳ４０において、調整部３２が、画像認識部３１により抽出された被加熱物２に関する複数の候補の表示順序を調整する。 If it is determined that the object to be heated 2 is not a foreign substance (NO in step S30), in step S40, the adjusting unit 32 causes the display order of the plurality of candidates for the object to be heated 2 extracted by the image recognition unit 31 to be displayed. To adjust.
　ここで、ステップＳ４０における表示順序の調整について、図１０を用いて説明する。図１０は、調理制御における表示順序の調整のフローチャートである。図１０に示すように、表示順序の調整のため、ステップＳ４１において、調整部３２は、履歴記憶部４２から選択履歴表（図４参照）を読み出す。 Here, the adjustment of the display order in step S40 will be described with reference to FIG. FIG. 10 is a flowchart of adjusting the display order in the cooking control. As shown in FIG. 10, in order to adjust the display order, in step S41, the adjustment unit 32 reads the selection history table (see FIG. 4) from the history storage unit 42.
　ステップＳ４２において、調整部３２は、選択履歴表の中に、履歴候補Ｍ１、Ｍ２、Ｍ３が抽出候補Ｃ１、Ｃ２、Ｃ３とそれぞれ同じで、かつ、現在時刻が選択時間帯に含まれる行があるか否かを判断する。 In step S42, the adjustment unit 32 includes a row in the selection history table in which the history candidates M1, M2, and M3 are the same as the extraction candidates C1, C2, and C3, respectively, and the current time is included in the selected time zone. It is determined whether or not.
　ステップＳ４２でＹＥＳの場合、ステップＳ４３において、調整部３２は、選択履歴表の選択頻度の最も高い行における「選択された被加熱物」を抽出する。ステップＳ４４において、調整部３２は、その「選択された被加熱物」を表示候補Ｄ１に設定するとともに、その行における他の二つの候補を確からしさの順に表示候補Ｄ２、Ｄ３に設定する。これで、表示順序の調整が終了する。 場合 If YES in step S42, in step S43, adjustment unit 32 extracts “selected heating target” in the row with the highest selection frequency in the selection history table. In step S44, the adjusting unit 32 sets the “selected object to be heated” as the display candidate D1, and sets the other two candidates in the row as display candidates D2 and D3 in order of likelihood. This completes the adjustment of the display order.
　ステップＳ４２でＮＯの場合、ステップＳ４５において、調整部３２は、抽出候補Ｃ１、Ｃ２、Ｃ３を表示候補Ｄ１、Ｄ２、Ｄ３に設定する。これで、表示順序の調整が終了する。 場合 If NO in step S42, in step S45, the adjustment unit 32 sets the extraction candidates C1, C2, and C3 as the display candidates D1, D2, and D3. This completes the adjustment of the display order.
　図５に戻り、表示順序の調整の後、ステップＳ５０において、表示部６０は、調整部３２により調整された表示順序で、被加熱物２に関する複数の候補を表示する。具体的には、表示候補Ｄ１、Ｄ２、Ｄ３が表示部６０に表示される。 Returning to FIG. 5, after adjusting the display order, in step S50, the display unit 60 displays a plurality of candidates for the object to be heated 2 in the display order adjusted by the adjustment unit 32. Specifically, display candidates D1, D2, and D3 are displayed on display unit 60.
　例えば、図７に示すように、アスパラガス、ほうれん草、ブロッコリがそれぞれ抽出候補Ｃ１、Ｃ２、Ｃ３として抽出され、それぞれ表示候補Ｄ１、Ｄ２、Ｄ３に設定された場合、表示部６０は図１１のように表示する。図１１に示すように、表示部６０は、アスパラガス、ほうれん草、ブロッコリの写真および名称を、確からしさを示す数値の順に表示する。 For example, as shown in FIG. 7, when asparagus, spinach, and broccoli are extracted as extraction candidates C1, C2, and C3, respectively, and set as display candidates D1, D2, and D3, respectively, the display unit 60 becomes as shown in FIG. To be displayed. As shown in FIG. 11, the display unit 60 displays the photos and names of asparagus, spinach, and broccoli in order of numerical values indicating certainty.
　図５に戻り、候補の表示の後、ステップＳ６０において、制御部３０は、被加熱物２の種類が決定されたか否かを判定する。具体的には、使用者が、操作部５０を操作して、表示部６０に表示された被加熱物２に関する複数の候補から一つの候補を選択する。この選択に応答して、制御部３０は、被加熱物２の種類が決定されたと判断する。 Returning to FIG. 5, after displaying the candidates, in step S60, control unit 30 determines whether or not the type of object to be heated 2 has been determined. Specifically, the user operates the operation unit 50 to select one candidate from the plurality of candidates for the object to be heated 2 displayed on the display unit 60. In response to this selection, control unit 30 determines that the type of object to be heated 2 has been determined.
　被加熱物２の種類が決定された場合（ステップＳ６０でＹＥＳの場合）、ステップＳ７０において、制御部３０は選択履歴を保存する。被加熱物２の種類が決定されない間は（ステップＳ６０でＮＯの場合）、ステップＳ６０の処理が繰り返される。 If the type of the object to be heated 2 is determined (YES in step S60), in step S70, the control unit 30 stores the selection history. While the type of the object to be heated 2 is not determined (NO in step S60), the processing in step S60 is repeated.
　ここで、ステップＳ７０における選択履歴の保存について、図１２を用いて説明する。図１２は、調理制御における選択履歴の保存のフローチャートである。図１２に示すように、選択履歴の保存のため、ステップＳ７１において、制御部３０は、履歴記憶部４２から選択履歴表（図４参照）を読み出す。 Here, the storage of the selection history in step S70 will be described with reference to FIG. FIG. 12 is a flowchart of saving the selection history in the cooking control. As shown in FIG. 12, in step S71, the control unit 30 reads a selection history table (see FIG. 4) from the history storage unit 42 in order to save the selection history.
　ステップＳ７２において、制御部３０は、選択履歴表の中に、履歴候補Ｍ１、Ｍ２、Ｍ３が抽出候補Ｃ１、Ｃ２、Ｃ３とそれぞれ同じで、かつ、現在時刻が選択時間帯に含まれる行があるか否かを判断する。 In step S72, the control unit 30 includes a row in the selection history table in which the history candidates M1, M2, and M3 are the same as the extraction candidates C1, C2, and C3, respectively, and the current time is included in the selected time zone. It is determined whether or not.
　ステップＳ７２でＹＥＳの場合、ステップＳ７３において、制御部３０は、その行の選択頻度を示す数値を一つ増加させる。 場合 If YES in step S72, in step S73, control unit 30 increases a numerical value indicating the frequency of selection of the row by one.
　ステップＳ７２でＮＯの場合、制御部３０は、選択履歴表に新規の行を追加して、その行に初期値を設定する。具体的には、履歴候補Ｍ１、Ｍ２、Ｍ３がそれぞれ抽出候補Ｃ１、Ｃ２、Ｃ３に設定される。「選択された被加熱物」が、使用者により選択された被加熱物の種類に設定される。選択時間帯が、現在時刻に基づいて設定される。選択頻度が１に設定される。これで、加熱調理器１における調理制御が終了する。 場合 If NO in step S72, control unit 30 adds a new row to the selection history table and sets an initial value in that row. Specifically, history candidates M1, M2, and M3 are set as extraction candidates C1, C2, and C3, respectively. “Selected heating target” is set to the type of the heating target selected by the user. The selected time zone is set based on the current time. The selection frequency is set to 1. This completes the cooking control in the heating cooker 1.
　本実施の形態では、画像認識部３１が、被加熱物２が加熱調理部１０に配置されていないと判定した場合、または、画像認識部３１が、被加熱物２が異物であると判定した場合、表示部６０は、被加熱物２に関する候補を表示しない。 In the present embodiment, when image recognition unit 31 determines that heated object 2 is not arranged in heating cooking unit 10, or image recognition unit 31 determines that heated object 2 is a foreign substance. In this case, the display unit 60 does not display a candidate for the object to be heated 2.
　これにより、不要な加熱が行われたり、不要な候補が毎回表示されたりすることを防止することができる。 This can prevent unnecessary heating and unnecessary candidates from being displayed every time.
　本実施の形態では、画像認識部３１が、被加熱物２が加熱調理部１０に配置されていないと判定した場合、または、画像認識部３１が、被加熱物２が異物であると判定した場合、表示部６０は、被加熱物２に関する候補が抽出されない旨のメッセージを表示する。これにより、使用者は、そのときの状況を容易に認識することができる。 In the present embodiment, when image recognition unit 31 determines that heated object 2 is not arranged in heating cooking unit 10, or image recognition unit 31 determines that heated object 2 is a foreign substance. In this case, the display unit 60 displays a message indicating that no candidate relating to the object to be heated 2 is extracted. Thereby, the user can easily recognize the situation at that time.
　（第１の変形例）
　図１３は、本実施の形態の第１の変形例に係る加熱調理器１Ａの構成を示すブロック図である。 (First Modification)
FIG. 13 is a block diagram showing a configuration of a heating cooker 1A according to a first modification of the present embodiment.
　本変形例では、上記実施の形態と異なり、記憶部４０は外部のサーバ１００に設けられる。加熱調理器１Ａは、インターネットなどの通信回線を介してサーバ１００と通信し、記憶部４０に記憶された情報の読み書きを行う。 In the present modification, unlike the above embodiment, the storage unit 40 is provided in the external server 100. The heating cooker 1A communicates with the server 100 via a communication line such as the Internet, and reads and writes information stored in the storage unit 40.
　本変形例は、記憶部４０以外については上記実施の形態と同じ構成を有し、上記実施の形態と同様の効果を奏する。 変 形 This modification has the same configuration as that of the above-described embodiment except for the storage unit 40, and achieves the same effects as the above-described embodiment.
　（第２の変形例）
　図１４は、本実施の形態の第２の変形例に係る加熱調理器１Ｂの構成を示すブロック図である。 (Second Modification)
FIG. 14 is a block diagram showing a configuration of a heating cooker 1B according to a second modification of the present embodiment.
　図１４に示すように、加熱調理器１Ｂは、上記実施の形態の構成に加えて、スピーカ７０をさらに備える。本変形例では、スピーカ７０は、表示部６０とともに提示部を構成する。 加熱 As shown in FIG. 14, the cooking device 1B further includes a speaker 70 in addition to the configuration of the above embodiment. In this modification, the speaker 70 constitutes a presentation unit together with the display unit 60.
　すなわち、加熱調理器１Ｂは、被加熱物２に関する候補が抽出されないことを、スピーカ７０を用いて音声でも使用者に知らせる。例えば、スピーカ７０は、加熱室１１内に被加熱物が存在しないことを示す音声、または、被加熱物２が食材ではなく異物であることを示す音声を出力する。 That is, the heating cooker 1B notifies the user by voice using the speaker 70 that no candidate relating to the object to be heated 2 is extracted. For example, the speaker 70 outputs a sound indicating that the object to be heated does not exist in the heating chamber 11 or a sound indicating that the object to be heated 2 is not a food material but a foreign substance.
　本変形例は、スピーカ７０以外については上記実施の形態と同じ構成を有し、上記実施の形態と同様の効果を奏する。 変 形 This modification has the same configuration as that of the above-described embodiment except for the speaker 70, and has the same effect as that of the above-described embodiment.
　（第３の変形例）
　図１５は、本実施の形態の第３の変形例に係る加熱調理器１Ｃの構成を示すブロック図である。本変形例の加熱調理器１Ｃは、ＩＨ（Induction Heating）クッキングヒータを備えたキッチンである。 (Third Modification)
FIG. 15 is a block diagram showing a configuration of a heating cooker 1C according to a third modification of the present embodiment. The heating cooker 1C of this modification is a kitchen provided with an IH (Induction Heating) cooking heater.
　図１５に示すように、加熱調理器１Ｃは、加熱調理部１０Ｃと、撮影部２０と、制御部３０と、記憶部４０と、操作部５０と、表示部６０と、レンジフード８０とを備える。加熱調理部１０Ｃは、被加熱物２を載置するためのトッププレート１５と、トッププレート１５の下方に配置された誘導加熱コイル１６とを有する。図１５では、トッププレート１５上に、被加熱物２であるやかんおよびフライパンが載置される。 As shown in FIG. 15, the cooking device 1 </ b> C includes a cooking unit 10 </ b> C, an imaging unit 20, a control unit 30, a storage unit 40, an operation unit 50, a display unit 60, and a range hood 80. . The heating cooking unit 10 </ b> C includes a top plate 15 on which the object to be heated 2 is placed, and an induction heating coil 16 disposed below the top plate 15. In FIG. 15, a kettle and a frying pan as the object to be heated 2 are placed on the top plate 15.
　撮影部２０は、レンジフード８０に配置されて、トッププレート１５に載置された被加熱物２を撮影する。表示部６０は、トッププレート１５上の手前側に配置される。 The photographing unit 20 is arranged on the range hood 80 and photographs the object to be heated 2 placed on the top plate 15. The display unit 60 is arranged on the near side on the top plate 15.
　本変形例は、加熱調理部１０Ｃ以外については上記実施の形態と同じ構成を有し、上記実施の形態と同様の効果を奏する。 変 形 This modification has the same configuration as that of the above-described embodiment except for the heating and cooking unit 10C, and achieves the same effects as the above-described embodiment.
　（その他の変形例）
　以上、本開示について実施の形態に基づいて説明したが、本開示は、上記実施の形態に限定されるものではない。 (Other modifications)
Although the present disclosure has been described based on the embodiments, the present disclosure is not limited to the above embodiments.
　例えば、上記実施の形態において、表示部６０は、被加熱物２の候補を三つ表示する。しかし、本開示はこれに限らない。表示部６０は、被加熱物２の候補を一つもしくは二つ、または、四つ以上表示してもよい。 For example, in the above embodiment, the display unit 60 displays three candidates for the object to be heated 2. However, the present disclosure is not limited to this. The display unit 60 may display one, two, or four or more candidates for the object to be heated 2.
　上述のように、本実施の形態において、制御部３０はマイクロコンピュータで構成される。制御部３０はマイクロコンピュータに限られるものではない。しかしながら、プログラム可能なマイクロコンピュータを用いれば、処理内容を容易に変更可能であり、設計の自由度を高めることができる。 As described above, in the present embodiment, the control unit 30 is configured by a microcomputer. The control unit 30 is not limited to a microcomputer. However, if a programmable microcomputer is used, the processing content can be easily changed, and the degree of freedom in design can be increased.
　処理速度の向上のため、制御部３０を論理回路で構成することも可能である。制御部３０を一つまたは複数の素子で構成してもよい。制御部３０を複数の素子で構成する場合、各制御項目をこれら複数の素子で実施してもよい。この場合、これら複数の素子が一つの制御部に対応すると考えることができる。 (4) In order to improve the processing speed, the control unit 30 may be configured by a logic circuit. The control unit 30 may be composed of one or more elements. When the control unit 30 is configured by a plurality of elements, each control item may be implemented by the plurality of elements. In this case, it can be considered that these plural elements correspond to one control unit.
　本開示は、電子レンジ、ＩＨクッキングヒータ、および、炊飯器などの加熱調理器に適用可能である。 The present disclosure is applicable to heating cookers such as microwave ovens, IH cooking heaters, and rice cookers.
　１、１Ａ、１Ｂ、１Ｃ　加熱調理器
　２　被加熱物
　１０、１０Ｃ　加熱調理部
　１１　加熱室
　１２ａ　内箱
　１２ｂ　外箱
　１３　扉
　１４　輻射ヒータ
　１５　トッププレート
　１６　誘導加熱コイル
　２０　撮影部
　３０　制御部
　３１　画像認識部
　３２　調整部
　３３　時計部
　４０　記憶部
　４１　候補記憶部
　４２　履歴記憶部
　５０　操作部
　６０　表示部
　７０　スピーカ
　８０　レンジフード
　１００　サーバ DESCRIPTION OF SYMBOLS 1, 1A, 1B, 1C Cooking device 2 Object to be heated 10, 10C Cooking device 11 Heating room 12a Inner box 12b Outer box 13 Door 14 Radiant heater 15 Top plate 16 Induction heating coil 20 Imaging unit 30 Control unit 31 Image recognition Unit 32 adjustment unit 33 clock unit 40 storage unit 41 candidate storage unit 42 history storage unit 50 operation unit 60 display unit 70 speaker 80 range hood 100 server

Claims (13)

  1. 　被加熱物を加熱するように構成された加熱調理部と、
    　前記被加熱物の画像を撮影するように構成された撮影部と、
    　前記被加熱物の前記画像に対して画像認識を行うことで、前記被加熱物に関する複数の候補を確からしさに基づいて抽出するように構成されるとともに、前記被加熱物が前記加熱調理部に配置されていないこと、および、前記被加熱物が異物であることを判定するように構成された画像認識部と、
    　前記画像認識部により抽出された前記複数の候補の表示順序を調整するように構成された調整部と、
    　前記調整部により調整された前記表示順序で前記複数の候補を表示するように構成されるとともに、前記画像認識部が、前記被加熱物が前記加熱調理部に配置されていないと判定した場合、または、前記画像認識部が、前記被加熱物が異物であると判定した場合、前記被加熱物に関する候補を表示しないように構成された表示部と、を備えた、
    　加熱調理器。     A cooking unit configured to heat the object to be heated,
    An imaging unit configured to capture an image of the object to be heated,
    By performing image recognition on the image of the object to be heated, a plurality of candidates for the object to be heated are configured to be extracted based on the likelihood, and the object to be heated is transmitted to the cooking unit. Not being placed, and an image recognition unit configured to determine that the object to be heated is a foreign substance,
    An adjustment unit configured to adjust the display order of the plurality of candidates extracted by the image recognition unit,
    When configured to display the plurality of candidates in the display order adjusted by the adjustment unit, and when the image recognition unit determines that the object to be heated is not arranged in the heating cooking unit, Or, when the image recognition unit determines that the object to be heated is a foreign substance, the display unit configured to not display a candidate for the object to be heated,
    Cooking cooker.
  2. 　前記画像認識部が、前記複数の候補のうち、最も確からしい候補の確からしさを示す数値が所定の閾値よりも低い場合、前記被加熱物が異物であると判定する、
    　請求項１に記載の加熱調理器。     The image recognition unit, among the plurality of candidates, if the numerical value indicating the likelihood of the most likely candidate is lower than a predetermined threshold, it is determined that the object to be heated is a foreign substance,
    The cooking device according to claim 1.
  3. 　前記画像認識部が、前記複数の候補のうちの最も確からしい候補が異物である場合、前記被加熱物が異物であると判定する、
    　請求項１に記載の加熱調理器。     If the most probable candidate among the plurality of candidates is a foreign substance, the image recognition unit determines that the object to be heated is a foreign substance.
    The cooking device according to claim 1.
  4. 　提示部をさらに備え、
    　前記画像認識部が、前記被加熱物が前記加熱調理部に配置されていないと判定した場合、または、前記画像認識部が、前記被加熱物が異物であると判定した場合、前記提示部は、前記被加熱物に関する候補が抽出されないことを提示する、
    　請求項１に記載の加熱調理器。     Further comprising a presentation unit,
    When the image recognition unit determines that the object to be heated is not arranged in the heating cooking unit, or when the image recognition unit determines that the object to be heated is a foreign substance, Presenting that candidates for the object to be heated are not extracted,
    The cooking device according to claim 1.
  5. 　前記提示部が前記表示部であり、
    　前記画像認識部が、前記被加熱物が前記加熱調理部に配置されていないと判定した場合、または、前記画像認識部が、前記被加熱物が異物であると判定した場合、前記表示部が、前記被加熱物に関する前記候補が抽出されない旨のメッセージを表示する、
    　請求項４に記載の加熱調理器。     The presentation unit is the display unit,
    When the image recognition unit determines that the object to be heated is not arranged in the cooking unit, or when the image recognition unit determines that the object to be heated is a foreign substance, Displaying a message that the candidate for the object to be heated is not extracted,
    The heating cooker according to claim 4.
  6. 　前記提示部がスピーカであり、
    　前記画像認識部が、前記被加熱物が前記加熱調理部に配置されていないと判定した場合、または、前記画像認識部が、前記被加熱物が異物であると判定した場合、前記スピーカが、前記被加熱物に関する前記候補が存在しないことを示す音声を出力する、
    　請求項４に記載の加熱調理器。     The presentation unit is a speaker,
    If the image recognition unit determines that the object to be heated is not arranged in the heating cooking unit, or if the image recognition unit determines that the object to be heated is a foreign substance, the speaker is Outputting a voice indicating that the candidate for the object to be heated does not exist,
    The heating cooker according to claim 4.
  7. 　前記複数の候補の中から使用者が一つの候補を選択するための操作部と、
    　選択履歴情報として、前記複数の候補と前記一つの候補とを対応させて記憶する履歴記憶部と、をさらに備え、
    　前記調整部は、前記選択履歴情報に基づいて、前記複数の候補の前記表示順序を決定する、
    　請求項１に記載の加熱調理器。     An operation unit for the user to select one candidate from among the plurality of candidates,
    A history storage unit configured to store the plurality of candidates and the one candidate in association with each other as the selection history information,
    The adjusting unit determines the display order of the plurality of candidates based on the selection history information,
    The cooking device according to claim 1.
  8. 　現在時刻を計時する時計部をさらに備え、
    　前記履歴記憶部は、前記選択履歴情報として、前記一つの候補の選択が行われた選択時間帯と、前記選択時間帯において前記一つの候補が選択される選択頻度とを記憶する、
    　請求項７に記載の加熱調理器。     It further includes a clock section that measures the current time,
    The history storage unit stores, as the selection history information, a selection time period in which the one candidate is selected, and a selection frequency at which the one candidate is selected in the selection time period,
    A heating cooker according to claim 7.
  9. 　前記履歴記憶部が、前記一つの候補が選択されたときの前記複数の候補の前記表示順序を記憶する、
    　請求項７に記載の加熱調理器。     The history storage unit stores the display order of the plurality of candidates when the one candidate is selected,
    A heating cooker according to claim 7.
  10. 　前記調整部が、前記選択履歴情報の中から前記選択時間帯が同じで、前記選択頻度の最も高い前記選択履歴情報を抽出し、抽出された前記選択履歴情報に応じて前記複数の候補の前記表示順序を決定する、
    　請求項８に記載の加熱調理器。     The adjusting unit extracts the selection history information having the same selection time zone from the selection history information and having the highest selection frequency, and selects the plurality of candidates according to the extracted selection history information. Determine the display order,
    A heating cooker according to claim 8.
  11. 　前記履歴記憶部が外部のサーバに設けられた、
    　請求項７に記載の加熱調理器。     The history storage unit is provided in an external server,
    A heating cooker according to claim 7.
  12. 　前記加熱調理部が、前記被加熱物を収容するための加熱室を有する、
    　請求項１に記載の加熱調理器。     The heating cooking unit has a heating chamber for housing the object to be heated,
    The cooking device according to claim 1.
  13. 　前記加熱調理部が、前記被加熱物を載置するためのトッププレートと、前記トッププレートの下方に配置された誘導加熱コイルとを有する、
    　請求項１に記載の加熱調理器。     The heating cooking unit has a top plate for placing the object to be heated, and an induction heating coil disposed below the top plate.
    The cooking device according to claim 1.
PCT/JP2019/035169 2018-09-10 2019-09-06 Heat cooking device WO2020054609A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980003781.0A CN111183317A (en) 2018-09-10 2019-09-06 Heating cooker
JP2019569854A JP7403044B2 (en) 2018-09-10 2019-09-06 heating cooker

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-168904 2018-09-10
JP2018168904 2018-09-10

Publications (1)

Publication Number Publication Date
WO2020054609A1 true WO2020054609A1 (en) 2020-03-19

Family

ID=69776750

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/035169 WO2020054609A1 (en) 2018-09-10 2019-09-06 Heat cooking device

Country Status (3)

Country Link
JP (1) JP7403044B2 (en)
CN (1) CN111183317A (en)
WO (1) WO2020054609A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11949535B2 (en) 2022-03-24 2024-04-02 Haier Us Appliance Solutions, Inc. Item management system for connected appliances

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010061382A (en) * 2008-09-03 2010-03-18 Nikon Corp Automatic recipe creation apparatus and program
JP2014202414A (en) * 2013-04-04 2014-10-27 東芝ホームテクノ株式会社 Heating cooker
WO2015029333A1 (en) * 2013-08-28 2015-03-05 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Control method, program, terminal device, information provision system, and information provision method
JP2016051526A (en) * 2014-08-28 2016-04-11 三菱電機株式会社 Heating cooker, heating cooking system, and control method of heating cooker
WO2016059770A1 (en) * 2014-10-17 2016-04-21 パナソニックＩｐマネジメント株式会社 Device for cooking by heating and control method for same
WO2017179460A1 (en) * 2016-04-11 2017-10-19 パナソニックＩｐマネジメント株式会社 Heating cooker, method of controlling heating cooker, and heating cooking system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08133449A (en) * 1994-11-11 1996-05-28 Mitsubishi Heavy Ind Ltd Detection system for specific foreign matter in object to be conveyed

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010061382A (en) * 2008-09-03 2010-03-18 Nikon Corp Automatic recipe creation apparatus and program
JP2014202414A (en) * 2013-04-04 2014-10-27 東芝ホームテクノ株式会社 Heating cooker
WO2015029333A1 (en) * 2013-08-28 2015-03-05 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Control method, program, terminal device, information provision system, and information provision method
JP2016051526A (en) * 2014-08-28 2016-04-11 三菱電機株式会社 Heating cooker, heating cooking system, and control method of heating cooker
WO2016059770A1 (en) * 2014-10-17 2016-04-21 パナソニックＩｐマネジメント株式会社 Device for cooking by heating and control method for same
WO2017179460A1 (en) * 2016-04-11 2017-10-19 パナソニックＩｐマネジメント株式会社 Heating cooker, method of controlling heating cooker, and heating cooking system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11949535B2 (en) 2022-03-24 2024-04-02 Haier Us Appliance Solutions, Inc. Item management system for connected appliances

Also Published As

Publication number Publication date
JP7403044B2 (en) 2023-12-22
JPWO2020054609A1 (en) 2021-08-30
CN111183317A (en) 2020-05-19

Similar Documents

Publication Publication Date Title
JP5853155B2 (en) Heating cooker, cooking system, arithmetic device and cooking support method
JP6827181B2 (en) Cooker
EP3477206B1 (en) Cooking appliance with a user interface
JP6439137B2 (en) Heating cooker and control method thereof
CN105358913A (en) Thermal cooker
JP2005140418A (en) Cooker
WO2018012245A1 (en) Heating cooker
KR20180015926A (en) Cooking apparatus and method of controlling the same
WO2017179460A1 (en) Heating cooker, method of controlling heating cooker, and heating cooking system
JP6906147B2 (en) How to control a cooker and a cooker
JP7349609B2 (en) How to control a heating cooker
WO2020054609A1 (en) Heat cooking device
JP6364607B2 (en) Cooker
JP2016166724A (en) Heating cooker
WO2017164050A1 (en) Heat-cooking device, heat-cooking device control method, and heat-cooking system
JP7345084B2 (en) heating cooker
JP2018004225A (en) Heating cooker
KR20230073006A (en) Home appliance having an interior space for accommodating a tray at various heights and method for obtaining an image by the home appliance
JP2020135572A (en) Information processing system
JP2022160322A (en) Heating cooking system
CN116687220A (en) Cooking method, cooking device, electronic equipment, cooking equipment and storage medium
TW201929747A (en) Intelligent cooking system and method applied thereto
KR20230109395A (en) Electronic apparatus and controlling method thereof
JPWO2018186117A1 (en) Cooker
CN116229249A (en) Cooking equipment image acquisition method and cooking equipment

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2019569854

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19859169

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19859169

Country of ref document: EP

Kind code of ref document: A1