WO2019159518A1 - Heating cooker and heating cooking system - Google Patents
Heating cooker and heating cooking system Download PDFInfo
- Publication number
- WO2019159518A1 WO2019159518A1 PCT/JP2018/045669 JP2018045669W WO2019159518A1 WO 2019159518 A1 WO2019159518 A1 WO 2019159518A1 JP 2018045669 W JP2018045669 W JP 2018045669W WO 2019159518 A1 WO2019159518 A1 WO 2019159518A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- heating
- recognition
- control information
- unit
- information area
- Prior art date
Links
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- F24C15/00—Details
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F24—HEATING; RANGES; VENTILATING
- F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- F24C7/00—Stoves or ranges heated by electric energy
- F24C7/02—Stoves or ranges heated by electric energy using microwaves
Definitions
- the present disclosure relates to a heating cooker and a heating cooking system that heat food based on an image photographed by a camera provided in the heating cooker.
- heating is performed when a user inputs a heating time and presses a button for starting heating.
- a store such as a convenience store or a supermarket, a store clerk sometimes provides a lunch purchased by a customer by heating it with a microwave oven.
- the optimal heating time by a microwave oven is written on a lunch box container sold in a store.
- a store clerk who is a user refers to the description and operates a numeric key or the like provided on the operation unit of the microwave to set the heating time.
- the user may set a heating time suitable for food by operating a plurality of operation buttons that are provided in the operation unit of the microwave oven and are assigned different heating times.
- Patent Document 1 In the technique described in Patent Document 1, an object to be cooked before cooking is photographed by a camera mounted on a heating cooker. By extracting necessary information from the photographed image, an optimal cooking method is selected.
- a heating cooker includes a heating chamber, a heating unit, a control unit, a photographing unit, a recognition processing unit, a recognition format storage unit, and a recognition format.
- a determination unit is a determination unit.
- the heating cabinet accommodates the object to be heated.
- the heating unit heats the object to be heated in the heating chamber.
- the control unit controls the heating unit according to heating control information for heating the object to be heated.
- the shooting unit takes images in the heating chamber.
- the recognition processing unit detects a control information area from the image and extracts a recognition target included in the control information area.
- the recognition format storage unit stores the threshold information related to the control information area and the recognition format for analyzing the recognition target in association with each other.
- the recognition format determination unit determines the recognition format based on the feature information and threshold information extracted from the control information area.
- the recognition processing unit analyzes the recognition target based on the recognition format determined by the recognition format determination unit, and acquires heating control information.
- the heating control information corresponding to various recognition formats and automatically set the heating conditions such as the heating time. Since it is possible to deal with food in a container with a small area for writing letters, it is possible to obtain a cooking device that can automatically heat food regardless of the type and size of the food. it can.
- FIG. 1 is a diagram illustrating an appearance of a heating cooker according to Embodiment 1 of the present disclosure.
- FIG. 2 is a block diagram showing a functional configuration of the heating cooker according to the first embodiment.
- FIG. 3A is a diagram illustrating an example of a food to be heated and a label attached to the food.
- FIG. 3B is a diagram illustrating another example of a food to be heated and a label attached to the food.
- FIG. 3C is a diagram illustrating another example of a food to be heated and a label attached to the food.
- FIG. 3D is a diagram illustrating another example of a food to be heated and a label attached to the food.
- FIG. 4A is a diagram illustrating an example of a control information area in the first embodiment.
- FIG. 4A is a diagram illustrating an example of a control information area in the first embodiment.
- FIG. 4B is a diagram showing another example of the control information area in the first exemplary embodiment.
- FIG. 4C is a diagram showing another example of the control information area in the first exemplary embodiment.
- FIG. 4D is a diagram illustrating another example of the control information area in the first embodiment.
- FIG. 4E is a diagram illustrating another example of the control information area in the first embodiment.
- FIG. 4F is a diagram illustrating an example of a control information area in the image recognition process in the cooking device according to Embodiment 1.
- FIG. 4G is a diagram showing another example of the control information area in the image recognition processing in the heating cooker according to Embodiment 1.
- FIG. 4H is a diagram showing another example of the control information area in the image recognition process in the heating cooker according to Embodiment 1.
- FIG. 5 is a diagram showing a recognition format table in the first embodiment.
- FIG. 6 is a flowchart of image recognition processing in the heating cooker according to the first embodiment.
- FIG. 7 is a block diagram illustrating a functional configuration of the heating cooker according to the second embodiment of the present disclosure.
- FIG. 8 is a diagram illustrating a deformed control information area in a captured image.
- FIG. 9 is a diagram showing a recognition format table in the second embodiment.
- FIG. 10 is a flowchart of image recognition processing in the heating cooker according to the second embodiment.
- the heating cooker includes a heating chamber, a heating unit, a control unit, a photographing unit, a recognition processing unit, a recognition format storage unit, and a recognition format determination unit.
- the heating cabinet accommodates the object to be heated.
- the heating unit heats the object to be heated in the heating chamber.
- the control unit controls the heating unit according to heating control information for heating the object to be heated.
- the shooting unit takes images in the heating chamber.
- the recognition processing unit detects a control information area from the image and extracts a recognition target included in the control information area.
- the recognition format storage unit stores the threshold information related to the control information area and the recognition format for analyzing the recognition target in association with each other.
- the recognition format determination unit determines the recognition format based on the feature information and threshold information extracted from the control information area.
- the recognition processing unit analyzes the recognition target based on the recognition format determined by the recognition format determination unit, and acquires heating control information.
- the recognition format storage unit stores information based on the shape of the control information area as threshold information.
- the recognition format determination unit determines the recognition format using information based on the shape of the control information area extracted from the image as feature information.
- the recognition format determination unit recognizes the aspect ratio of the control information area having a rectangular shape extracted from the image as the feature information. Determine the format.
- the recognition processing unit corrects the shape of the control information area according to the position of the control information area in the image.
- the recognition format storage unit further stores the dimensions of the control information area as threshold information.
- the recognition format determination unit determines the recognition format using the aspect ratio and the dimensions as feature information.
- the heating cooking system includes a heating chamber, a heating unit, a control unit, a photographing unit, a recognition processing unit, a recognition format storage unit, and a recognition format determination unit.
- the heating cabinet accommodates the object to be heated.
- the heating unit heats the object to be heated in the heating chamber.
- the control unit controls the heating unit according to heating control information for heating the object to be heated.
- the shooting unit takes images in the heating chamber.
- the recognition processing unit detects a control information area from the image and extracts a recognition target included in the control information area.
- the recognition format storage unit stores the threshold information related to the control information area and the recognition format for analyzing the recognition target in association with each other.
- the recognition format determination unit determines the recognition format based on the feature information and threshold information extracted from the control information area.
- the recognition processing unit analyzes the recognition target based on the recognition format determined by the recognition format determination unit, and acquires heating control information.
- the heating chamber, the heating unit, the control unit, and the photographing unit are arranged in the casing of the heating cooker. At least one of the recognition processing unit, the recognition format storage unit, and the recognition format determination unit is arranged outside the casing of the heating cooker.
- FIG. 1 is a diagram illustrating an appearance of a heating cooker 100 according to the first embodiment of the present disclosure.
- the heating cooker 100 includes a heating chamber 104 that is provided in a housing 111 and stores food that is an object to be heated, and a door 101 that covers a front opening of the heating chamber 104.
- a display unit 102 and a selection unit 103 are arranged on the top of the housing 111.
- the heating cooker 100 reads the heating time suitable for the food from the description on the label attached to the food, and heats the food during the heating time.
- the display unit 102 displays the read heating time.
- the selection unit 103 when the heating time is not read, includes a menu button for selecting a menu suitable for food and a numeric button for manually setting the heating time.
- the selection unit 103 further includes a heating start button for starting heating and a heating stop button for stopping heating.
- an illumination unit 105 for illuminating the interior of the chamber is disposed on the side surface of the heating chamber 104.
- an illumination unit 105 for illuminating the interior of the chamber is disposed.
- a camera 106 for photographing the interior is arranged on the ceiling of the heating cabinet 104. The camera 106 is controlled by a control circuit (not shown).
- the cooking device 100 is configured to photograph the food 107 stored in the heating chamber 104 using the camera 106 and read the heating control information related to the food 107 from the photographed image.
- the heating control information is information such as a heating amount and a heating time necessary for heating the food 107.
- FIG. 2 is a block diagram showing a functional configuration of the heating cooker 100.
- the heating cooker 100 includes a heating unit 201, an operation unit 202, an imaging unit 203, a control unit 204, and a recognition processing unit 205 as functional configurations arranged in the casing 111.
- the heating unit 201 is composed of, for example, a magnetron, and heats the food by supplying high frequency to the food placed in the heating chamber 104.
- the operation unit 202 includes, for example, a touch panel and a plurality of keys, and is used for setting a heating time, starting heating, and the like.
- the imaging unit 203 includes a camera 106 and a control circuit, and images the inside of the heating chamber 104.
- the camera 106 is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
- CMOS Complementary Metal Oxide Semiconductor
- CCD Charge Coupled Device
- the recognition processing unit 205 detects a control information area from the image captured by the image capturing unit 203 and extracts character information included in the control information area. The recognition processing unit 205 determines whether the character information is heating control information.
- the control information area is, for example, a rectangular area provided in a label affixed to the food and in which the heating control information is described.
- the character information may include not only the heating control information but also image information of the whole food, the type of food, the shape of the food, and the expiration date.
- the storage unit 206 is configured by a non-volatile memory such as a flash memory, and stores a recognition format related to the control information area, heating control information, and the like.
- the recognition format storage unit 207 stores the threshold information and the recognition format in association with each other.
- the threshold information is the aspect ratio of the control information area.
- the recognition format will be described later.
- the heating control information includes a heating amount (wattage) and a heating time for the heating amount.
- the information stored in the storage unit 206 may include information related to the shape of the food, the setting information of the heating cooker 100, the setting information of the camera 106, and the heating control and operation, in addition to the heating control information.
- the recognition format determination unit 208 determines the recognition format for the extracted character information based on the information stored in the recognition format storage unit 207.
- the control unit 204 controls the heating unit 201 according to the heating control information obtained by the recognition processing unit 205.
- FIG. 3A shows an example of a food 301 heated by the heating cooker 100 and a label attached to the food 301.
- the food 301 is a lunch box.
- a label 302 on which the name, price, and heating control information of the food is written is attached to the food 301.
- the heating control information is information necessary for heating the food 301, and specifically, a heating amount (wattage) and a heating time (minute, second).
- the heating control information may be described in a form that can be recognized by the user, or may be described in a barcode or a two-dimensional code.
- the control information area 303 is an area where heating control information is written on the label 302.
- the control information area 303 may be an area having the same size as the label 302 or may be a partial area within the label 302.
- the label 302 may be a sticker affixed to the food 301 or may be formed integrally with the packaging of the food 301.
- heating control information for a household microwave oven and heating control information (heating amount, heating time) for a commercial microwave oven are displayed. ).
- the heating control information for a household microwave oven is “500W for 2 minutes 30 seconds of heating”, and the heating control information for a commercial microwave oven is “1500W for 0 minutes 45 minutes”. Second heating ".
- the control information area 303 describes “500 W 2 minutes 30 seconds 1500 W 0 minutes 45 seconds”.
- the heating control information includes the first character string “500” representing the heating amount, the second character string “W” representing the unit of the heating amount, and the third character string “W” representing the heating time at the heating amount. 2 ”and the fifth character string“ 30 ”, and a fourth character string“ minute ”and a sixth character string“ second ”representing the unit of the heating time.
- the heating control information includes a seventh character string “1500” that represents the heating amount, an eighth character string “W” that represents the unit of the heating amount, and a ninth character string that represents the heating time at the heating amount. 0 ”and the eleventh character string“ 45 ”, and a tenth character string“ minute ”and a twelfth character string“ second ”representing the unit of the heating time.
- W (Watt) which is an SI unit representing the amount of heat
- Minute is described in the fourth and tenth character strings
- second is described in the sixth and twelfth character strings.
- other units may be used as long as they represent time.
- FIG. 3A two sets of heating control information are described in the control information area 303. However, in the control information area 303, only one set of heating control information may be described, or three or more sets of heating control information may be described.
- FIG. 3A and 3C also show examples of the food 301 heated by the heating cooker 100 and labels attached to the food 301, as in FIG. 3A.
- FIG. 3D shows an example of the food 307 heated by the heating cooker 100 and a label attached to the food 307.
- a part of the label 304 attached to the food 301 is a control information area 401 in which heating control information is described.
- the entire area of the label 305 affixed to the food 301 is a control information area 401 in which heating control information is described.
- the entire area of the label 306 affixed to the food 307 is a control information area 402 in which encoded heating control information is described.
- control information areas 401 and 402 are surrounded by an explicit frame. The detection of the control information area will be described later.
- the heating control information can be expressed in a plurality of formats. Thereby, it becomes easy to describe heating control information in foods or containers of different sizes. Also, different heating conditions can be easily distinguished using multiple formats.
- FIG. 4A shows a control information area 401 surrounded by a rectangular frame having a vertical width D1 and a horizontal width W1.
- heating control information is described in a format in which a plurality of sets of heating amounts and heating times are described side by side.
- the heating cooker 100 selects one of a plurality of heating control information according to its own maximum heating capacity, and performs heating according to the selected heating control information.
- FIG. 4B shows a control information area 402 surrounded by a rectangular frame having a vertical width D2 and a horizontal width W2.
- the heating control information is described in the format of encoded number information. This number information represents a combination of the heating amount and the heating time by a combination of alphanumeric characters and symbols.
- FIG. 4B four alphanumeric characters “324P” are written in the control information area 402.
- the first “3” corresponds to the heating amount.
- the subsequent “24” corresponds to the heating time.
- the last “P” is a check character indicating whether these three numbers are correct.
- the heating control information is expressed using four alphanumeric characters.
- the heating control information may be expressed using one number corresponding to the number described on the operation panel.
- the heating control information may be expressed in a format that is easy for the user to understand, including the upper two digits of the heating amount and the numerical value of the heating time converted into seconds.
- the heating control information by expressing the heating control information with encoded number information, a large amount of information can be written in a small display area.
- FIG. 4C shows a control information area 403 surrounded by a rectangular frame having a vertical width D3 and a horizontal width W3.
- heating control information is described in a format in which a plurality of sets of heating amounts and heating times are arranged vertically.
- the heating amount is “500 W”, and the heating time is “2 minutes 30 seconds”.
- the heating amount is “1500 W” and the heating time is “0 minute 45 seconds”.
- the heating amount is “300 W” and the heating time is “25 seconds”.
- the cooking device 100 performs stepwise heating by sequentially referring to the first to third heating control information.
- FIG. 4D shows a control information area 404 surrounded by a rectangular frame having a vertical width D4 and a horizontal width W4.
- the heating control information is described in a plurality of encoded number information formats.
- control information area 404 three pieces of number information “324P”, “156S”, and “676V” are described.
- the heating control information for performing a complicated sequence can be described in a small display area.
- FIG. 4E shows a control information area 405 surrounded by a rectangular frame having a vertical width D5 and a horizontal width W5.
- the boundary of the area is surrounded by a thick frame, whereas in the control information area 405 shown in FIG. 4E, the boundary of the area is surrounded by a double line.
- the control information area may have a shape that can be easily detected by the recognition processing unit 205.
- FIG. 4F shows a control information area 406 surrounded by an elliptical frame having a vertical width D6 and a horizontal width W6. That is, the major axis of the control information area 406 is the horizontal width W6, and the minor axis of the control information area 406 is the vertical width D6.
- FIG. 4G shows a control information area 407 surrounded by a virtual rectangular frame having a vertical width D7 and a horizontal width W7.
- the control information area 407 is a rectangular area virtually indicated by two markers indicating the upper left corner and the lower right corner.
- FIG. 4H shows a control information area 408 having a rectangular shape having a vertical width D8 and a horizontal width W8.
- the heating control information is described in the format of encoded number information.
- the character has a light color (for example, white) and the character background has a dark color (for example, black).
- the control information area may include color information that can be easily detected by the recognition processing unit 205.
- FIG. 5 shows a recognition format table 501 in the present embodiment.
- the recognition format table 501 is stored in the recognition format storage unit 207.
- the recognition format table 501 describes the aspect ratio, which is the ratio of the vertical width to the horizontal width of the rectangular control information area, as threshold information based on the shape of the control information area.
- the aspect ratio of the control information area 401 is a value obtained by dividing the horizontal width W1 by the vertical width D1.
- the aspect ratio of the control information area 402 is a value obtained by dividing the horizontal width W2 by the vertical width D2.
- the vertical width and the horizontal width are measured by the number of pixels in the image captured by the imaging unit 203.
- the recognition format is information indicating the format in which the heating control information is expressed in the control information area.
- the recognition format is “one-line character format”.
- heating control information is described according to this recognition format.
- the recognition format table 501 includes an identification ID, threshold information for the aspect ratio of the control information area (hereinafter referred to as an aspect ratio threshold), and a recognition format.
- the corresponding recognition format is “number format”.
- heating control information is described in the control information area 402 as number information such as “324P”.
- the corresponding recognition format is “one-line character format”.
- heating control information such as “500 W 2 minutes 30 seconds 1500 W 0 minutes 45 seconds” is described in the control information area 401.
- FIG. 6 is a flowchart of image recognition processing in the heating cooker 100.
- step S ⁇ b> 601 the imaging unit 203 captures an image in the heating chamber 104 on which the food 301 is placed.
- the recognition processing unit 205 detects the control information area from the label of the food 301 in the image captured by the imaging unit 203. Specifically, the recognition processing unit 205 detects an area surrounded by a frame having a predetermined shape as shown in FIG. 4A as a control information area. At this time, the recognition processing unit 205 may determine that the filled area (see FIG. 4H) is not a detection target.
- the recognition processing unit 205 extracts one or more recognition targets from the detected control information area.
- the recognition target is a character string included in the control information area.
- step S603 the recognition processing unit 205 determines whether the extracted recognition target is a regular recognition target that conforms to the standard.
- the recognition processing unit 205 determines whether the extracted recognition target is a regular recognition target based on, for example, whether the area of the control information region is a predetermined size or more. The recognition processing unit 205 determines whether the extracted recognition target is a regular recognition target based on whether the detected control information area has a predetermined color or a predetermined pattern. May be.
- step S604 the recognition processing unit 205 calculates the aspect ratio of the detected control information area using the detected vertical and horizontal widths of the control information area.
- the aspect ratio of the detected control information area is the characteristic information of the detected control information area.
- step S605 the recognition format determination unit 208 compares the aspect ratio calculated in step S604 with the aspect ratio threshold described in the recognition format table 501. Thereby, the recognition format determination unit 208 determines the recognition format for the extracted recognition target.
- step S606 the recognition processing unit 205 analyzes the recognition target based on the recognition format determined by the recognition format determination unit 208, and acquires heating control information.
- the control unit 204 controls the heating unit 201 based on the heating amount and the heating time included in the heating control information. Thereby, the heating cooker 100 heats the food 301.
- step S603 when it is determined that the extracted recognition target is not a regular recognition target, or when analysis of all the recognition targets included in the control information area is completed, the image recognition process ends.
- heating control information corresponding to various recognition formats and automatically set heating conditions such as heating time. Since it is possible to deal with food in a container with a small area for writing letters, it is possible to obtain a cooking device that can automatically heat food regardless of the type and size of the food. it can.
- the recognition format is determined before the characters of the heating control information are recognized, the heating control information can be recognized quickly and accurately.
- the recognition format can be determined with high accuracy, and the non-standard control information area can be accurately excluded.
- FIG. 7 is a block diagram showing a functional configuration of the heating cooker 700.
- the cooking device 700 includes a heating unit 701, an operation unit 702, an imaging unit 703, a control unit 704, and a recognition processing unit 705 as functional configurations arranged in the casing 111.
- the recognition processing unit 705 detects a control information area from the image captured by the imaging unit 703, and extracts character information included in the control information area. The recognition processing unit 705 determines whether the character information is heating control information.
- the character information may include not only the heating control information but also image information of the whole food, the type of food, the shape of the food, and the expiration date.
- the image correction unit 710 performs image processing according to the position of the detected control information area in the image. Specifically, when the control information area in the image is deformed or the image is unclear due to the position and orientation of the camera 106, the illuminance in the heating chamber 104, the image correction unit 710 Correct the defect.
- the storage unit 706 is configured by a nonvolatile memory such as a flash memory, and stores a recognition format related to the control information area, heating control information, and the like.
- the recognition format storage unit 707 stores the threshold information and the recognition format in association with each other.
- the threshold information is the aspect ratio and size of the control information area.
- the recognition format determination unit 708 determines the recognition format for the extracted character information based on the information stored in the recognition format storage unit 707.
- the control unit 704 controls the heating unit 701 according to the heating control information obtained by the recognition processing unit 705.
- FIG. 8 shows a deformed control information area in a photographed image.
- An image 801 illustrated in FIG. 8 is an image captured by the imaging unit 703.
- a food 802 as a lunch box is photographed.
- a label 803 is attached to the food 802.
- the label 803 includes a rectangular control information area 804.
- the food 802 is located in the upper left of the image 801. Therefore, the captured control information area 804 has a trapezoidal shape depending on the position and orientation of the camera 106.
- the image correction unit 710 corrects the trapezoidal shape to a rectangular shape using the trapezoidal correction in the image processing.
- FIG. 9 shows a recognition format table 901 in the present embodiment.
- the recognition format table 901 is stored in the recognition format storage unit 707.
- the recognition format table 901 describes the aspect ratio and the dimensions of the control information area in the image (the width in this example) as threshold information based on the shape of the control information area.
- the corresponding recognition The format is “number format”.
- heating control information is described in the control information area 402 as number information such as “324P”.
- the corresponding recognition The format is “one-line character format”.
- heating control information is described in the control information area 401 in a format such as “500 W 2 minutes 30 seconds 1500 W 0 minutes 45 seconds”.
- the discrimination process can be performed at high speed.
- FIG. 10 is a flowchart of image recognition processing in the heating cooker 700. As shown in FIG. 10, in step S ⁇ b> 1001, the imaging unit 703 captures an image in the heating chamber 104 on which the food 802 is placed.
- step S1002 the recognition processing unit 705 detects a control information area from the label 803 of the food 802 in the image photographed by the imaging unit 703.
- the recognition processing unit 705 extracts one or more recognition targets from the detected control information area.
- step S1003 the image correction unit 710 corrects the deformed control information area.
- step S1004 the recognition processing unit 705 determines whether the extracted recognition target is a regular recognition target that conforms to the standard.
- the recognition processing unit 705 determines whether the extracted recognition target is a regular recognition target based on, for example, whether the area of the control information area is equal to or larger than a predetermined size. The recognition processing unit 705 determines whether the extracted recognition target is a regular recognition target based on whether the detected control information area has a predetermined color or a predetermined pattern. May be.
- step S1005 the recognition processing unit 705 calculates the aspect ratio of the control information area by using the vertical width and horizontal width of the control information area, and acquires the dimensions of the control information area in the image.
- the aspect ratio of the detected control information area and the size of the control information area in the image are the characteristic information of the detected control information area.
- step S1006 the recognition format storage unit 707 compares the aspect ratio calculated in step S1005 with the aspect ratio threshold described in the recognition format table 901. Further, the recognition format storage unit 707 determines whether or not the size of the control information area in the image is within a predetermined range. Accordingly, the recognition format determination unit 708 determines a recognition format for the extracted recognition target.
- step S1007 the recognition processing unit 705 analyzes the recognition target based on the recognition format determined by the recognition format determination unit 708, and acquires heating control information.
- the control unit 704 controls the heating unit 701 based on the heating amount and the heating time included in the heating control information. Thereby, the heating cooker 700 heats the food 802.
- step S1004 when it is determined that the extracted recognition target is not a regular recognition target, or when analysis of all the recognition targets included in the control information area is completed, the image recognition process ends.
- heating control information corresponding to various formats and automatically set heating conditions such as heating time. Since the recognition format is determined based on the aspect ratio and dimensions of the control information area, the heating control information can be recognized quickly and accurately.
- the aspect ratio of the control information area is used as information based on the shape of the control information area for determining the recognition format.
- the information based on the shape of the control information area for determining the recognition format may be the area of the control information area, the ratio of the thicknesses of the two sides of the control information area, or the radius of curvature at the corner of the control information area. .
- the information based on the shape of the control information area may be information that can be easily extracted by the recognition processing unit 205.
- the heating cooker 100 includes a recognition processing unit 205, a storage unit 206, and a recognition format determination unit 208 in a casing 111.
- the recognition processing unit 205, the storage unit 206, and the recognition format determination unit 208 may be disposed outside the casing 111 of the heating cooker 100.
- This configuration constitutes a cooking system including a cooking device.
- the recognition processing unit 205, the storage unit 206, and the recognition format determination unit 208 are arranged outside the casing 111 of the heating cooker 100, the control unit 204 and elements arranged outside the casing 111 ( Information is transmitted / received to / from the recognition processing unit 205, the storage unit 206, and the recognition format determination unit 208).
- the heating control information can be obtained from an image taken by the camera. Accordingly, it is possible to provide a heating cooker and a heating cooking system that can easily heat various foods without requiring a troublesome input operation. Therefore, this indication is applicable to cooking-by-heating machines, such as a microwave oven and an induction heating cooking appliance.
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- General Engineering & Computer Science (AREA)
- Electric Ovens (AREA)
- Electric Stoves And Ranges (AREA)
Abstract
This heating cooker is provided with a heating chamber, a heating unit, a control unit, an image capturing unit, a recognition processing unit, a recognition form storage unit, and a recognition form determination unit. The heating chamber receives an object to be heated. The heating unit heats the object to be heated in the heating chamber. The control unit controls the heating unit according to heating control information for heating the object to be heated. The image capturing unit captures an image of the inside of the heating chamber. The recognition processing unit detects a control information area from the image and extracts a recognition target included in the control information area. The recognition form storage unit stores threshold information related to the control information area in association with a recognition form for analyzing the recognition target. The recognition form determination determines the recognition form on the basis of feature information extracted from the control information area and the threshold information. The recognition processing unit analyzes the recognition target and acquires heating control information on the basis of the recognition form determined by the recognition form determination unit.
Description
本開示は、加熱調理器内に設けられたカメラにより撮影された画像に基づいて食品を加熱する加熱調理器および加熱調理システムに関する。
The present disclosure relates to a heating cooker and a heating cooking system that heat food based on an image photographed by a camera provided in the heating cooker.
加熱調理器の一例である電子レンジでは、使用者が、加熱時間などを入力し、加熱を開始させるためのボタンを押下すると、加熱が行われる。コンビニエンスストア、スーパーマーケットなどの店舗において、店員が、顧客が購入した弁当を電子レンジで加熱して提供することがある。
In a microwave oven that is an example of a heating cooker, heating is performed when a user inputs a heating time and presses a button for starting heating. In a store such as a convenience store or a supermarket, a store clerk sometimes provides a lunch purchased by a customer by heating it with a microwave oven.
一般的に、店舗で販売される弁当の容器には、電子レンジによる最適な加熱時間が記載される。使用者である店員は、その記載を参照して、電子レンジの操作部に設けられた数字キーなどを操作して加熱時間を設定する。
Generally, the optimal heating time by a microwave oven is written on a lunch box container sold in a store. A store clerk who is a user refers to the description and operates a numeric key or the like provided on the operation unit of the microwave to set the heating time.
電子レンジの操作部に設けられ、異なる加熱時間が割り当てられた複数の操作ボタンを操作することで、使用者が食品に適した加熱時間を設定する場合もある。
The user may set a heating time suitable for food by operating a plurality of operation buttons that are provided in the operation unit of the microwave oven and are assigned different heating times.
しかしながら、このような加熱時間の入力操作は、使用者にとって面倒である。このため、電子レンジに加熱時間などが自動的に設定される技術が提案されている(例えば、特許文献1参照)。
However, such a heating time input operation is troublesome for the user. For this reason, a technique for automatically setting a heating time or the like in a microwave oven has been proposed (see, for example, Patent Document 1).
特許文献1に記載された技術では、加熱調理器に搭載されたカメラにより、調理前の被調理物が撮影される。撮影された画像から必要な情報が抽出されることで、最適な調理方法が選択される。
In the technique described in Patent Document 1, an object to be cooked before cooking is photographed by a camera mounted on a heating cooker. By extracting necessary information from the photographed image, an optimal cooking method is selected.
しかしながら、上記従来の技術では、様々な大きさの容器や異なる加熱条件の食品について、被加熱物の量や加熱時間などの加熱制御情報を自動で設定することが難しい。
However, it is difficult to automatically set the heating control information such as the amount of the object to be heated and the heating time for various sizes of containers and foods with different heating conditions in the above-described conventional technology.
上記従来の問題を解決するために、本開示の一態様の加熱調理器は、加熱庫と、加熱部と、制御部と、撮影部と、認識処理部と、認識書式記憶部と、認識書式判定部とを備える。
In order to solve the above conventional problems, a heating cooker according to an aspect of the present disclosure includes a heating chamber, a heating unit, a control unit, a photographing unit, a recognition processing unit, a recognition format storage unit, and a recognition format. A determination unit.
加熱庫は、被加熱物を収容する。加熱部は、加熱庫内の被加熱物を加熱する。制御部は、被加熱物の加熱のための加熱制御情報に従って加熱部を制御する。
The heating cabinet accommodates the object to be heated. The heating unit heats the object to be heated in the heating chamber. The control unit controls the heating unit according to heating control information for heating the object to be heated.
撮影部は、加熱庫内の画像を撮影する。認識処理部は、画像から制御情報領域を検出するとともに、制御情報領域に含まれた認識対象を抽出する。認識書式記憶部は、制御情報領域に関連する閾値情報と、認識対象を解析するための認識書式とを関連付けて記憶する。
The shooting unit takes images in the heating chamber. The recognition processing unit detects a control information area from the image and extracts a recognition target included in the control information area. The recognition format storage unit stores the threshold information related to the control information area and the recognition format for analyzing the recognition target in association with each other.
認識書式判定部は、制御情報領域から抽出された特徴情報と閾値情報とに基づいて、認識書式を判定する。認識処理部は、認識書式判定部により判定された認識書式に基づいて、認識対象を解析し加熱制御情報を取得する。
The recognition format determination unit determines the recognition format based on the feature information and threshold information extracted from the control information area. The recognition processing unit analyzes the recognition target based on the recognition format determined by the recognition format determination unit, and acquires heating control information.
本態様によれば、様々な認識書式に対応した加熱制御情報を読み取り、加熱時間などの加熱条件を自動で設定することができる。文字を記載する領域が小さい容器に入った食品にも対応することが可能であるため、食品の種類や大きさに関係なく、食品を自動的に加熱することができる加熱調理器を得ることができる。
According to this aspect, it is possible to read the heating control information corresponding to various recognition formats and automatically set the heating conditions such as the heating time. Since it is possible to deal with food in a container with a small area for writing letters, it is possible to obtain a cooking device that can automatically heat food regardless of the type and size of the food. it can.
本開示の第1の態様の加熱調理器は、加熱庫と、加熱部と、制御部と、撮影部と、認識処理部と、認識書式記憶部と、認識書式判定部とを備える。
The heating cooker according to the first aspect of the present disclosure includes a heating chamber, a heating unit, a control unit, a photographing unit, a recognition processing unit, a recognition format storage unit, and a recognition format determination unit.
加熱庫は、被加熱物を収容する。加熱部は、加熱庫内の被加熱物を加熱する。制御部は、被加熱物の加熱のための加熱制御情報に従って加熱部を制御する。
The heating cabinet accommodates the object to be heated. The heating unit heats the object to be heated in the heating chamber. The control unit controls the heating unit according to heating control information for heating the object to be heated.
撮影部は、加熱庫内の画像を撮影する。認識処理部は、画像から制御情報領域を検出するとともに、制御情報領域に含まれた認識対象を抽出する。認識書式記憶部は、制御情報領域に関連する閾値情報と、認識対象を解析するための認識書式とを関連付けて記憶する。
The shooting unit takes images in the heating chamber. The recognition processing unit detects a control information area from the image and extracts a recognition target included in the control information area. The recognition format storage unit stores the threshold information related to the control information area and the recognition format for analyzing the recognition target in association with each other.
認識書式判定部は、制御情報領域から抽出された特徴情報と閾値情報とに基づいて、認識書式を判定する。認識処理部は、認識書式判定部により判定された認識書式に基づいて、認識対象を解析し加熱制御情報を取得する。
The recognition format determination unit determines the recognition format based on the feature information and threshold information extracted from the control information area. The recognition processing unit analyzes the recognition target based on the recognition format determined by the recognition format determination unit, and acquires heating control information.
本開示の第2の態様の加熱調理器では、第1の態様に加えて、認識書式記憶部は、制御情報領域の形状に基づく情報を閾値情報として記憶する。認識書式判定部は、画像から抽出された、制御情報領域の形状に基づく情報を特徴情報として用いて認識書式を判定する。
In the cooking device according to the second aspect of the present disclosure, in addition to the first aspect, the recognition format storage unit stores information based on the shape of the control information area as threshold information. The recognition format determination unit determines the recognition format using information based on the shape of the control information area extracted from the image as feature information.
本開示の第3の態様の加熱調理器では、第2の態様に加えて、認識書式判定部は、画像から抽出された、長方形形状を有する制御情報領域の縦横比率を特徴情報として用いて認識書式を判定する。
In the heating cooker according to the third aspect of the present disclosure, in addition to the second aspect, the recognition format determination unit recognizes the aspect ratio of the control information area having a rectangular shape extracted from the image as the feature information. Determine the format.
本開示の第4の態様の加熱調理器では、第3の態様に加えて、認識処理部は、画像における制御情報領域の位置に応じて、制御情報領域の形状を補正する。
In the heating cooker according to the fourth aspect of the present disclosure, in addition to the third aspect, the recognition processing unit corrects the shape of the control information area according to the position of the control information area in the image.
本開示の第5の態様の加熱調理器では、第3の態様に加えて、認識書式記憶部は、閾値情報として、制御情報領域の寸法をさらに記憶する。認識書式判定部は、縦横比率と前記寸法とを特徴情報として用いて認識書式を判定する。
In the cooking device of the fifth aspect of the present disclosure, in addition to the third aspect, the recognition format storage unit further stores the dimensions of the control information area as threshold information. The recognition format determination unit determines the recognition format using the aspect ratio and the dimensions as feature information.
本開示の第6の態様の加熱調理システムは、加熱庫と、加熱部と、制御部と、撮影部と、認識処理部と、認識書式記憶部と、認識書式判定部とを備える。
The heating cooking system according to the sixth aspect of the present disclosure includes a heating chamber, a heating unit, a control unit, a photographing unit, a recognition processing unit, a recognition format storage unit, and a recognition format determination unit.
加熱庫は、被加熱物を収容する。加熱部は、加熱庫内の被加熱物を加熱する。制御部は、被加熱物の加熱のための加熱制御情報に従って加熱部を制御する。
The heating cabinet accommodates the object to be heated. The heating unit heats the object to be heated in the heating chamber. The control unit controls the heating unit according to heating control information for heating the object to be heated.
撮影部は、加熱庫内の画像を撮影する。認識処理部は、画像から制御情報領域を検出するとともに、制御情報領域に含まれた認識対象を抽出する。認識書式記憶部は、制御情報領域に関連する閾値情報と、認識対象を解析するための認識書式とを関連付けて記憶する。
The shooting unit takes images in the heating chamber. The recognition processing unit detects a control information area from the image and extracts a recognition target included in the control information area. The recognition format storage unit stores the threshold information related to the control information area and the recognition format for analyzing the recognition target in association with each other.
認識書式判定部は、制御情報領域から抽出された特徴情報と閾値情報とに基づいて、認識書式を判定する。認識処理部は、認識書式判定部により判定された認識書式に基づいて、認識対象を解析し加熱制御情報を取得する。
The recognition format determination unit determines the recognition format based on the feature information and threshold information extracted from the control information area. The recognition processing unit analyzes the recognition target based on the recognition format determined by the recognition format determination unit, and acquires heating control information.
加熱庫と加熱部と制御部と撮影部とは、加熱調理器の筐体内に配置される。認識処理部と認識書式記憶部と認識書式判定部との少なくともいずれか一つは、加熱調理器の筐体外に配置される。
The heating chamber, the heating unit, the control unit, and the photographing unit are arranged in the casing of the heating cooker. At least one of the recognition processing unit, the recognition format storage unit, and the recognition format determination unit is arranged outside the casing of the heating cooker.
以下、本開示の実施の形態の例を、図面を参照しながら説明する。
Hereinafter, exemplary embodiments of the present disclosure will be described with reference to the drawings.
(実施の形態1)
図1は、本開示の実施の形態1に係る加熱調理器100の外観を示す図である。図1に示すように、加熱調理器100は、筐体111内に設けられ、被加熱物である食品を収容する加熱庫104と、加熱庫104の前面開口を覆うドア101とを有する。筐体111の上部には、表示部102と選択部103とが配置される。 (Embodiment 1)
FIG. 1 is a diagram illustrating an appearance of aheating cooker 100 according to the first embodiment of the present disclosure. As shown in FIG. 1, the heating cooker 100 includes a heating chamber 104 that is provided in a housing 111 and stores food that is an object to be heated, and a door 101 that covers a front opening of the heating chamber 104. A display unit 102 and a selection unit 103 are arranged on the top of the housing 111.
図1は、本開示の実施の形態1に係る加熱調理器100の外観を示す図である。図1に示すように、加熱調理器100は、筐体111内に設けられ、被加熱物である食品を収容する加熱庫104と、加熱庫104の前面開口を覆うドア101とを有する。筐体111の上部には、表示部102と選択部103とが配置される。 (Embodiment 1)
FIG. 1 is a diagram illustrating an appearance of a
後述するように、加熱調理器100は、食品に貼付されたラベルの記載から食品に適した加熱時間を読み取り、その加熱時間の間、食品を加熱する。表示部102は、読み取られた加熱時間を表示する。
As will be described later, the heating cooker 100 reads the heating time suitable for the food from the description on the label attached to the food, and heats the food during the heating time. The display unit 102 displays the read heating time.
加熱時間が読み取られなかった場合などのために、選択部103は、食品に適したメニューを選択するためのメニューボタン、および、加熱時間を手動で設定するための数字ボタンを有する。選択部103はさらに、加熱を開始するための加熱開始ボタン、および、加熱を停止させるための加熱停止ボタンを有する。
For example, when the heating time is not read, the selection unit 103 includes a menu button for selecting a menu suitable for food and a numeric button for manually setting the heating time. The selection unit 103 further includes a heating start button for starting heating and a heating stop button for stopping heating.
加熱庫104の側面には、庫内を照らすための照明部105が配置される。加熱庫104の天井には、庫内を撮影するためのカメラ106が配置される。カメラ106は、図示しない制御回路に制御される。
On the side surface of the heating chamber 104, an illumination unit 105 for illuminating the interior of the chamber is disposed. On the ceiling of the heating cabinet 104, a camera 106 for photographing the interior is arranged. The camera 106 is controlled by a control circuit (not shown).
加熱調理器100は、カメラ106を用いて、加熱庫104に収容された食品107を撮影し、撮影された画像から、食品107に関連する加熱制御情報を読み取るように構成される。加熱制御情報とは、食品107を加熱するために必要な加熱量、加熱時間などの情報である。
The cooking device 100 is configured to photograph the food 107 stored in the heating chamber 104 using the camera 106 and read the heating control information related to the food 107 from the photographed image. The heating control information is information such as a heating amount and a heating time necessary for heating the food 107.
図2は、加熱調理器100の機能的構成を示すブロック図である。図2に示すように、加熱調理器100は、筐体111内に配置された機能的構成として、加熱部201と、操作部202と、撮像部203と、制御部204と、認識処理部205と、記憶部206と、認識書式記憶部207と、認識書式判定部208と、表示部209とを有する。
FIG. 2 is a block diagram showing a functional configuration of the heating cooker 100. As shown in FIG. 2, the heating cooker 100 includes a heating unit 201, an operation unit 202, an imaging unit 203, a control unit 204, and a recognition processing unit 205 as functional configurations arranged in the casing 111. A storage unit 206, a recognition format storage unit 207, a recognition format determination unit 208, and a display unit 209.
加熱部201は、例えばマグネトロンで構成され、加熱庫104に置かれた食品に高周波を供給して食品を加熱する。
The heating unit 201 is composed of, for example, a magnetron, and heats the food by supplying high frequency to the food placed in the heating chamber 104.
操作部202は、例えばタッチパネルおよび複数のキーを有し、加熱時間の設定、加熱の開始などを行うために使用される。
The operation unit 202 includes, for example, a touch panel and a plurality of keys, and is used for setting a heating time, starting heating, and the like.
撮像部203は、カメラ106と制御回路とを含み、加熱庫104の内部を撮影する。カメラ106は、例えばCMOS(Complementary Metal Oxide Semiconductor)イメージセンサ、または、CCD(Charge Coupled Device)イメージセンサなどで構成される。
The imaging unit 203 includes a camera 106 and a control circuit, and images the inside of the heating chamber 104. The camera 106 is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
認識処理部205は、撮像部203により撮影された画像から制御情報領域を検出し、その制御情報領域に含まれた文字情報を抽出する。認識処理部205は、その文字情報が加熱制御情報かどうかを判定する。制御情報領域とは、食品に貼付されたラベル内に設けられ、加熱制御情報が記載された例えば長方形領域である。
The recognition processing unit 205 detects a control information area from the image captured by the image capturing unit 203 and extracts character information included in the control information area. The recognition processing unit 205 determines whether the character information is heating control information. The control information area is, for example, a rectangular area provided in a label affixed to the food and in which the heating control information is described.
ラベルの文字認識方法として、例えば、ラベル内の枠で囲まれた文字情報を抽出する方法や、ラベルの輪郭を検出する方法が用いられる。文字情報には、加熱制御情報だけでなく、食品全体の画像情報、食品の種類、食品の形状、賞味期限が含まれてもよい。
As a label character recognition method, for example, a method of extracting character information surrounded by a frame in the label or a method of detecting the outline of the label is used. The character information may include not only the heating control information but also image information of the whole food, the type of food, the shape of the food, and the expiration date.
記憶部206は、フラッシュメモリなどの不揮発性メモリで構成され、制御情報領域に関する認識書式、加熱制御情報などを記憶する。認識書式記憶部207は、閾値情報と認識書式とを関連付けて記憶する。本実施の形態では、閾値情報は、制御情報領域の縦横比率である。認識書式については後述する。
The storage unit 206 is configured by a non-volatile memory such as a flash memory, and stores a recognition format related to the control information area, heating control information, and the like. The recognition format storage unit 207 stores the threshold information and the recognition format in association with each other. In the present embodiment, the threshold information is the aspect ratio of the control information area. The recognition format will be described later.
加熱制御情報には、加熱量(ワット数)とその加熱量に対する加熱時間が含まれる。記憶部206に記憶された情報には、加熱制御情報のほか、食品の形状、加熱調理器100の設定情報、カメラ106の設定情報、加熱制御および操作に関連する情報が含まれてもよい。
The heating control information includes a heating amount (wattage) and a heating time for the heating amount. The information stored in the storage unit 206 may include information related to the shape of the food, the setting information of the heating cooker 100, the setting information of the camera 106, and the heating control and operation, in addition to the heating control information.
認識書式判定部208は、認識書式記憶部207に記憶された情報に基づき、抽出された文字情報に対する認識書式を判定する。制御部204は、認識処理部205により得られた加熱制御情報に従って、加熱部201を制御する。
The recognition format determination unit 208 determines the recognition format for the extracted character information based on the information stored in the recognition format storage unit 207. The control unit 204 controls the heating unit 201 according to the heating control information obtained by the recognition processing unit 205.
図3Aは、加熱調理器100により加熱される食品301、および、食品301に貼付されたラベルの例を示す。図3Aに示すように、食品301は弁当である。食品301には、食品の名称、価格、加熱制御情報などが記載されたラベル302が貼付される。
FIG. 3A shows an example of a food 301 heated by the heating cooker 100 and a label attached to the food 301. As shown in FIG. 3A, the food 301 is a lunch box. A label 302 on which the name, price, and heating control information of the food is written is attached to the food 301.
加熱制御情報は、食品301の加熱に必要な情報であり、具体的には、加熱量(ワット数)および加熱時間(分、秒)である。加熱制御情報は、使用者が認識できる形態で記載されてもよく、バーコードまたは二次元コードで記載されてもよい。
The heating control information is information necessary for heating the food 301, and specifically, a heating amount (wattage) and a heating time (minute, second). The heating control information may be described in a form that can be recognized by the user, or may be described in a barcode or a two-dimensional code.
制御情報領域303は、ラベル302において加熱制御情報が記載される領域である。制御情報領域303は、ラベル302と同じ大きさの領域でもよく、ラベル302内の一部分の領域でもよい。ラベル302は、食品301に貼付されたシールであってもよく、食品301の包装と一体的に形成されてもよい。
The control information area 303 is an area where heating control information is written on the label 302. The control information area 303 may be an area having the same size as the label 302 or may be a partial area within the label 302. The label 302 may be a sticker affixed to the food 301 or may be formed integrally with the packaging of the food 301.
図3Aに示す例では、制御情報領域303に、家庭用の電子レンジのための加熱制御情報(加熱量、加熱時間)と、業務用の電子レンジのための加熱制御情報(加熱量、加熱時間)とが記載される。
In the example shown in FIG. 3A, in the control information area 303, heating control information (heating amount, heating time) for a household microwave oven and heating control information (heating amount, heating time) for a commercial microwave oven are displayed. ).
具体的には、家庭用の電子レンジのための加熱制御情報は、「500Wで2分30秒の加熱」であり、業務用の電子レンジのための加熱制御情報は、「1500Wで0分45秒の加熱」である。この場合、制御情報領域303には、「500W 2分30秒 1500W 0分45秒」と記載される。
Specifically, the heating control information for a household microwave oven is “500W for 2 minutes 30 seconds of heating”, and the heating control information for a commercial microwave oven is “1500W for 0 minutes 45 minutes”. Second heating ". In this case, the control information area 303 describes “500 W 2 minutes 30 seconds 1500 W 0 minutes 45 seconds”.
すなわち、加熱制御情報は、加熱量を表す第1文字列「500」と、その加熱量の単位を表す第2文字列「W」と、その加熱量での加熱時間を表す第3文字列「2」および第5文字列「30」と、その加熱時間の単位を表す第4文字列「分」および第6文字列「秒」とを含む。
That is, the heating control information includes the first character string “500” representing the heating amount, the second character string “W” representing the unit of the heating amount, and the third character string “W” representing the heating time at the heating amount. 2 ”and the fifth character string“ 30 ”, and a fourth character string“ minute ”and a sixth character string“ second ”representing the unit of the heating time.
さらに、加熱制御情報は、加熱量を表す第7文字列「1500」と、その加熱量の単位を表す第8文字列「W」と、その加熱量での加熱時間を表す第9文字列「0」および第11文字列「45」と、その加熱時間の単位を表す第10文字列「分」および第12文字列「秒」とを含む。
Furthermore, the heating control information includes a seventh character string “1500” that represents the heating amount, an eighth character string “W” that represents the unit of the heating amount, and a ninth character string that represents the heating time at the heating amount. 0 ”and the eleventh character string“ 45 ”, and a tenth character string“ minute ”and a twelfth character string“ second ”representing the unit of the heating time.
本実施の形態では、第2および第8文字列に、熱量を表すSI単位である「W(ワット)」が記載される。しかし、加熱量を表すものであれば、他の単位を用いてもよい。第4および第10文字列に「分」が、第6および第12文字列に「秒」が記載される。しかし、時間を表すものであれば、他の単位でもよい。
In the present embodiment, “W (Watt)”, which is an SI unit representing the amount of heat, is described in the second and eighth character strings. However, other units may be used as long as they represent the heating amount. “Minute” is described in the fourth and tenth character strings, and “second” is described in the sixth and twelfth character strings. However, other units may be used as long as they represent time.
図3Aでは、制御情報領域303に、2組の加熱制御情報が記載される。しかし、制御情報領域303には、1組の加熱制御情報だけが記載されてもよく、3組以上の加熱制御情報が記載されてもよい。
In FIG. 3A, two sets of heating control information are described in the control information area 303. However, in the control information area 303, only one set of heating control information may be described, or three or more sets of heating control information may be described.
図3Aと同様、図3B、図3Cも、加熱調理器100により加熱される食品301、および、食品301に貼付されたラベルの例を示す。図3Dは、加熱調理器100により加熱される食品307、および、食品307に貼付されたラベルの例を示す。
3A and 3C also show examples of the food 301 heated by the heating cooker 100 and labels attached to the food 301, as in FIG. 3A. FIG. 3D shows an example of the food 307 heated by the heating cooker 100 and a label attached to the food 307.
図3Bに示す例では、食品301に貼付されたラベル304の一部が、加熱制御情報が記載された制御情報領域401である。図3Cに示す例は、食品301に貼付されたラベル305の全域が、加熱制御情報が記載された制御情報領域401である。図3Dに示す例では、食品307に貼付されたラベル306の全域が、符号化された加熱制御情報が記載された制御情報領域402である。
In the example shown in FIG. 3B, a part of the label 304 attached to the food 301 is a control information area 401 in which heating control information is described. In the example shown in FIG. 3C, the entire area of the label 305 affixed to the food 301 is a control information area 401 in which heating control information is described. In the example shown in FIG. 3D, the entire area of the label 306 affixed to the food 307 is a control information area 402 in which encoded heating control information is described.
これらの図において、認識処理部205による検出を容易にするために、制御情報領域401および402の境界が明示的な枠で囲まれている。制御情報領域の検出については後述する。
In these drawings, in order to facilitate detection by the recognition processing unit 205, the boundaries of the control information areas 401 and 402 are surrounded by an explicit frame. The detection of the control information area will be described later.
図3A~図3Dに示すように、加熱制御情報は、複数の書式により表現することができる。これにより、異なる大きさの食品または容器に、加熱制御情報を記載することが容易となる。また、複数の書式を用いて、異なる加熱条件を容易に区別することができる。
As shown in FIGS. 3A to 3D, the heating control information can be expressed in a plurality of formats. Thereby, it becomes easy to describe heating control information in foods or containers of different sizes. Also, different heating conditions can be easily distinguished using multiple formats.
図4Aは、縦幅D1、横幅W1を有する長方形の枠で囲まれた制御情報領域401を示す。制御情報領域401には、複数組の加熱量および加熱時間を並べて記載する書式で、加熱制御情報が記載される。
FIG. 4A shows a control information area 401 surrounded by a rectangular frame having a vertical width D1 and a horizontal width W1. In the control information area 401, heating control information is described in a format in which a plurality of sets of heating amounts and heating times are described side by side.
具体的には、制御情報領域401には、2組の加熱制御情報が記載される。第1の加熱制御情報では、加熱量が「500W」、加熱時間が「2分30秒」である。第2の加熱制御情報では、加熱量が「1500W」、加熱時間が「0分45秒」である。この記載に基づいて、加熱調理器100は、自己の最大加熱能力に応じて複数の加熱制御情報のいずれかを選択し、選択された加熱制御情報に従って加熱を行う。
Specifically, two sets of heating control information are described in the control information area 401. In the first heating control information, the heating amount is “500 W”, and the heating time is “2 minutes 30 seconds”. In the second heating control information, the heating amount is “1500 W” and the heating time is “0 minute 45 seconds”. Based on this description, the heating cooker 100 selects one of a plurality of heating control information according to its own maximum heating capacity, and performs heating according to the selected heating control information.
図4Bは、縦幅D2、横幅W2を有する長方形の枠で囲まれた制御情報領域402を示す。制御情報領域402には、加熱制御情報が、符号化された番号情報の書式で記載される。この番号情報は、加熱量および加熱時間の組み合わせを、英数字、記号の組み合わせで表現したものである。
FIG. 4B shows a control information area 402 surrounded by a rectangular frame having a vertical width D2 and a horizontal width W2. In the control information area 402, the heating control information is described in the format of encoded number information. This number information represents a combination of the heating amount and the heating time by a combination of alphanumeric characters and symbols.
具体的には、図4Bに示すように、制御情報領域402内に、英数字4文字「324P」が記載される。この例では、最初の「3」は加熱量に対応する。続く「24」は加熱時間に対応する。最後の「P」は、これら三つの数字が正しいかどうかを示すチェック文字である。
Specifically, as shown in FIG. 4B, four alphanumeric characters “324P” are written in the control information area 402. In this example, the first “3” corresponds to the heating amount. The subsequent “24” corresponds to the heating time. The last “P” is a check character indicating whether these three numbers are correct.
この例では四つの英数字を用いて、加熱制御情報が表現される。しかし、操作パネル上に記載された番号に対応した一つの数字を用いて、加熱制御情報が表現されてもよい。加熱量の上位2桁の数字と、秒換算した加熱時間の数値とを含む、使用者に理解し易い形式で、加熱制御情報が表現されてもよい。このように、加熱制御情報を符号化された番号情報で表現することにより、小さい表示領域に多くの情報を記載することができる。
In this example, the heating control information is expressed using four alphanumeric characters. However, the heating control information may be expressed using one number corresponding to the number described on the operation panel. The heating control information may be expressed in a format that is easy for the user to understand, including the upper two digits of the heating amount and the numerical value of the heating time converted into seconds. Thus, by expressing the heating control information with encoded number information, a large amount of information can be written in a small display area.
図4Cは、縦幅D3、横幅W3を有する長方形の枠で囲まれた制御情報領域403を示す。制御情報領域403には、加熱制御情報が、複数組の加熱量および加熱時間が縦に並ぶ書式で記載される。
FIG. 4C shows a control information area 403 surrounded by a rectangular frame having a vertical width D3 and a horizontal width W3. In the control information area 403, heating control information is described in a format in which a plurality of sets of heating amounts and heating times are arranged vertically.
具体的には、制御情報領域403には、3組の加熱制御情報が記載される。第1の加熱制御情報では、加熱量が「500W」、加熱時間が「2分30秒」である。第2の加熱制御情報では、加熱量が「1500W」、加熱時間が「0分45秒」である。第3の加熱制御情報では、加熱量が「300W」、加熱時間が「25秒」である。
Specifically, in the control information area 403, three sets of heating control information are described. In the first heating control information, the heating amount is “500 W”, and the heating time is “2 minutes 30 seconds”. In the second heating control information, the heating amount is “1500 W” and the heating time is “0 minute 45 seconds”. In the third heating control information, the heating amount is “300 W” and the heating time is “25 seconds”.
加熱調理器100は、第1~第3の加熱制御情報を順に参照することにより、ステップ状の加熱を実施する。
The cooking device 100 performs stepwise heating by sequentially referring to the first to third heating control information.
図4Dは、縦幅D4、横幅W4を有する長方形の枠で囲まれた制御情報領域404を示す。制御情報領域404には、加熱制御情報が、複数の符号化された番号情報の書式で記載される。
FIG. 4D shows a control information area 404 surrounded by a rectangular frame having a vertical width D4 and a horizontal width W4. In the control information area 404, the heating control information is described in a plurality of encoded number information formats.
具体的には、制御情報領域404には、「324P」、「156S」、「676V」の三つの番号情報が記載される。このように、複数の加熱制御情報を複数の符号化された番号情報で表現することにより、複雑なシーケンスを実施するための加熱制御情報を小さい表示領域に記載することができる。
Specifically, in the control information area 404, three pieces of number information “324P”, “156S”, and “676V” are described. Thus, by expressing a plurality of heating control information with a plurality of encoded number information, the heating control information for performing a complicated sequence can be described in a small display area.
図4Eは、縦幅D5、横幅W5を有する長方形の枠で囲まれた制御情報領域405を示す。図4Cに示す制御情報領域403では、領域の境界が太枠で囲まれるのに対して、図4Eに示す制御情報領域405では、領域の境界が二重線で囲まれる。このように、制御情報領域は、認識処理部205により容易に検出可能な形状を有してもよい。
FIG. 4E shows a control information area 405 surrounded by a rectangular frame having a vertical width D5 and a horizontal width W5. In the control information area 403 shown in FIG. 4C, the boundary of the area is surrounded by a thick frame, whereas in the control information area 405 shown in FIG. 4E, the boundary of the area is surrounded by a double line. As described above, the control information area may have a shape that can be easily detected by the recognition processing unit 205.
図4Fは、縦幅D6、横幅W6を有する楕円形状の枠で囲まれた制御情報領域406を示す。すなわち、制御情報領域406の長径が横幅W6であり、制御情報領域406の短径が縦幅D6である。
FIG. 4F shows a control information area 406 surrounded by an elliptical frame having a vertical width D6 and a horizontal width W6. That is, the major axis of the control information area 406 is the horizontal width W6, and the minor axis of the control information area 406 is the vertical width D6.
図4Gは、縦幅D7、横幅W7を有する仮想的な長方形の枠で囲まれた制御情報領域407を示す。図4Gに示すように、制御情報領域407は、左上の角と右下の角とを意味する二つのマーカーにより仮想的に示された長方形の領域である。
FIG. 4G shows a control information area 407 surrounded by a virtual rectangular frame having a vertical width D7 and a horizontal width W7. As shown in FIG. 4G, the control information area 407 is a rectangular area virtually indicated by two markers indicating the upper left corner and the lower right corner.
図4Hは、縦幅D8、横幅W8を有する長方形形状を有する制御情報領域408を示す。制御情報領域408には、加熱制御情報が、符号化された番号情報の書式で記載される。制御情報領域408では、文字が淡い色(例えば白)を有し、文字の背景が濃い色(例えば黒)を有する。このように、制御情報領域は、認識処理部205により容易に検出可能な色情報を含んでもよい。
FIG. 4H shows a control information area 408 having a rectangular shape having a vertical width D8 and a horizontal width W8. In the control information area 408, the heating control information is described in the format of encoded number information. In the control information area 408, the character has a light color (for example, white) and the character background has a dark color (for example, black). As described above, the control information area may include color information that can be easily detected by the recognition processing unit 205.
図5は、本実施の形態における認識書式テーブル501を示す。認識書式テーブル501は、認識書式記憶部207により記憶される。
FIG. 5 shows a recognition format table 501 in the present embodiment. The recognition format table 501 is stored in the recognition format storage unit 207.
図5に示すように、認識書式テーブル501は、制御情報領域の形状に基づく閾値情報として、長方形の制御情報領域の縦幅と横幅との比である縦横比率を記載する。
As shown in FIG. 5, the recognition format table 501 describes the aspect ratio, which is the ratio of the vertical width to the horizontal width of the rectangular control information area, as threshold information based on the shape of the control information area.
図4Aに示す例では、制御情報領域401の縦横比率は、横幅W1を縦幅D1で割った値である。図4Bに示す例では、制御情報領域402の縦横比率は、横幅W2を縦幅D2で割った値である。縦幅と横幅とは、撮像部203により撮影された画像における画素数により測定される。
In the example shown in FIG. 4A, the aspect ratio of the control information area 401 is a value obtained by dividing the horizontal width W1 by the vertical width D1. In the example shown in FIG. 4B, the aspect ratio of the control information area 402 is a value obtained by dividing the horizontal width W2 by the vertical width D2. The vertical width and the horizontal width are measured by the number of pixels in the image captured by the imaging unit 203.
認識書式とは、制御情報領域において加熱制御情報が表現される書式を示す情報である。例えば図4Aに示す例では、認識書式は「1行の文字書式」である。制御情報領域401には、加熱制御情報がこの認識書式に従って記載される。
The recognition format is information indicating the format in which the heating control information is expressed in the control information area. For example, in the example shown in FIG. 4A, the recognition format is “one-line character format”. In the control information area 401, heating control information is described according to this recognition format.
図5に示すように、認識書式テーブル501は、識別IDと、制御情報領域の縦横比率に対する閾値情報(以下、縦横比率閾値という)と、認識書式とを含む。
As shown in FIG. 5, the recognition format table 501 includes an identification ID, threshold information for the aspect ratio of the control information area (hereinafter referred to as an aspect ratio threshold), and a recognition format.
制御情報領域の縦横比率が1.0~1.2の範囲にある、識別ID「L0001」の場合、対応する認識書式は「番号書式」である。この場合、例えば図4Bで示すように、制御情報領域402には、「324P」のような番号情報として加熱制御情報が記載される。
In the case of the identification ID “L0001” where the aspect ratio of the control information area is in the range of 1.0 to 1.2, the corresponding recognition format is “number format”. In this case, for example, as shown in FIG. 4B, heating control information is described in the control information area 402 as number information such as “324P”.
制御情報領域の縦横比率が4.0~6.0の範囲にある、識別ID「L0002」の場合、対応する認識書式は「1行の文字書式」である。この場合、図4Aに示すように、制御情報領域401には、「500W 2分30秒 1500W 0分45秒」のような加熱制御情報が記載される。
In the case of the identification ID “L0002” in which the aspect ratio of the control information area is in the range of 4.0 to 6.0, the corresponding recognition format is “one-line character format”. In this case, as shown in FIG. 4A, heating control information such as “500 W 2 minutes 30 seconds 1500 W 0 minutes 45 seconds” is described in the control information area 401.
認識書式テーブル501を用いて対応する認識書式を判定する際に、該当の認識書式がなければ、エラー処理を行ってもよい。該当の認識書式がない場合、例えば、使用者に食品を加熱しないことを通知してもよい。このように、制御情報領域の形状の特徴を閾値と比較することにより、対応する書式を判定するだけでなく、エラーを検出することもできる。
When determining the corresponding recognition format using the recognition format table 501, if there is no corresponding recognition format, error processing may be performed. If there is no corresponding recognition format, for example, the user may be notified that the food is not heated. In this way, by comparing the feature of the shape of the control information area with the threshold value, it is possible not only to determine the corresponding format but also to detect an error.
次に、本実施の形態における画像認識処理について説明する。図6は、加熱調理器100における画像認識処理のフローチャートである。図6に示すように、ステップS601において、撮像部203は、食品301が載置された加熱庫104内の画像を撮影する。
Next, the image recognition process in this embodiment will be described. FIG. 6 is a flowchart of image recognition processing in the heating cooker 100. As shown in FIG. 6, in step S <b> 601, the imaging unit 203 captures an image in the heating chamber 104 on which the food 301 is placed.
ステップS602において、認識処理部205は、撮像部203により撮影された画像における食品301のラベルから制御情報領域を検出する。具体的には、認識処理部205は、図4Aに示すような所定形状の枠で囲まれた領域を制御情報領域として検出する。この際、認識処理部205は、塗りつぶされた領域(図4H参照)を検出対象外と判断してもよい。
In step S602, the recognition processing unit 205 detects the control information area from the label of the food 301 in the image captured by the imaging unit 203. Specifically, the recognition processing unit 205 detects an area surrounded by a frame having a predetermined shape as shown in FIG. 4A as a control information area. At this time, the recognition processing unit 205 may determine that the filled area (see FIG. 4H) is not a detection target.
認識処理部205は、検出された制御情報領域から一つ以上の認識対象を抽出する。認識対象とは、制御情報領域に含まれた文字列のことである。
The recognition processing unit 205 extracts one or more recognition targets from the detected control information area. The recognition target is a character string included in the control information area.
ステップS603において、認識処理部205は、抽出された認識対象が規格に準拠した正規の認識対象であるかどうかを判断する。
In step S603, the recognition processing unit 205 determines whether the extracted recognition target is a regular recognition target that conforms to the standard.
具体的には、認識処理部205は、例えば制御情報領域の面積が所定の大きさ以上であるかに基づいて、抽出された認識対象が正規の認識対象であるかどうかを判断する。認識処理部205は、検出された制御情報領域が所定の色を有するか、または、所定の模様を有するかなどに基づいて、抽出された認識対象が、正規の認識対象であるかどうかを判断してもよい。
Specifically, the recognition processing unit 205 determines whether the extracted recognition target is a regular recognition target based on, for example, whether the area of the control information region is a predetermined size or more. The recognition processing unit 205 determines whether the extracted recognition target is a regular recognition target based on whether the detected control information area has a predetermined color or a predetermined pattern. May be.
抽出された認識対象が正規の認識対象(本実施の形態では、例えば制御情報領域401、402)である場合、処理はステップS604に進む。ステップS604において、認識処理部205は、検出された制御情報領域の縦幅および横幅を用いて、検出された制御情報領域の縦横比率を算出する。本実施の形態では、検出された制御情報領域の縦横比率が、検出された制御情報領域の特徴情報である。
If the extracted recognition target is a regular recognition target (in this embodiment, for example, the control information areas 401 and 402), the process proceeds to step S604. In step S604, the recognition processing unit 205 calculates the aspect ratio of the detected control information area using the detected vertical and horizontal widths of the control information area. In the present embodiment, the aspect ratio of the detected control information area is the characteristic information of the detected control information area.
ステップS605において、認識書式判定部208は、ステップS604で算出された縦横比率と、認識書式テーブル501に記載された縦横比率閾値とを比較する。これにより、認識書式判定部208は、抽出された認識対象に対する認識書式を判定する。
In step S605, the recognition format determination unit 208 compares the aspect ratio calculated in step S604 with the aspect ratio threshold described in the recognition format table 501. Thereby, the recognition format determination unit 208 determines the recognition format for the extracted recognition target.
ステップS606において、認識処理部205は、認識書式判定部208により判定された認識書式に基づいて認識対象を解析し、加熱制御情報を取得する。
In step S606, the recognition processing unit 205 analyzes the recognition target based on the recognition format determined by the recognition format determination unit 208, and acquires heating control information.
制御部204は、この加熱制御情報に含まれた加熱量および加熱時間に基づいて、加熱部201を制御する。これにより、加熱調理器100は食品301を加熱する。
The control unit 204 controls the heating unit 201 based on the heating amount and the heating time included in the heating control information. Thereby, the heating cooker 100 heats the food 301.
ステップS603において、抽出された認識対象が正規の認識対象でないと判断された場合、または、制御情報領域に含まれたすべての認識対象の解析が完了した場合、画像認識処理は終了する。
In step S603, when it is determined that the extracted recognition target is not a regular recognition target, or when analysis of all the recognition targets included in the control information area is completed, the image recognition process ends.
このように、本実施の形態によれば、様々な認識書式に対応した加熱制御情報を読み取り、加熱時間などの加熱条件を自動で設定することができる。文字を記載する領域が小さい容器に入った食品にも対応することが可能であるため、食品の種類や大きさに関係なく、食品を自動的に加熱することができる加熱調理器を得ることができる。
Thus, according to this embodiment, it is possible to read heating control information corresponding to various recognition formats and automatically set heating conditions such as heating time. Since it is possible to deal with food in a container with a small area for writing letters, it is possible to obtain a cooking device that can automatically heat food regardless of the type and size of the food. it can.
本実施の形態によれば、複数の加熱条件を識別できるため、様々な加熱方法による食品を提供することができる。複雑な加熱シーケンスを小さい領域に記載できるため、食品ごとに適した加熱を行うことができる。
According to this embodiment, since a plurality of heating conditions can be identified, food by various heating methods can be provided. Since a complicated heating sequence can be described in a small area, heating suitable for each food can be performed.
加熱制御情報の文字を認識する前に認識書式を判定するので、加熱制御情報を素早く、精度よく認識することができる。制御情報領域の形状に関する特徴情報を複数の閾値情報と比較することで、精度よく認識書式を判定できるとともに、規格外の制御情報領域を精度よく除外することができる。
Since the recognition format is determined before the characters of the heating control information are recognized, the heating control information can be recognized quickly and accurately. By comparing the feature information related to the shape of the control information area with a plurality of threshold information, the recognition format can be determined with high accuracy, and the non-standard control information area can be accurately excluded.
(実施の形態2)
以下、本開示の実施の形態2に係る加熱調理器700について説明する。本実施の形態では、実施の形態1と同様の構造、機能的構成、制御方法についての説明を省略する。 (Embodiment 2)
Hereinafter, theheating cooker 700 according to the second embodiment of the present disclosure will be described. In the present embodiment, description of the same structure, functional configuration, and control method as in Embodiment 1 will be omitted.
以下、本開示の実施の形態2に係る加熱調理器700について説明する。本実施の形態では、実施の形態1と同様の構造、機能的構成、制御方法についての説明を省略する。 (Embodiment 2)
Hereinafter, the
図7は、加熱調理器700の機能的構成を示すブロック図である。図7に示すように、加熱調理器700は、筐体111内に配置された機能的構成として、加熱部701と、操作部702と、撮像部703と、制御部704と、認識処理部705と、記憶部706と、認識書式記憶部707と、認識書式判定部708と、表示部709と、画像補正部710とを有する。
FIG. 7 is a block diagram showing a functional configuration of the heating cooker 700. As illustrated in FIG. 7, the cooking device 700 includes a heating unit 701, an operation unit 702, an imaging unit 703, a control unit 704, and a recognition processing unit 705 as functional configurations arranged in the casing 111. A storage unit 706, a recognition format storage unit 707, a recognition format determination unit 708, a display unit 709, and an image correction unit 710.
認識処理部705は、撮像部703により撮影された画像から制御情報領域を検出し、その制御情報領域に含まれた文字情報を抽出する。認識処理部705は、その文字情報が加熱制御情報かどうかを判定する。
The recognition processing unit 705 detects a control information area from the image captured by the imaging unit 703, and extracts character information included in the control information area. The recognition processing unit 705 determines whether the character information is heating control information.
ラベルの文字認識方法として、例えば、ラベル内の枠で囲まれた文字情報を抽出する方法や、ラベルの輪郭を検出する方法が用いられる。文字情報には、加熱制御情報だけでなく、食品全体の画像情報、食品の種類、食品の形状、賞味期限が含まれてもよい。
As a label character recognition method, for example, a method of extracting character information surrounded by a frame in the label or a method of detecting the outline of the label is used. The character information may include not only the heating control information but also image information of the whole food, the type of food, the shape of the food, and the expiration date.
画像補正部710は、検出された制御情報領域の画像内の位置に応じた画像処理を行う。具体的には、カメラ106の位置および向き、加熱庫104内の照度などにより、画像内の制御情報領域が変形していたり、画像が不鮮明になっていたりする場合、画像補正部710がこれらの不具合を補正する。
The image correction unit 710 performs image processing according to the position of the detected control information area in the image. Specifically, when the control information area in the image is deformed or the image is unclear due to the position and orientation of the camera 106, the illuminance in the heating chamber 104, the image correction unit 710 Correct the defect.
記憶部706は、フラッシュメモリなどの不揮発性メモリで構成され、制御情報領域に関する認識書式、加熱制御情報などを記憶する。認識書式記憶部707は、閾値情報と認識書式とを関連付けて記憶する。本実施の形態では、閾値情報は、制御情報領域の縦横比率および寸法である。
The storage unit 706 is configured by a nonvolatile memory such as a flash memory, and stores a recognition format related to the control information area, heating control information, and the like. The recognition format storage unit 707 stores the threshold information and the recognition format in association with each other. In the present embodiment, the threshold information is the aspect ratio and size of the control information area.
認識書式判定部708は、認識書式記憶部707に記憶された情報に基づき、抽出された文字情報に対する認識書式を判定する。制御部704は、認識処理部705により得られた加熱制御情報に従って、加熱部701を制御する。
The recognition format determination unit 708 determines the recognition format for the extracted character information based on the information stored in the recognition format storage unit 707. The control unit 704 controls the heating unit 701 according to the heating control information obtained by the recognition processing unit 705.
図8は、撮影された画像における変形した制御情報領域を示す。図8に示す画像801は、撮像部703により撮影された画像である。画像801内には、弁当である食品802が撮影されている。食品802にはラベル803が貼付される。ラベル803は、長方形の制御情報領域804を含む。
FIG. 8 shows a deformed control information area in a photographed image. An image 801 illustrated in FIG. 8 is an image captured by the imaging unit 703. In the image 801, a food 802 as a lunch box is photographed. A label 803 is attached to the food 802. The label 803 includes a rectangular control information area 804.
この例では、食品802が画像801の左上に位置する。このため、カメラ106の位置および向きにより、撮影された制御情報領域804は台形の形状となる。この場合、画像補正部710が、画像処理における台形補正を用いて台形の形状を長方形形状に補正する。
In this example, the food 802 is located in the upper left of the image 801. Therefore, the captured control information area 804 has a trapezoidal shape depending on the position and orientation of the camera 106. In this case, the image correction unit 710 corrects the trapezoidal shape to a rectangular shape using the trapezoidal correction in the image processing.
図9は、本実施の形態における認識書式テーブル901を示す。認識書式テーブル901は、認識書式記憶部707により記憶される。
FIG. 9 shows a recognition format table 901 in the present embodiment. The recognition format table 901 is stored in the recognition format storage unit 707.
図9に示すように、認識書式テーブル901は、制御情報領域の形状に基づく閾値情報として、縦横比率と、画像内の制御情報領域の寸法(この例では横幅)とを記載する。
As shown in FIG. 9, the recognition format table 901 describes the aspect ratio and the dimensions of the control information area in the image (the width in this example) as threshold information based on the shape of the control information area.
制御情報領域の縦横比率が1.0~1.2の範囲にあり、かつ、画像内の制御情報領域の横幅が20~40ピクセルの範囲にある、識別ID「L1001」の場合、対応する認識書式は「番号書式」である。この場合、例えば図4Bに示すように、制御情報領域402には、「324P」のような番号情報として加熱制御情報が記載される。
In the case of the identification ID “L1001” in which the aspect ratio of the control information area is in the range of 1.0 to 1.2 and the width of the control information area in the image is in the range of 20 to 40 pixels, the corresponding recognition The format is “number format”. In this case, for example, as shown in FIG. 4B, heating control information is described in the control information area 402 as number information such as “324P”.
制御情報領域の縦横比率が4.0~6.0の範囲にあり、かつ、画像内の制御情報領域の横幅が50~90ピクセルの範囲にある、識別ID「L1002」の場合、対応する認識書式は「1行の文字書式」である。この場合、例えば図4Aに示すように、制御情報領域401には、「500W 2分30秒 1500W 0分45秒」のような書式で加熱制御情報が記載される。
In the case of the identification ID “L1002” in which the aspect ratio of the control information area is in the range of 4.0 to 6.0 and the width of the control information area in the image is in the range of 50 to 90 pixels, the corresponding recognition The format is “one-line character format”. In this case, for example, as shown in FIG. 4A, heating control information is described in the control information area 401 in a format such as “500 W 2 minutes 30 seconds 1500 W 0 minutes 45 seconds”.
本実施の形態によれば、認識書式の判別条件に、画像内の制御情報領域の寸法を追加することで、縦横比率だけでは判別しにくい領域の判別処理を省くことができる。その結果、判別処理を高速に行うことが可能となる。
According to the present embodiment, by adding the size of the control information area in the image to the recognition format discrimination condition, it is possible to omit the discrimination process of the area that is difficult to discriminate only by the aspect ratio. As a result, the discrimination process can be performed at high speed.
図10は、加熱調理器700における画像認識処理のフローチャートである。図10に示すように、ステップS1001において、撮像部703は、食品802が載置された加熱庫104内の画像を撮影する。
FIG. 10 is a flowchart of image recognition processing in the heating cooker 700. As shown in FIG. 10, in step S <b> 1001, the imaging unit 703 captures an image in the heating chamber 104 on which the food 802 is placed.
ステップS1002において、認識処理部705は、撮像部703により撮影された画像における食品802のラベル803から制御情報領域を検出する。認識処理部705は、検出された制御情報領域から一つ以上の認識対象を抽出する。
In step S1002, the recognition processing unit 705 detects a control information area from the label 803 of the food 802 in the image photographed by the imaging unit 703. The recognition processing unit 705 extracts one or more recognition targets from the detected control information area.
制御情報領域が変形して撮影されている場合、ステップS1003において、画像補正部710が、変形した制御情報領域を補正する。
If the control information area is deformed and photographed, in step S1003, the image correction unit 710 corrects the deformed control information area.
ステップS1004において、認識処理部705は、抽出された認識対象が規格に準拠した正規の認識対象であるかどうかを判断する。
In step S1004, the recognition processing unit 705 determines whether the extracted recognition target is a regular recognition target that conforms to the standard.
具体的には、認識処理部705は、例えば制御情報領域の面積が所定の大きさ以上であるかに基づいて、抽出された認識対象が正規の認識対象であるかどうかを判断する。認識処理部705は、検出された制御情報領域が所定の色を有するか、または、所定の模様を有するかなどに基づいて、抽出された認識対象が、正規の認識対象であるかどうかを判断してもよい。
Specifically, the recognition processing unit 705 determines whether the extracted recognition target is a regular recognition target based on, for example, whether the area of the control information area is equal to or larger than a predetermined size. The recognition processing unit 705 determines whether the extracted recognition target is a regular recognition target based on whether the detected control information area has a predetermined color or a predetermined pattern. May be.
抽出された認識対象が正規の認識対象(本実施の形態では、例えば制御情報領域401、402)である場合、処理はステップS1005に進む。ステップS1005において、認識処理部705は、制御情報領域の縦幅および横幅を用いて制御情報領域の縦横比率の算出と、画像内の制御情報領域の寸法の取得とを行う。
If the extracted recognition target is a regular recognition target (in this embodiment, for example, the control information areas 401 and 402), the process proceeds to step S1005. In step S1005, the recognition processing unit 705 calculates the aspect ratio of the control information area by using the vertical width and horizontal width of the control information area, and acquires the dimensions of the control information area in the image.
本実施の形態では、検出された制御情報領域の縦横比率と画像における制御情報領域の寸法とが、検出された制御情報領域の特徴情報である。
In the present embodiment, the aspect ratio of the detected control information area and the size of the control information area in the image are the characteristic information of the detected control information area.
ステップS1006において、認識書式記憶部707は、ステップS1005で算出された縦横比率と、認識書式テーブル901に記載された縦横比率閾値とを比較する。また、認識書式記憶部707は、画像における制御情報領域の寸法が所定の範囲内にあるかどうかを判定する。これにより、認識書式判定部708は、抽出された認識対象に対する認識書式を判定する。
In step S1006, the recognition format storage unit 707 compares the aspect ratio calculated in step S1005 with the aspect ratio threshold described in the recognition format table 901. Further, the recognition format storage unit 707 determines whether or not the size of the control information area in the image is within a predetermined range. Accordingly, the recognition format determination unit 708 determines a recognition format for the extracted recognition target.
ステップS1007において、認識処理部705は、認識書式判定部708により判定された認識書式に基づいて認識対象を解析し、加熱制御情報を取得する。
In step S1007, the recognition processing unit 705 analyzes the recognition target based on the recognition format determined by the recognition format determination unit 708, and acquires heating control information.
制御部704は、この加熱制御情報に含まれた加熱量および加熱時間に基づいて、加熱部701を制御する。これにより、加熱調理器700は食品802を加熱する。
The control unit 704 controls the heating unit 701 based on the heating amount and the heating time included in the heating control information. Thereby, the heating cooker 700 heats the food 802.
ステップS1004において、抽出された認識対象が正規の認識対象でないと判断された場合、または、制御情報領域に含まれたすべての認識対象の解析が完了した場合、画像認識処理は終了する。
In step S1004, when it is determined that the extracted recognition target is not a regular recognition target, or when analysis of all the recognition targets included in the control information area is completed, the image recognition process ends.
このように、本実施の形態によれば、様々な書式に対応した加熱制御情報を読み取り、加熱時間などの加熱条件を自動で設定することができる。制御情報領域の縦横比率および寸法に基づいて認識書式を判定するので、加熱制御情報を素早く、精度よく認識することができる。
Thus, according to the present embodiment, it is possible to read heating control information corresponding to various formats and automatically set heating conditions such as heating time. Since the recognition format is determined based on the aspect ratio and dimensions of the control information area, the heating control information can be recognized quickly and accurately.
(その他の実施の形態)
実施の形態1では、認識書式を判別するための制御情報領域の形状に基づく情報として、制御情報領域の縦横比率を用いた。しかしながら、認識書式を判別するための制御情報領域の形状に基づく情報は、制御情報領域の面積、制御情報領域の二辺の太さの比率、または、制御情報領域の角部における曲率半径でもよい。 (Other embodiments)
In the first embodiment, the aspect ratio of the control information area is used as information based on the shape of the control information area for determining the recognition format. However, the information based on the shape of the control information area for determining the recognition format may be the area of the control information area, the ratio of the thicknesses of the two sides of the control information area, or the radius of curvature at the corner of the control information area. .
実施の形態1では、認識書式を判別するための制御情報領域の形状に基づく情報として、制御情報領域の縦横比率を用いた。しかしながら、認識書式を判別するための制御情報領域の形状に基づく情報は、制御情報領域の面積、制御情報領域の二辺の太さの比率、または、制御情報領域の角部における曲率半径でもよい。 (Other embodiments)
In the first embodiment, the aspect ratio of the control information area is used as information based on the shape of the control information area for determining the recognition format. However, the information based on the shape of the control information area for determining the recognition format may be the area of the control information area, the ratio of the thicknesses of the two sides of the control information area, or the radius of curvature at the corner of the control information area. .
すなわち、制御情報領域の形状に基づく情報は、認識処理部205が抽出容易な情報であればよい。
That is, the information based on the shape of the control information area may be information that can be easily extracted by the recognition processing unit 205.
実施の形態1では、加熱調理器100は、筐体111内に、認識処理部205と記憶部206と認識書式判定部208とを備える。しかしながら、認識処理部205、記憶部206、認識書式判定部208の少なくともいずれか一つが、加熱調理器100の筐体111外に配置されてもよい。
In Embodiment 1, the heating cooker 100 includes a recognition processing unit 205, a storage unit 206, and a recognition format determination unit 208 in a casing 111. However, at least one of the recognition processing unit 205, the storage unit 206, and the recognition format determination unit 208 may be disposed outside the casing 111 of the heating cooker 100.
この構成により、加熱調理器を含む加熱調理システムが構成される。例えば、認識処理部205、記憶部206、認識書式判定部208が、加熱調理器100の筐体111外に配置された加熱調理システムでは、制御部204と筐体111外に配置された要素(認識処理部205、記憶部206、認識書式判定部208)との間で、通信により情報が送受信される。
This configuration constitutes a cooking system including a cooking device. For example, in a cooking system in which the recognition processing unit 205, the storage unit 206, and the recognition format determination unit 208 are arranged outside the casing 111 of the heating cooker 100, the control unit 204 and elements arranged outside the casing 111 ( Information is transmitted / received to / from the recognition processing unit 205, the storage unit 206, and the recognition format determination unit 208).
本開示によれば、カメラにより撮影された画像から加熱制御情報を入手することができる。これにより、煩わしい入力作業を必要とせず、様々な食品を簡単に加熱することができる加熱調理器および加熱調理システムを提供することができる。よって、本開示は、電子レンジや誘導加熱調理器などの加熱調理器に適用可能である。
According to the present disclosure, the heating control information can be obtained from an image taken by the camera. Accordingly, it is possible to provide a heating cooker and a heating cooking system that can easily heat various foods without requiring a troublesome input operation. Therefore, this indication is applicable to cooking-by-heating machines, such as a microwave oven and an induction heating cooking appliance.
100、700 加熱調理器
101 ドア
102 表示部
103 選択部
104 加熱庫
105 照明部
106 カメラ
107 食品
111 筐体
201、701 加熱部
202、702 操作部
203、703 撮像部
204、704 制御部
205、705 認識処理部
206、706 記憶部
207、707 認識書式記憶部
208、708 認識書式判定部
209、709 表示部
301、307、802 食品
302、304、305、306、803 ラベル
303、401、402、403、404、405、406、407、408、804 制御情報領域
501、901 認識書式テーブル
710 画像補正部
801 画像 DESCRIPTION OF SYMBOLS 100,700Heating cooker 101 Door 102 Display part 103 Selection part 104 Heating chamber 105 Illumination part 106 Camera 107 Food 111 Case 201,701 Heating part 202,702 Operation part 203,703 Imaging part 204,704 Control part 205,705 Recognition processing unit 206, 706 Storage unit 207, 707 Recognition format storage unit 208, 708 Recognition format determination unit 209, 709 Display unit 301, 307, 802 Food 302, 304, 305, 306, 803 Label 303, 401, 402, 403 , 404, 405, 406, 407, 408, 804 Control information area 501, 901 Recognition format table 710 Image correction unit 801 Image
101 ドア
102 表示部
103 選択部
104 加熱庫
105 照明部
106 カメラ
107 食品
111 筐体
201、701 加熱部
202、702 操作部
203、703 撮像部
204、704 制御部
205、705 認識処理部
206、706 記憶部
207、707 認識書式記憶部
208、708 認識書式判定部
209、709 表示部
301、307、802 食品
302、304、305、306、803 ラベル
303、401、402、403、404、405、406、407、408、804 制御情報領域
501、901 認識書式テーブル
710 画像補正部
801 画像 DESCRIPTION OF SYMBOLS 100,700
Claims (6)
- 被加熱物を収容するように構成された加熱庫と、
前記加熱庫内の前記被加熱物を加熱するように構成された加熱部と、
前記被加熱物の加熱のための加熱制御情報に従って前記加熱部を制御するように構成された制御部と、
前記加熱庫内の画像を撮影するように構成された撮影部と、
前記画像から制御情報領域を検出するとともに、前記制御情報領域に含まれた認識対象を抽出するように構成された認識処理部と、
前記制御情報領域に関連する閾値情報と、前記認識対象を解析するための認識書式とを関連付けて記憶する認識書式記憶部と、
前記制御情報領域から抽出された特徴情報と前記閾値情報とに基づいて、前記認識書式を判定する認識書式判定部と、を備え、
前記認識処理部は、前記認識書式判定部により判定された前記認識書式に基づいて、前記認識対象を解析し前記加熱制御情報を取得するように構成された、加熱調理器。 A heating cabinet configured to accommodate an object to be heated;
A heating unit configured to heat the object to be heated in the heating chamber;
A control unit configured to control the heating unit according to heating control information for heating the object to be heated;
An imaging unit configured to capture an image in the heating chamber;
A recognition processing unit configured to detect a control information area from the image and to extract a recognition target included in the control information area;
A recognition format storage unit that stores threshold information related to the control information area and a recognition format for analyzing the recognition target in association with each other;
A recognition format determination unit that determines the recognition format based on the feature information extracted from the control information region and the threshold information,
The recognition processing unit is a heating cooker configured to analyze the recognition target and acquire the heating control information based on the recognition format determined by the recognition format determination unit. - 前記認識書式記憶部が、前記制御情報領域の形状に基づく情報を前記閾値情報として記憶し、
前記認識書式判定部が、前記画像から抽出された、前記制御情報領域の形状に基づく情報を前記特徴情報として用いて前記認識書式を判定するように構成された、請求項1に記載の加熱調理器。 The recognition format storage unit stores information based on the shape of the control information area as the threshold information,
The cooking according to claim 1, wherein the recognition format determination unit is configured to determine the recognition format using information based on a shape of the control information region extracted from the image as the feature information. vessel. - 前記認識書式判定部が、前記画像から抽出された、長方形形状を有する前記制御情報領域の縦横比率を前記特徴情報として用いて前記認識書式を判定するように構成された、請求項2に記載の加熱調理器。 The said recognition format determination part is comprised so that the said recognition format may be determined using the aspect ratio of the said control information area | region which has a rectangular shape extracted from the said image as said characteristic information. Cooking cooker.
- 前記認識処理部が、前記画像における前記制御情報領域の位置に応じて、前記制御情報領域の形状を補正するように構成された、請求項3に記載の加熱調理器。 The cooking device according to claim 3, wherein the recognition processing unit is configured to correct a shape of the control information area according to a position of the control information area in the image.
- 前記認識書式記憶部が、前記閾値情報として、前記制御情報領域の寸法をさらに記憶し、
前記認識書式判定部が、前記縦横比率と前記寸法とを前記特徴情報として用いて前記認識書式を判定するように構成された、請求項3に記載の加熱調理器。 The recognition format storage unit further stores the size of the control information area as the threshold information,
The cooking device according to claim 3, wherein the recognition format determination unit is configured to determine the recognition format using the aspect ratio and the dimensions as the feature information. - 被加熱物を収容するように構成された加熱庫と、
前記加熱庫内の前記被加熱物を加熱するように構成された加熱部と、
前記被加熱物の加熱のための加熱制御情報に従って前記加熱部を制御するように構成された制御部と、
前記加熱庫内の画像を撮影するように構成された撮影部と、
前記画像から制御情報領域を検出するとともに、前記制御情報領域に含まれた認識対象を抽出するように構成された認識処理部と、
前記制御情報領域に関連する閾値情報と、前記認識対象を解析するための認識書式とを関連付けて記憶する認識書式記憶部と、
前記制御情報領域から抽出された特徴情報と前記閾値情報とに基づいて、前記認識書式を判定する認識書式判定部と、を備え、
前記認識処理部は、前記認識書式判定部により判定された前記認識書式に基づいて、前記認識対象を解析し前記加熱制御情報を取得するように構成され
前記加熱庫と前記加熱部と前記制御部と前記撮影部とは、加熱調理器の筐体内に配置され、
前記認識処理部と前記認識書式記憶部と前記認識書式判定部との少なくともいずれか一つは、前記加熱調理器の前記筐体外に配置された、加熱調理システム。 A heating cabinet configured to accommodate the article to be heated;
A heating unit configured to heat the object to be heated in the heating chamber;
A control unit configured to control the heating unit according to heating control information for heating the object to be heated;
An imaging unit configured to capture an image in the heating chamber;
A recognition processing unit configured to detect a control information area from the image and to extract a recognition target included in the control information area;
A recognition format storage unit that stores threshold information related to the control information area and a recognition format for analyzing the recognition target in association with each other;
A recognition format determination unit that determines the recognition format based on the feature information extracted from the control information region and the threshold information,
The recognition processing unit is configured to analyze the recognition target and acquire the heating control information based on the recognition format determined by the recognition format determination unit. The heating chamber, the heating unit, and the control unit And the photographing unit are arranged in a casing of the heating cooker,
At least one of the recognition processing unit, the recognition format storage unit, and the recognition format determination unit is a heating cooking system arranged outside the casing of the cooking device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020500300A JPWO2019159518A1 (en) | 2018-02-15 | 2018-12-12 | Cooker and cooker system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018-024601 | 2018-02-15 | ||
JP2018024601 | 2018-02-15 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019159518A1 true WO2019159518A1 (en) | 2019-08-22 |
Family
ID=67621006
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2018/045669 WO2019159518A1 (en) | 2018-02-15 | 2018-12-12 | Heating cooker and heating cooking system |
Country Status (2)
Country | Link |
---|---|
JP (1) | JPWO2019159518A1 (en) |
WO (1) | WO2019159518A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2022062665A (en) * | 2020-10-08 | 2022-04-20 | シャープ株式会社 | Cooker |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001324146A (en) * | 2000-05-17 | 2001-11-22 | Matsushita Electric Ind Co Ltd | High-frequency heating apparatus |
JP2005140418A (en) * | 2003-11-06 | 2005-06-02 | Sharp Corp | Cooker |
JP2007017142A (en) * | 2005-07-06 | 2007-01-25 | Samsung Electronics Co Ltd | Cooker, cooking system and cooking control method using bar code |
US20110063468A1 (en) * | 2009-09-11 | 2011-03-17 | Samsung Electronics Co., Ltd. | Method and apparatus for retrieving label |
JP2012185722A (en) * | 2011-03-07 | 2012-09-27 | Ntt Docomo Inc | Character recognition device, character recognition method, character recognition system and character recognition program |
WO2017077695A1 (en) * | 2015-11-05 | 2017-05-11 | パナソニックIpマネジメント株式会社 | Cooking device |
JP2017138703A (en) * | 2016-02-02 | 2017-08-10 | コニカミノルタ株式会社 | Character recognition device and program |
-
2018
- 2018-12-12 WO PCT/JP2018/045669 patent/WO2019159518A1/en active Application Filing
- 2018-12-12 JP JP2020500300A patent/JPWO2019159518A1/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001324146A (en) * | 2000-05-17 | 2001-11-22 | Matsushita Electric Ind Co Ltd | High-frequency heating apparatus |
JP2005140418A (en) * | 2003-11-06 | 2005-06-02 | Sharp Corp | Cooker |
JP2007017142A (en) * | 2005-07-06 | 2007-01-25 | Samsung Electronics Co Ltd | Cooker, cooking system and cooking control method using bar code |
US20110063468A1 (en) * | 2009-09-11 | 2011-03-17 | Samsung Electronics Co., Ltd. | Method and apparatus for retrieving label |
JP2012185722A (en) * | 2011-03-07 | 2012-09-27 | Ntt Docomo Inc | Character recognition device, character recognition method, character recognition system and character recognition program |
WO2017077695A1 (en) * | 2015-11-05 | 2017-05-11 | パナソニックIpマネジメント株式会社 | Cooking device |
JP2017138703A (en) * | 2016-02-02 | 2017-08-10 | コニカミノルタ株式会社 | Character recognition device and program |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2022062665A (en) * | 2020-10-08 | 2022-04-20 | シャープ株式会社 | Cooker |
Also Published As
Publication number | Publication date |
---|---|
JPWO2019159518A1 (en) | 2021-01-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10986703B2 (en) | Heating cooker | |
US10616962B2 (en) | Heating device for cooking | |
JP6906146B2 (en) | Cooker, control method of cooker, and cooker system | |
US20190019049A1 (en) | Character/graphics recognition device, character/graphics recognition method, and character/graphics recognition program | |
JP6906147B2 (en) | How to control a cooker and a cooker | |
JPWO2017077695A1 (en) | Cooker | |
JP7349609B2 (en) | How to control a heating cooker | |
WO2019159518A1 (en) | Heating cooker and heating cooking system | |
WO2018096885A1 (en) | Heating cooker, method of controlling heating cooker, and heating cooking system | |
EP3929489A1 (en) | Heating cooker | |
JP6920591B2 (en) | Cooker | |
JPWO2017164050A1 (en) | Heating cooker, heating cooker control method and heating cooking system | |
JP2020076550A (en) | Cooker | |
CN110832256A (en) | Heating cooker | |
JP7213419B2 (en) | heating cooker | |
JP7345084B2 (en) | heating cooker | |
US20220418055A1 (en) | Heating cooker, control device, and control method | |
CN109844410B (en) | Heating cooker and method for controlling heating cooker |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18906035 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2020500300 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18906035 Country of ref document: EP Kind code of ref document: A1 |