CN111034355A

CN111034355A - Heating cooking system and method for informing installation state of camera for photographing heating cooking device

Info

Publication number: CN111034355A
Application number: CN201980003899.3A
Authority: CN
Inventors: 幸裕弘; 贞平匡史; 藤涛知也; Z·拉菲
Original assignee: Panasonic Intellectual Property Management Co Ltd
Current assignee: Panasonic Intellectual Property Management Co Ltd
Priority date: 2018-04-19
Filing date: 2019-03-29
Publication date: 2020-04-17
Also published as: JP7142320B2; JP2019192355A; WO2019202951A1

Abstract

The heating cooking system comprises: a top panel having marking information; a heating section; a heating control unit that controls the amount of heat applied to the cooking container from the heating unit; a camera disposed at a position apart from the top plate and facing the top plate; a marker information extracting unit that extracts the marker information included in the image captured by the camera; a 1 st determination unit that determines whether or not the extracted marker information is included in a predetermined range of the image; and a notification unit that notifies the installation state of the camera based on the determination result of the 1 st determination unit.

Description

Heating cooking system and method for informing installation state of camera for photographing heating cooking device

Technical Field

The present disclosure relates to a heating cooking system and a method of notifying a setting state of a camera photographing a heating cooker.

Background

Conventionally, there is a heating cooker having a cooking state recognition unit that recognizes a cooking state of an object to be cooked.

For example, in the heating cooker of patent document 1, a temperature sensor is disposed in a range hood. The temperature sensor measures the temperature of the cooking object heated by the heating cooker. The air quantity of the range hood is controlled according to the measured temperature. As described above, patent document 1 describes a technique of recognizing a cooking state using a temperature sensor as a cooking state recognition unit.

Documents of the prior art

Patent document

Patent document 1: japanese patent No. 5887481

Disclosure of Invention

Problems to be solved by the invention

In order to recognize the cooking state of the object to be heated, it is assumed that more detailed cooking information is obtained by providing a camera above the heating cooker. However, the positional displacement of the camera may not allow the object to be heated or the pan in which the object to be heated is stored to be appropriately photographed.

Accordingly, an object of the present disclosure is to solve the above-described problems and to realize appropriate imaging by allowing a user to recognize whether or not there is positional displacement of a camera for imaging a cooking device from above.

Means for solving the problems

In order to achieve the above object, a heating cooking system according to one aspect of the present disclosure includes a top plate, a heating unit, a heating control unit, a camera, a mark information extraction unit, a 1 st determination unit, and a notification unit. The top plate is provided with a container for accommodating an object to be heated and has label information. The heating unit heats the container from below. The heating control unit controls an amount of heat applied to the container from the heating unit. The camera is disposed at a position spaced apart from the top plate and facing the top plate. The marker information extracting unit extracts the marker information included in the image captured by the camera. The 1 st determination unit determines whether or not the extracted marker information is included in a predetermined range of the image. The notification unit notifies the installation state of the camera based on the determination result of the 1 st determination unit.

In addition, a method of notifying an installation state of a camera of a cooking device according to an aspect of the present disclosure is a method of notifying an installation state of a camera of a cooking device, the cooking device including: a top plate on which a container for accommodating an object to be heated is placed and which has mark information; and a heating unit that heats the container from below. In the method, an image captured by the camera is input. Further, the marker information contained in the image is extracted. Further, it is determined whether or not the extracted marker information is included in a predetermined range of the image. Further, an alarm signal for informing the installation state of the camera is output according to the result of the determination.

ADVANTAGEOUS EFFECTS OF INVENTION

The present disclosure enables a user to recognize whether a camera for photographing a cooking device from above is displaced, thereby enabling proper photographing.

Drawings

Fig. 1 is a perspective view of a heating cooking system according to embodiment 1.

Fig. 2 is a plan view of the heating cooker.

Fig. 3 is a block diagram showing a control system of the heating cooking system according to embodiment 1.

Fig. 4 is a side view showing a state of arrangement of the heating cooking system.

Fig. 5 is a diagram showing an example of a captured image by the camera.

Fig. 6 is a diagram showing an example of guidance for position correction of the cooking state recognition unit.

Fig. 7 is a diagram showing an example of a captured image by the camera.

Fig. 8 is a diagram showing an example of guidance of the installation state of the camera.

Fig. 9 is a diagram showing an example of a captured image by the camera.

Fig. 10 is a diagram showing an example of guidance for position correction of the cooking state recognition unit.

Fig. 11 is a diagram showing an example of a captured image by the camera.

Fig. 12 is a diagram showing an example of guidance for position correction of the cooking state recognition unit.

Fig. 13 is a diagram showing an example of a captured image by the camera.

Fig. 14 is a diagram showing an example of guidance for position correction of the cooking state recognition unit.

Fig. 15 is a diagram showing an example of a captured image by the camera.

Fig. 16 is a diagram showing an example of guidance for position correction of the cooking state recognition unit.

Fig. 17 is a diagram showing an example of guidance for position correction of the cooking state recognition unit.

Fig. 18 is a diagram showing an example of a captured image by the camera.

Fig. 19 is a diagram showing an example of a captured image by the camera.

Fig. 20 is a diagram showing an example of guidance for position correction of the cooking state recognition unit.

Fig. 21 is a flowchart showing a correction guidance flow of the camera position.

Fig. 22 is a diagram showing an example of a captured image by the camera.

Fig. 23 is a diagram showing an example of a captured image by the camera.

Fig. 24 is a diagram showing an example of a captured image by the camera.

Fig. 25 is a diagram showing an example of a captured image by the camera.

Fig. 26 is a diagram showing an example of a captured image by the camera.

Fig. 27 is a diagram showing an example of a captured image by the camera.

Fig. 28 is a diagram showing an example of a captured image by the camera.

Fig. 29 is a block diagram showing a control system of a heating cooking system according to embodiment 3.

Fig. 30 is a side view showing a state of arrangement of the heating cooking system.

Fig. 31 is a diagram showing an example of a captured image by the camera.

Fig. 32 is a diagram showing an example of a captured image by the camera.

Fig. 33 is a diagram showing an example of a captured image by the camera.

Fig. 34 is a diagram illustrating the height position of the cooking state recognition unit.

Fig. 35 is a diagram showing an example of a captured image by the camera.

Fig. 36 is a diagram showing an example of a captured image by the camera.

Fig. 37 is a diagram showing an example of a captured image by the camera.

Fig. 38 is a diagram showing an example of a captured image by the camera.

Fig. 39 is a flowchart showing a correction guidance flow of the camera position.

Fig. 40 is a block diagram showing a control system of a heating cooking system according to embodiment 4.

Fig. 41 is a block diagram showing a control system of a heating cooking system according to embodiment 5.

Fig. 42 is a diagram illustrating a schematic configuration of a heating cooking system.

Fig. 43 is a block diagram showing a control system of a heating cooking system according to embodiment 6.

Fig. 44 is a bottom view of the detection unit of the cooking state recognition unit.

Fig. 45 is a diagram illustrating a schematic configuration of a heating cooking system.

Fig. 46 is a diagram showing an example of a mark projected from the adjustment guide projection unit.

Fig. 47 is a diagram showing an example of a mark projected from the adjustment guide projection unit.

Fig. 48 is a diagram showing an example of the display unit.

Fig. 49 is a diagram showing a positional relationship between the main body of the heating cooker and a captured image of the camera.

Fig. 50 is a diagram showing an example of the display unit.

Fig. 51 is a diagram showing an example of the display unit.

Fig. 52 is a diagram illustrating an example of the display unit.

Fig. 53 is a diagram illustrating an example of the display unit.

Fig. 54 is a diagram showing a positional relationship between the main body of the heating cooker and a captured image of the camera.

Fig. 55 is a diagram showing a positional relationship between the main body of the heating cooker and a captured image of the camera.

Fig. 56 is a plan view showing an example of the heating cooker.

Fig. 57 is a diagram showing a positional relationship between the main body of the heating cooker and a captured image of the camera.

Fig. 58 is a diagram showing an example of guidance information displayed on the display unit.

Fig. 59 is a diagram showing a positional relationship between the main body of the heating cooker and a captured image of the camera.

Fig. 60 is a side view showing a state of arrangement of the heating cooking system.

Fig. 61 is a diagram showing a positional relationship between a main body of the heating cooker and a captured image of the camera.

Fig. 62 is a side view showing a state of arrangement of the heating cooking system.

Fig. 63 is a diagram showing a positional relationship between the main body of the heating cooker and a captured image of the camera.

Detailed Description

According to one aspect of the present disclosure, a heating cooking system is provided that includes a top plate, a heating unit, a heating control unit, a camera, a mark information extraction unit, a 1 st determination unit, and a notification unit. The top plate is provided with a container for accommodating an object to be heated and has label information. The heating unit heats the container from below. The heating control unit controls an amount of heat applied to the container from the heating unit. The camera is disposed at a position spaced apart from the top plate and facing the top plate. The marker information extracting unit extracts the marker information included in the image captured by the camera. The 1 st determination unit determines whether or not the extracted marker information is included in a predetermined range of the image. The notification unit notifies the installation state of the camera based on the determination result of the 1 st determination unit.

The notification unit may notify an abnormal installation state of the camera when the 1 st determination unit determines that the extracted marker information is not included in the predetermined range of the image.

The heating cooking system may include a communication unit that wirelessly communicates the abnormal installation state of the camera to an external device having the notification unit. When the 1 st determination unit determines that the extracted flag information is not included in the predetermined range of the image, the communication unit may transmit information of the abnormal installation state of the camera to the external device, and the notification unit of the external device may notify the abnormal installation state of the camera.

The heating cooking system may further include a 2 nd determination unit that determines whether or not the height position of the camera is included in a range of a predetermined height position based on the extracted mark information. When the 2 nd determination unit determines that the height position of the camera is not included in the range of the predetermined height position, the notification unit may notify the abnormal installation state of the camera.

The heating cooking system may include a guidance information output unit that outputs guidance information for adjusting the position of the camera in accordance with the installation state of the camera. When the 1 st determination unit determines that the extracted flag information is not included in the predetermined range of the image, the guidance information output unit may output the guidance information for guiding the change of the installation state of the camera to the notification unit so that the extracted flag information is included in the predetermined range of the image.

The heating cooking system may include a guidance information output unit that outputs guidance information for adjusting the position of the camera in accordance with the installation state of the camera. When the 2 nd determination unit determines that the height position of the camera is not included in the range of the predetermined height position, the guidance information output unit may output the guidance information for guiding the change in the installation state of the camera to the notification unit so that the height position of the camera is included in the range of the predetermined height position.

The heating cooking system may further include a camera position estimating unit that estimates the height position of the camera as setting information about the setting state of the camera based on distortion of the extracted flag information. The guidance information output unit may output the guidance information based on position adjustment data recorded in advance corresponding to the estimated height position.

The heating cooking system may have a storage unit that records the estimated setting information. The determination by the 1 st determining unit may be performed when a difference between the setting information obtained based on the image captured by the camera last time and the setting information obtained based on the image captured thereafter exceeds a predetermined range.

The camera may take an image of the object during cooking. The 1 st determination unit may determine whether or not the installation state of the camera has changed by performing determination during cooking of the object to be heated. When the change in the installation state is detected, the guidance information output unit may output the guidance information, or the heating control unit may stop heating from the heating unit.

The marker information may be lighted or blinked in at least one of a predetermined position, a predetermined color, and a predetermined order.

The guide information output unit may display a predetermined symbol or pattern as the mark information.

The external device may be a portable terminal having at least one of a display unit and a sound output unit, or an integrated control unit having at least one of a display unit and a sound output unit and disposed at home.

The heating cooking system may have an electric drive unit that can electrically adjust the shooting direction of the camera. The electric drive unit may automatically adjust the shooting direction of the camera so that the 1 st determination unit determines that the extracted marker information is included in the predetermined range of the image.

The heating cooking system may include a cooking state recognition unit including the camera and a temperature detection unit disposed at a position away from the top plate and facing the top plate. The camera and the temperature detection unit may be arranged to face in the same direction.

The heating cooking system may include a guide projection unit disposed at a position separated from the top plate and facing the top plate. The top plate may have a target mark indicating a predetermined adjustment target position. The guide projection unit may be configured to project a projection mark indicating a shooting direction of the camera. It is also possible to adjust the shooting direction of the camera by reducing the difference in physical distance between the target mark and the projected mark.

The heating cooking system may include a guide projection unit disposed at a position separated from the top plate and facing the top plate. The top plate may have a target mark indicating a predetermined adjustment target position. The guide projection unit may be configured to project a projection mark indicating the imaging direction of the camera. It is also possible to adjust the shooting direction of the camera by reducing the difference in physical distance between the target mark and the projected mark.

The heating unit may have a heating coil that generates an induction magnetic field to heat the container. The heating control unit may supply a high-frequency current to the heating coil to heat the container.

The mark information on the top board may be 1/100 or more of the recognizable number of pixels of the camera in the image captured by the camera.

The distance from the camera to the top plate may be 600mm or more and 2000mm or less.

Further, according to one aspect of the present disclosure, there is provided a method of notifying an installation state of a camera for photographing a heating cooker, the heating cooker including: a top board on which a container for storing an object to be heated is placed and which has mark information; and a heating unit that heats the container from below. In the method, an image captured by the camera is input. Further, the marker information contained in the image is extracted. Further, it is determined whether or not the extracted marker information is included in a predetermined range of the image. Further, an alarm signal for informing the installation state of the camera is output according to the result of the determination.

(embodiment mode 1)

A heating cooking system according to embodiment 1 of the present disclosure will be described below with reference to fig. 1 to 4. Fig. 1 is a perspective view of a heating cooking system 100 according to embodiment 1 of the present disclosure. Fig. 2 is a plan view of heating cooker 1 according to embodiment 1. Fig. 3 is a block diagram showing a control system of the heating cooking system 100. Fig. 4 is a side view showing an installation state of the heating cooking system, in which the X-axis direction indicates the longitudinal direction of the heating cooking device 1 when viewed from above, the Y-axis direction indicates the front-rear direction, and the Z-axis direction indicates the height direction. The positive direction of the X axis is the right, and the negative direction of the X axis is the left. Further, the positive direction of the Y axis is set as the rear, and the negative direction of the Y axis is set as the front.

As shown in fig. 1, the heating cooking system 100 includes a heating cooker 1 and a cooking state recognition unit 19. The heating cooker 1 includes a main body 3 and a top plate 5 as an upper side portion of the main body 3 on which a container Cr is placed. The container Cr accommodates an object to be heated Tc to be cooked such as stew.

In embodiment 1, the heating cooker 1 is an induction heating cooker, and as shown in fig. 1, heating coils 7A, 7B, and 7C are disposed in the main body 3 below the container placement region of the top plate 5 as heating portions of the heating cooker 1. Ring-shaped

marks

8A, 8B, and 8C indicating container placement areas are printed on the top plate 5 above the

corresponding heating coils

7A, 7B, and 7C, respectively. The heating coils 7A to 7C generate an induction magnetic field to heat the container Cr. The coil control unit 10 supplies high-frequency current to the heating coils 7A to 7C to heat the container Cr. The coil control unit 10 controls the amount of current flowing through the heating coils 7A to 7C.

Further, in a plan view,

light emitting units

6A, 6B, and 6C that emit light annularly are disposed on the top plate 5 outside the heating coils 7A, 7B, and 7C, respectively. The

light emitting units

6A, 6B, and 6C emit light when, for example, a current flows through the

corresponding heating coils

7A, 7B, and 7C. The light emitting units 6A to 6C include, for example, LED light emitting substrates.

As operation units for a user to operate the heating coils 7A to 7C, a plurality of

operation input units

9A, 9B, and 9C are arranged on the front side of the top plate 5 of the heating cooker 1. The operation input units 9A to 9C may be touch keys or touch panels, for example. The operation input unit 9A corresponds to the heating coil 7A, the operation input unit 9B corresponds to the heating coil 7B, and the operation input unit 9C corresponds to the heating coil 7C. The coil control unit 10 controls the start or stop of heating by the heating coil 7A in accordance with the operation instruction received by the operation input unit 9A. The coil control unit 10 adjusts the heating level of the heating coil 7A in 4 stages, for example, in accordance with the operation instruction received by the operation input unit 9A. Similarly, the coil control unit 10 controls heating of the heating coil 7B in accordance with the operation instruction received by the operation input unit 9B. The coil control unit 10 controls heating of the heating coil 7C in accordance with the operation instruction received by the operation input unit 9C.

The main body 3 further includes a notification unit 4, and the notification unit 4 notifies information on heating of the heating coils 7A to 7C. The notification unit 4 includes a display unit 11 and a sound output unit 15. Display unit 11 is disposed on the front side of top plate 5 of heating cooker 1, and displays the heating levels of heating coils 7A to 7C. The display unit 11 has, for example, a band shape extending in the longitudinal direction of the top plate 5. The display unit 11 is a black-and-white liquid crystal panel, but may be a color liquid crystal panel.

Setting unit 13 is provided on the front surface side of main body 3 of heating cooker 1 so that the user can set heating by heating coils 7A to 7C in detail. The setting unit 13 is capable of being put into and taken out from the main body 3, and includes: a setting key 13a for setting heating by the heating coils 7A to 7C in detail; and a setting display unit 13b for displaying the setting contents and the detailed states of the heating coils 7A to 7C. The setting unit 13 sets heating temperatures, heating times, timers, and the like of the heating coils 7A to 7C.

The heating cooker 1 further includes a sound output unit 15 on the front surface side for outputting a sound guide to the user. The sound output unit 15 is, for example, a speaker.

A range hood 17 is disposed above the heating cooker 1. The hood 17 sucks air above the cooking device 1 into the hood 17 through a hood portion 17a provided at a lower portion, and discharges the air from a discharge port communicating with the outside.

The heating cooker 1 further includes a cooking state recognition unit 19 for recognizing a cooking state of the object Tc to be heated on the top plate 5 from above. The cooking state recognition unit 19 is disposed at a position separated from the top plate 5, for example, at the center of a cover portion 17a of the range hood 17.

The cooking state recognition unit 19 has a camera 19 a. The camera 19a is a visible light camera, for example, a CCD (Charge Coupled Device) camera or a CMOS (Complementary metal oxide semiconductor) camera. The camera 19a can take an image of the entire top panel 5 from above by setting an appropriate angle of view and an appropriate imaging direction. The cooking state recognition unit 19 may be disposed on the ceiling or the wall, in addition to the range hood 17. The distance from the cooking state recognition unit 19 to the top plate 5 is 400mm or more, for example, 600mm or more and 2000mm or less. That is, since the camera 19a is exposed on the outer surface of the cooking state recognizing unit 19, the distance from the camera 19a to the top plate 5 is 400mm or more, for example, 600mm or more and 2000mm or less.

The main body 3 has a communication part 21, and the cooking condition recognition part 19 has a communication part 23 for wireless communication between the main body 3 and the cooking condition recognition part 19. The image information captured by the camera 19a is transmitted through the communication unit 23, and received by the main body 3 through the communication unit 21. The

communication units

21 and 23 each have an antenna, and are wirelessly connected by wireless communication such as Wi-Fi (registered trademark), Bluetooth (registered trademark), or BLE (Bluetooth Low Energy). Instead of having the

communication units

21 and 23, the main body 3 and the cooking state recognition unit 19 may be connected by a wire.

The heating cooker 1 includes a control unit 25, a storage unit 27, and a guidance information output unit 29 inside the main body 3. The control Unit 25 and the guidance information output Unit 29 are Processing devices or Processing circuits such as a CPU (Central Processing Unit) or a microprocessor, for example, and are configured to implement various functions by executing programs stored in the storage Unit 27 such as a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, or an SSD (Solid State Drive). At least one of the control unit 25, the storage unit 27, and the guidance information output unit 29 may be disposed not in the main body 3 but in the cooking state recognition unit 19.

The control unit 25 includes a mark extraction unit 25a, a 1 st determination unit 25b, and a deviation estimation unit 25 c. The deviation estimating section 25c corresponds to a camera position estimating section of the present disclosure. The marker extracting unit 25a, the 1 st determining unit 25b, and the deviation estimating unit 25c may be each configured by hardware such as a circuit or a device, or may be configured by software. The marker extracting unit 25a, the 1 st deciding unit 25b and the deviation estimating unit 25c may be independently configured or may be integrally configured. At least one of the marker extracting unit 25a, the 1 st deciding unit 25b and the deviation estimating unit 25c may be integrated with the coil control unit 10.

The marker extracting unit 25a extracts marker information included in the image captured by the camera 19 a. On the top panel 5, in addition to the marks 8A to 8C, a display unit 11 and light emitting units 6A to 6C are displayed as mark information. For example, at least any 1 of these pieces of mark information may be displayed on the top panel 5. Alternatively, other marker information may be displayed. That is, the marker information is not limited to the markers 8A to 8C, the display unit 11, and the light emitting units 6A to 6C, and may be any information that can be recognized as a reference of the shooting direction of the camera.

The marker information of the top panel 5 has a size of 1/100 or more, which is the recognizable number of pixels of the camera 19a, in the image captured by the camera 19 a. This enables appropriate extraction of the marker information.

The 1 st determination unit 25b determines whether or not the extracted marker information is included in a predetermined range of the image of the camera 19a in a predetermined state. The predetermined state indicates a state in which the 1 st determination unit 25b instructs to perform the determination. For example, the predetermined state may be "when the power supply is turned on", or may be "during cooking, and may be" under a predetermined condition ". When the 1 st determining unit 25b determines that the extracted flag information is included in a predetermined range of the image of the camera 19a in a predetermined state, the notification unit 4 notifies that the cooking state recognizing unit 19 is set in the correct direction. That is, the notification unit 4 notifies that the shooting direction of the camera 19a is correct.

When the 1 st determination unit 25b determines that the extracted marker information is not included in the predetermined range of the image of the camera 19a in the predetermined state, the deviation estimation unit 25c estimates the type of deviation from the installation state of the predetermined camera 19a based on the position of the marker information in the image. The normal setting state of the camera 19a is set to a state a. Examples of the types of misalignment include a state b in which there is a misalignment parallel to the left direction, a state c in which there is a misalignment parallel to the right direction, a state d in which there is a misalignment parallel to the rear direction, a state e in which there is a misalignment parallel to the front direction, a state f in which there is a misalignment rotating clockwise, a state g in which there is a misalignment rotating counterclockwise, and a state h in which the set height position is low and the angle of view is narrowed. The deviation estimating unit 25c estimates the state and the amount of deviation of these deviations by image processing.

The guidance information output unit 29 outputs guidance information for adjusting the position of the camera 19a stored in the storage unit 27 to the display unit 11 and the sound output unit 15, in accordance with the type and the amount of deviation of the camera 19a estimated by the deviation estimation unit 25 c.

Next, the installation state of the camera 19a of the cooking state recognition unit 19 will be described with reference to fig. 5. In the following example, the display unit 11 on the top panel 5 is used as the mark information, but instead of the display unit 11, for example, a black band may be displayed on the top panel 5.

Fig. 5 shows a simplified view of the image taken by the camera 19a of the heating cooker 1 from above. The dashed line area of fig. 5 shows the area of the image 19aa of the camera 19 a. The marker extraction unit 25a extracts the display unit 11 as marker information from the image 19 aa. The extraction method of the marker information uses image processing such as template matching or edge detection. As shown in fig. 5, when the extracted marker information is included in a predetermined range in a predetermined state, the display unit 11 displays "set in the correct direction" as shown in fig. 6, for example. The sound output unit 15 also outputs a sound guidance "the correct direction is set". The image 19aa of fig. 5 is stored in the storage unit 27 as a state (state a) in which the extracted marker information is included in a predetermined range in a predetermined state. Image 19aa of fig. 5 is image data of the camera 19a when properly configured.

Fig. 7 shows an image 19aa obtained by simplifying an image obtained by shooting the heating cooker 1 with the camera 19a from above. In fig. 7, since the position or the imaging direction of the camera 19a is deviated to the left, the display unit 11 extracted from the image 19aa is absent on the right side as indicated by a circular broken line 31. Let this state be state b. The 1 st determination unit 25b determines that the extracted marker information is not included in the predetermined range of the image 19aa of the camera 19 a. Since the marker information is missing on the right side of the image 19aa, the deviation estimation unit 25c instructs the guide information output unit 29 to direct the angle of view of the camera 19a further to the right side. As shown in fig. 8, the guidance information output unit 29 displays guidance information of the right arrow on the display unit 11. Further, the audio output unit 15 outputs an audio guidance such as "please move in the right direction". This can guide the user to move the position of the camera 19a to the right or to direct the shooting direction to the right.

Fig. 9 shows a simplified image 19aa of the image obtained by capturing the image of the heating cooker 1 with the camera 19a from above. In fig. 9, since the position or the imaging direction of the camera 19a is shifted to the right, the display unit 11 extracted from the image 19aa is missing on the left side as indicated by the circular broken line 33. Let this state be state c. Therefore, the 1 st determination unit 25b determines that the extracted marker information is not included in the predetermined range of the image 19aa of the camera 19 a. Since the marker information is missing on the left side of the image 19aa, the deviation estimation unit 25c instructs the guide information output unit 29 to direct the angle of view of the camera 19a further to the left side. As shown in fig. 10, the guidance information output unit 29 displays guidance information of the left arrow on the display unit 11. The audio output unit 15 outputs an audio guidance such as "please move in the left direction". This can guide the user to move the position of the camera 19a to the left or to direct the shooting direction to the left.

Fig. 11 shows a simplified image 19aa of the image obtained by capturing the image of the heating cooker 1 with the camera 19a from above. In fig. 11, the position or the shooting direction of the camera 19a is shifted rearward, and therefore the display unit 11 is not extracted from the image 19aa as the marker information. Let this state be state d. Therefore, the 1 st determination unit 25b determines that the marker information is not included in the predetermined range of the image 19aa of the camera 19 a. Since the marker information is not included in the image 19aa, the deviation estimation unit 25c instructs the guide information output unit 29 to direct the angle of view of the camera 19a further forward. As shown in fig. 12, the guidance information output unit 29 displays guidance information of a forward arrow on the display unit 11. Further, the sound output unit 15 outputs a sound guidance such as "please move toward the front". This can guide the user to move the position of the camera 19a forward or to direct the shooting direction forward.

Fig. 13 shows a simplified image 19aa of the image obtained by shooting the heating cooker 1 with the camera 19a from above. In fig. 13, since the position or the imaging direction of the camera 19a is shifted forward, the number of pixels is not less than a predetermined number between the distance PL from the display unit 11 extracted from the image 19aa to the lower end of the image. Let this state be state e. Therefore, the 1 st determination unit 25b determines that the extracted marker information is not included in a predetermined range of the image 19aa of the camera 19a in a predetermined state. Since the marker information is greatly separated from the front end of the image 19aa, the deviation estimation unit 25c instructs the guide information output unit 29 to direct the angle of view of the camera 19a further rearward. As shown in fig. 14, the guide information output unit 29 displays the guide information of the backward arrow on the display unit 11. Further, the sound output unit 15 outputs a sound guidance such as "please move to the back side". This can guide the user to move the position of the camera 19a rearward or to direct the shooting direction rearward.

Fig. 15 shows a simplified image 19aa of the image obtained by capturing the image of the heating cooker 1 with the camera 19a from above. In fig. 15, the left front end portion of the display unit 11 extracted from the image 19aa is missing because the shooting direction of the camera 19a is rotated clockwise. Let this state be state f. Therefore, the 1 st determination unit 25b determines that the extracted marker information is not included in a predetermined range of the image 19aa of the camera 19a in a predetermined state. The deviation estimating unit 25c instructs the guidance information output unit 29 to further rotate the angle of view of the camera 19a counterclockwise from the angle formed by the front edge 19ab of the image 19aa and the straight line portion in the longitudinal direction of the display unit 11. As shown in fig. 16, the guidance information output unit 29 displays guidance information of a counterclockwise arrow on the display unit 11. Further, the voice output unit 15 outputs a voice guidance such as "please move counterclockwise". This can guide the user to rotate the camera 19a counterclockwise. The rotation angle may be displayed by both an image and a number.

In addition, the 1 st determination unit 25b determines that the extracted marker information is not included in the predetermined range of the image 19aa of the camera 19a in a predetermined state even when the imaging direction of the camera 19a is rotationally deviated counterclockwise. Let this state be state g. The deviation estimating unit 25c instructs the guidance information output unit 29 to rotate the angle of view of the camera 19a clockwise from the angle formed by the front edge 19ab of the image 19aa and the straight line portion in the longitudinal direction of the display unit 11. As shown in fig. 17, the guidance information output unit 29 displays guidance information of a clockwise arrow on the display unit 11. Further, the audio output unit 15 outputs an audio guidance such as "please move clockwise". This can guide the user to rotate the camera 19a clockwise. The rotation angle may be displayed by both an image and a number.

Fig. 18 shows a simplified image 19aa of the image obtained by capturing the image of the heating cooker 1 with the camera 19a from above. In fig. 18, since the position where the camera 19a is disposed is not sufficiently far from the top panel 5, that is, the height position of the camera 19a is low, in the image 19aa, both ends of the extracted display part 11 are missing as indicated by the circular broken line 38. Let this state be state h. Therefore, the 1 st determination unit 25b determines that the extracted marker information is not included in a predetermined range of the image 19aa of the camera 19a in a predetermined state.

Since the marker information is missing on both sides of the image 19aa, the deviation estimation unit 25c instructs the guide information output unit 29 to move the installation position of the camera 19a to a higher position. For example, as shown in fig. 20, the guidance information output unit 29 displays guidance information such as "please raise the set height" on the display unit 11. The sound output unit 15 outputs, for example, a sound guidance such as "please raise the installation height". This can guide the user to raise the height of the installation position of the camera 19 a.

Fig. 19 shows a simplified image 19aa of the image obtained by capturing the image of the heating cooker 1 with the camera 19a from above. In fig. 19, the display unit 11 is not extracted from the image 19aa because the camera 19a is not disposed sufficiently far from the top panel 5, that is, the height position of the camera 19a is low. In addition, in the image 19aa, a part of the marker 8C is missing, and the entirety thereof is not included in the image 19 aa. This state is also referred to as a state h. Since the display unit 11 and a part of the marker 8C are not included in the image 19aa in this way, the 1 st determination unit 25b determines that the extracted marker information is not included in the predetermined range of the image 19aa of the camera 19a in a predetermined state.

Since the display unit 11 and a part of the marker 8C are not included in the image 19aa, the deviation estimation unit 25C estimates that the installation position of the camera 19a is low, and instructs the guide information output unit 29 to move to a higher position. As shown in fig. 20, the guidance information output unit 29 displays guidance information such as "please raise the set height" on the display unit 11, thereby guiding the user to raise the height of the set position of the camera 19 a.

In addition, in the case of using a color liquid crystal panel as the display unit 11, the display color may be changed according to the amount of deviation. For example, the guidance display may be performed in a red or warm color system when the deviation amount is large. For example, when the amount of deviation is small, guidance display may be performed in a blue or cold color system.

Next, the flow of guidance for installation of the cooking state recognition unit 19 will be described with reference to fig. 21. Fig. 21 is a flowchart showing a flow of guidance of the camera position. Confirmation of the installation state of the cooking state recognition unit 19 is performed by a construction installation worker when the heating cooker 1 is installed for the first time or by a general user when a trouble of the heating cooker 1 is dealt with.

After the user mounts the cooking state recognition unit 19 to the range hood 17, the user starts the direction adjustment mode of the cooking state recognition unit 19 by inputting from the setting key 13 a. After the direction adjustment mode is started, the control unit 25 sends a shooting instruction to the camera 19a in step S1.

Upon receiving the shooting instruction, the camera 19a shoots an image in step S2. The captured image is sent to the control unit 25.

Next, in step S3, the marker extracting unit 25a extracts marker information from the image transmitted to the control unit 25. The extraction of the marker information is performed using image processing techniques such as template matching or feature point extraction.

Next, in step S4, the 1 st determination unit 25b determines whether or not the extracted marker information is included in a predetermined range of the image in a predetermined state. If the extracted marker information is included in the predetermined range of the image in the predetermined state as in yes at step S4, at step S5, the guidance information output unit 29 instructs the display unit 11 or the audio output unit 15 to normally set guidance.

Thus, the display unit 11 displays the sound guidance "the direction is set to be correct", or the sound output unit 15 performs the sound guidance "the direction is set to be correct". Alternatively, guidance is performed from both the display unit 11 and the sound output unit 15.

If the extracted flag information is not included in the predetermined range of the image in the predetermined state as in no at step S4, the deviation estimating unit 25c estimates the type of deviation of the cooking state identifying unit 19 at step S6. The type of the deviation also includes the direction and amount of the deviation, and based on the estimated type of the deviation, in step S7, the guidance information output unit 29 outputs guidance information for position correction for eliminating the deviation to the display unit 11 or the audio output unit 15.

Thus, the user can confirm the type of deviation by the display unit 11 or the audio output unit 15, and can correct the deviation of the cooking state recognition unit 19, that is, the deviation of the shooting direction of the camera 19 a. After the guidance for the position correction is given from the display unit 11 or the audio output unit 15, the flow of the installation position confirmation is started again from step S1 after a predetermined time elapses or in accordance with an input from the setting key 13 a. The shooting direction of the camera 19a is a direction from the camera 19a toward the center of the visual field range of the camera 19 a.

As described above, the heating cooking system 100 according to embodiment 1 can check whether or not the cooking state recognition unit 19 disposed apart from the top plate 5 is properly installed. In addition, when the installation position is not appropriate, the display unit 11 or the audio output unit 15 guides the direction of the deviation, the amount of the deviation, and the like, and therefore the user can adjust the direction according to the guidance. As a result, the cooking state recognition unit 19 can be provided at an appropriate position, and the state during cooking on the top plate 5 can be recognized appropriately.

The heating cooking system 100 of the present embodiment includes a top plate 5, heating coils 7A to 7C (an example of a heating unit of the present disclosure), a coil control unit 10 (an example of a heating control unit of the present disclosure), a camera 19a, a mark extraction unit 25a, a 1 st determination unit 25b, and a notification unit 4.

The top plate 5 has at least 1 or more mark information (for example, at least one of the display unit 11 and the marks 8A to 8C) on which the container Cr accommodating the object Tc to be heated is placed. The heating coils 7A to 7C heat the container Cr from below. The coil control unit 10 controls the amount of heat applied to the container Cr from the heating coils 7A to 7C. The camera 19a is disposed at a position spaced apart from the top panel 5 and faces the top panel 5. The marker extraction unit 25a extracts marker information included in the image 19aa captured by the camera 19 a. The 1 st determination unit 25b determines whether or not the extracted marker information is included in a predetermined range of the image 19 aa. The notification unit 4 notifies the installation state of the camera 19a based on the determination result of the 1 st determination unit 25 b.

For example, when the 1 st determining unit 25b determines that the extracted marker information is included in the predetermined range of the image 19aa, the notification unit 4 outputs a signal for allowing the user to recognize that the installation state of the camera 19a is normal. Alternatively, when the 1 st determining unit 25b determines that the extracted marker information is not included in the predetermined range of the image 19aa, the notification unit 4 outputs a signal for allowing the user to recognize that the installation state of the camera 19a is abnormal. The predetermined range may be, for example, the entire area of the image 19aa, or may be a part of a predetermined area of the image 19 aa.

This allows the user to recognize whether the camera 19a is displaced. That is, the heating cooking system 100 can prompt the user to correct the positional displacement of the camera 19a, and can realize appropriate imaging.

In the present embodiment, when the 1 st determining unit 25b determines that the extracted marker information is not included in the predetermined range of the image 19aa, the notification unit 4 notifies the abnormal installation state of the camera 19 a.

Thereby, the user can recognize the positional deviation of the camera 19 a. That is, the heating cooking system 100 can prompt the user to correct the positional displacement of the camera 19a, and can realize appropriate imaging.

Further, the means for notifying the abnormal installation state may be the following means: the normal state is always reported in the normal setting state, and the normal state is not reported in the abnormal setting state. Alternatively, the means for reporting the abnormal installation state may be the following means: the alarm signal is not output in the normal setting state, and the alarm signal is output only in the abnormal setting state. Since it is considered that the normal installation state is larger than the abnormal installation state, the power required for notification can be reduced by outputting the notification signal only when the normal installation state is the abnormal installation state. Alternatively, the means for notifying the abnormal installation state may be means for outputting a signal different from a signal output in the normal installation state. Thereby, the user can more reliably recognize whether the camera 19a is in the normal setting state or the abnormal setting state.

The heating cooking system 100 of the present embodiment further includes a guidance information output unit 29, and the guidance information output unit 29 outputs guidance information for adjusting the position of the camera 19a in accordance with the installation state of the camera 19 a. When the 1 st determination unit 25b determines that the extracted marker information is not included in the predetermined range of the image 19aa, the guide information output unit 29 outputs the guide information for guiding the change of the installation state of the camera 19a to the notification unit 4 so that the extracted marker information is included in the predetermined range of the image 19 aa. The guidance information for changing the guidance setting state is information related to guidance output from the display unit 11 and the sound output unit 15.

Accordingly, the heating cooking system 100 can show the user a correction method of the positional displacement of the camera 19a, and can realize appropriate imaging.

In the present embodiment, the heating cooker 1 is an induction heating cooker. That is, the heating unit includes heating coils 7A to 7C that generate an induction magnetic field to heat the container Cr. The coil control unit 10 supplies a high-frequency current to the heating coil to heat the container Cr. That is, the camera 19a, the marker extracting unit 25a, the 1 st determining unit 25b, and the notification unit 4 according to the present embodiment can also be applied to a heating cooker such as a gas range, but are also suitable for an induction heating cooker.

In the present embodiment, the marker information of the top 5 is 1/100 or more of the recognizable number of pixels of the camera in the image 19aa captured by the camera 19 a. Thus, the marker extracting unit 25a can appropriately extract the marker information.

In the present embodiment, the distance from the camera 19a to the top plate 5 is 600mm or more and 2000mm or less. This makes it possible to easily photograph a large area of the top panel 5 using the general-purpose camera 19 a.

In addition, the present embodiment discloses a method of notifying the installation state of the camera 19a of the heating cooker 1. The heating cooker 1 includes a top plate 5 and heating coils 7A to 7C. A container Cr for accommodating the object Tc to be heated is placed on the top plate 5. The top panel 5 has mark information (for example, at least one of the display unit 11 and the marks 8A to 8C). The method comprises the step of inputting an image captured by the camera 19 a. Furthermore, the method comprises a step of extracting the marking information contained in the image. The method also includes a step of determining whether or not the extracted marker information is included in a predetermined range of the image. The method includes a step of outputting an alarm signal for informing a setting state of the camera based on a determination result of the determining step.

This allows the user to recognize whether the camera 19a is displaced. That is, the heating cooker 1 can prompt the user to correct the positional deviation of the camera 19a, and can realize appropriate imaging.

(embodiment mode 2)

Next, a heating cooking system according to embodiment 2 will be described with reference to fig. 22 to 28. While the heating cooking system 100 of embodiment 1 extracts the display unit 11 or the black band as the mark information to determine the shift of the cooking state recognition unit 19, the heating cooking system of embodiment 2 extracts the ring-shaped light emitting units 6A to 6C as the mark information to determine the shift of the cooking state recognition unit 19, that is, the shift of the imaging direction of the camera 19 a. The heating cooking system of embodiment 2 is similar to the heating cooking system 100 of embodiment 1 except for the following matters.

The marker extracting unit 25a according to embodiment 2 extracts the loop of the light emitting units 6A to 6C as marker information. The extraction method can extract the light emitting units 6A to 6C by obtaining the difference between the image before lighting of the light emitting units 6A to 6C and the image after lighting. The light emitting units 6A to 6C are lighted or blinked by the control unit 25 in at least one of a predetermined position, a predetermined color, and a predetermined order.

Fig. 22 shows a simplified image of the cooking device 1 captured by the camera 19a from above. The dotted line area of the rectangle of fig. 22 shows an area of the image 19ac captured by the camera 19 a. The broken line of the triangle 32 is an index for detecting the rotational deviation of the image 19 ac. The mark extraction section 25a extracts the light emitting sections 6A to 6C from the image 19ac as mark information. As shown in fig. 22, the image 19ac is an image when the camera 19a is arranged at the correct position. That is, since the image 19ac in the state a is obtained, the processing is performed in the same manner as in embodiment 1, and the guidance corresponding to the state a is output from the display unit 11 and the sound output unit 15.

Fig. 23 shows a simplified image 19ac of the image obtained by shooting the heating cooker 1 with the camera 19a from above. In fig. 23, the position or shooting direction of the camera 19a is deviated to the left. Therefore, of light-emitting portions 6A to 6C extracted from image 19ac, right-side light-emitting portion 6C disposed on the right side is absent. That is, since the image 19ac in the state b is obtained, the processing is performed in the same manner as in embodiment 1, and the guidance corresponding to the state b is output from the display unit 11 and the sound output unit 15.

Fig. 24 shows a simplified image 19ac of the image obtained by shooting the heating cooker 1 with the camera 19a from above. In fig. 24, the position or shooting direction of the camera 19a is shifted rightward. Therefore, of light-emitting portions 6A to 6C extracted from image 19ac, light-emitting portion 6A disposed on the left side is missing on the left side. That is, since the image 19ac in the state c is obtained, the processing is performed in the same manner as in embodiment 1, and guidance corresponding to the state c is output from the display unit 11 and the sound output unit 15.

Fig. 25 shows a simplified image 19ac of the image obtained by shooting the heating cooker 1 with the camera 19a from above. In fig. 25, the position or shooting direction of the camera 19a is shifted rearward. Therefore, among light-emitting portions 6A to 6C extracted from image 19ac, the front side of light-emitting

portions

6A and 6B arranged on the front side is missing. That is, since the image 19ac in the state d is obtained, the processing is performed in the same manner as in embodiment 1, and guidance corresponding to the state d is output from the display unit 11 and the sound output unit 15.

Fig. 26 shows a simplified image 19ac of the image obtained by shooting the heating cooker 1 with the camera 19a from above. In fig. 26, the position or shooting direction of the camera 19a is shifted forward. Therefore, of light emitting portions 6A to 6C extracted from image 19ac, light emitting portion 6C disposed on the rear side is missing on the rear side. That is, since the image 19ac in the state e is obtained, the processing is performed in the same manner as in embodiment 1, and the guidance corresponding to the state e is output from the display unit 11 and the sound output unit 15.

Fig. 27 shows a simplified image 19ac of the image obtained by shooting the heating cooker 1 with the camera 19a from above. In fig. 27, the shooting direction of the camera 19a is rotationally deviated clockwise. The rotational misalignment can be detected by, for example, a rotational misalignment relative to a predetermined positional relationship of the marker information. For example, in a normal state, positions on the captured image of the camera 19a corresponding to the left end of the light emitting section 6A, the right end of the light emitting section 6B, and the upper end of the light emitting section 6C are stored in advance. An angle formed by the base of a triangle 32 connecting the points and the base of a triangle 34 connecting the points, wherein the triangle 34 is obtained by connecting the points corresponding to the light emitting units 6A to 6C detected from the captured image by template matching or the like, is detected. Thus, the rotation direction and the rotation angle are detected. Since the type of deviation in the image 19ac in fig. 27 is the state f, the deviation estimating unit 25c performs the processing in the same manner as in embodiment 1, and the display unit 11 and the sound output unit 15 output guidance corresponding to the state f. When the camera 19a is rotated counterclockwise, the state g is processed, and guidance corresponding to the state g is output from the display unit 11 and the sound output unit 15.

Fig. 28 shows a simplified image 19ac of the image obtained by shooting the heating cooker 1 with the camera 19a from above. In fig. 28, the position where the camera 19a is installed is not sufficiently separated from the top plate 5, that is, the height position of the camera 19a is low, and therefore, the extracted light emitting portions 6A to 6C are missing in the image 19 ac. Therefore, the 1 st determination unit 25b determines that the extracted marker information is not included in a predetermined range of the image 19ac of the camera 19a in a predetermined state. The deviation estimating unit 25c estimates the deviation of the state h, and instructs the guide information output unit 29 to move the installation position of the camera 19a to a higher position. Thereby, guidance corresponding to the state h is output from the display unit 11 and the sound output unit 15.

According to the heating cooking system of embodiment 2, since the light emitting portions 6A to 6C corresponding to the heating coils 7A to 7C are used as the mark information, the installation position of the camera 19a can be adjusted so as to more appropriately photograph the respective heating coils 7A to 7C. Therefore, the accuracy of the position adjustment of the camera 19a can be improved.

In embodiment 2, the marker information is lighted or blinked in at least 1 of the predetermined position, the predetermined color, and the predetermined order. Thus, the marker extracting unit 25a can easily extract the marker information.

(embodiment mode 3)

Next, a heating cooking system 41 according to embodiment 3 will be described with reference to fig. 29 to 38. In the heating cooking system 100 according to embodiments 1 and 2, the cooking state recognition unit 19 is disposed in the range hood 17 provided above the main body 3. In contrast, in the heating cooking system 41 according to embodiment 3, the cooking state recognition unit 19 is disposed on the wall 37 extending upward behind the main body 3. The heating cooking system 41 according to embodiment 3 is the same as the heating cooking system 100 according to embodiment 1 or 2 except for the following matters.

Fig. 29 is a block diagram showing a control system of a heating cooking system 41 according to embodiment 3. A body 43 of a heating cooker of the heating cooking system 41 according to embodiment 3 includes a 2 nd determination unit 35 in a control unit 45 disposed inside the body. That is, the control unit 45 of embodiment 3 is obtained by adding the 2 nd determination unit 35 to the control unit 25 of embodiment 1.

The 2 nd determination unit 35 determines whether or not the height position of the camera 19a is included in a range of a predetermined height position corresponding to the angle of view of the camera 19a, based on the marker information extracted by the marker extraction unit 25 a. The range included in the predetermined height position may be: the reference height position is set to have a certain predetermined width and is included in the range of the reference. Or may also mean: a reference difference value is set for the reference height position, and the difference between the height position of the camera 19a and the reference height position is equal to or smaller than the reference difference value.

For example, as shown in fig. 30, if the camera 19a of the cooking state recognition unit 19 is provided on the wall 37 at an angle having a viewing angle 39 indicated by a two-dot chain line, it is possible to appropriately photograph the top plate 5 of the heating cooker 1. That is, the tilt of the camera 19a at the angle of view 39 is normal and is included in a predetermined tilt range. In this case, as shown in fig. 31, the light emitting portions 6A to 6C are included in the captured image 19 ad. Instead of light emitting units 6A to 6C, markers 8A to 8C or display unit 11 may be used as marker information. When compared with the image 19ac when set in the hood 17, the image 19ad becomes an image extending in the forward direction.

Referring again to fig. 30, when the camera 19a of the cooking state recognition unit 19 is provided on the wall 37 at an angle having a field angle 44 indicated by a one-dot chain line, for example, it is impossible to appropriately photograph the top plate 5. That is, the tilt of the camera 19a at the angle of view 44 is abnormal and is not included in the predetermined tilt range. In this case, for example, as shown in fig. 32, the captured image 19ad includes more front areas of the top panel 5. Thus, the image 19ad in fig. 32 is an image missing from the rear of the light emitting unit 6C.

Therefore, the state e in which the deviation estimation unit 25c estimates that the deviation has occurred in the forward direction is guided by the guide information output unit 29 so as to correct the orientation of the camera 19a in the backward direction. The deviation estimating unit 25c may estimate the angle of the camera with respect to the top 5 to adjust the angle. Further, since the left side of the display unit 11 is missing, the guidance is performed so as to correct the orientation of the camera 19a in the left direction in a state c in which the deviation estimating unit 25c estimates whether the deviation has occurred in the right direction. The orientation of the camera 19a is corrected by the 2 correction guides, and an image shown in fig. 33 can be obtained. Then, the control section 45 cuts out an image in the effective range 19c within the angle of view of the camera 19 a. Alternatively, the control unit 45 performs zoom adjustment of the camera 19 a.

Next, the relationship between the height position at which the cooking state recognition unit 19 is provided on the wall 37 and the captured image will be described with reference to fig. 34 to 38. In fig. 34 to 38, for convenience of explanation, a trapezoidal captured image is shown as a rectangular captured image. Fig. 34 is a diagram illustrating the height position of the cooking state recognition unit. Fig. 35 shows a simplified image 19ae of an image captured when the cooking state recognition unit 19 is provided at a point k in the center of the range hood 17. Since the image 19ae captured from the point k is captured from directly above the top panel 5, the marks 8A to 8C in the captured image are not distorted. The marks 8A to 8C are perfect circles. The image 19ae in this state is stored in the storage unit 27 as an image in a normal state.

The image 19af taken from the point m located in the wall 37 at a height of, for example, 800mm from the ceiling 5 is shown by the solid line in fig. 36. In fig. 36, marks 8A to 8C in the distortion-free state in fig. 35 are shown by broken line comparison. The markers 8A-8C in the image 19af distort from perfect circles to ellipses. From the degree of the distortion, it is possible to detect at which height of the wall the cooking state recognition unit 19 is mounted.

The image taken from the point n is shown by the solid line of fig. 37, and the point n is located in the wall 37 at a height of, for example, 600mm from the ceiling 5. In fig. 37, marks 8A to 8C in the distortion-free state in fig. 35 are shown in comparison with broken lines. In the 600mm image 19af, the marks 8A to 8C are captured with a larger distortion than in the 800mm image.

The image taken from the point p is shown by the solid line of fig. 38, and the point p is located at a position in the wall 37 at a height of, for example, 400mm from the ceiling 5. In fig. 38, marks 8A to 8C in the distortion-free state in fig. 35 are shown in comparison with broken lines. The 400mm image 19af is captured with the marks 8A to 8C having a larger distortion than the 600 and 800mm images.

When the marks 8A to 8C in the captured image are further distorted than the marks 8A to 8C shown in fig. 38, the height position of the cooking state identification unit 19 is too low, and therefore the 2 nd determination unit 35 determines that detection is impossible. In this case, the deviation estimating unit 25c estimates the state h, and outputs guidance corresponding to the state h from the display unit 11 and the sound output unit 15. This guides the user to raise the height of the cooking state recognition unit 19. In this way, the deviation estimating unit 25c estimates the height of the camera as the position information of the camera based on the distortion of the extracted marker information.

The storage unit 27 stores image data of the state a, which is a normal state of each height of 400, 600, and 800 mm. Therefore, even if the marker information extracted from the captured image is distorted compared to the image captured from directly above, the type of deviation can be estimated. The height of the cooking state identifier 19 may be estimated by detecting the long side and the short side of each ellipse by image processing, and determining the degree of distortion of the ellipse from the ratio between the detected long side and short side. The deviation estimating unit 25c estimates the type of deviation of the captured image from each detected height.

Fig. 39 is a flowchart showing a correction guidance flow of the camera position according to embodiment 3. Steps S1 to S3 are the same as embodiment 1, and therefore, the description thereof is omitted. After extracting the marker information from the captured image in step S3, the 2 nd determination unit 35 determines whether or not the height position of the camera is included in the range of the predetermined height position in step S11. When the 2 nd determining unit 35 determines that the height position of the camera is included in the range of the predetermined height position (yes in step S11), the processing of step S4 and subsequent steps in embodiment 1 is similarly performed.

When the 2 nd determining unit 35 determines that the height position of the camera is not within the predetermined range of the height position (no in step S11), the 2 nd determining unit 35 instructs the guide information output unit 29 to output the guide information for changing the height position of the cooking state recognizing unit 19. The guidance information output unit 29 guides the same guidance as in the state h from the display unit 11 and the sound output unit 15 of the notification unit 4. Then, the process is started again from step S1.

When the cooking state recognition unit 19 is attached to the wall 37, the cooking state recognition unit can be attached to various height positions as compared with the case of being attached to the range hood 17. Therefore, the possibility that the user mistakenly installs the position (i.e., the height position of the camera 19 a) may increase. However, in the heating cooking system 41 according to embodiment 3, even when the cooking state recognition unit 19 is attached to the wall 37, it is possible to guide the user whether or not the height position is appropriate. Further, when the height position is not appropriate, the user can correct the height position of the cooking state recognition unit 19 in accordance with the guidance because the user is notified of the guidance for correcting the height position.

Further, the 1 st determining unit 25b of embodiment 1 is provided, whereby the imaging direction of the camera 19a can be corrected. The 1 st deciding unit 25b may acquire the predetermined range by using the reference image data corresponding to the height position. That is, the predetermined range may be changed according to the height position. This enables the determination at step S4 to be performed with higher accuracy.

Further, the guidance information may be output using the reference image data corresponding to the height position. That is, the guidance information may be changed according to the height position. The guidance information output unit 29 can output guidance information with high accuracy to correct the inclination with higher accuracy.

In the present embodiment, the 2 nd determination unit 35 is provided, and the 2 nd determination unit 35 determines whether or not the height position of the camera 19a is included in the range of the predetermined height position based on the extracted marker information. When the 2 nd determining unit 35 determines that the height position of the camera 19a is not included in the predetermined range of height positions, the notifying unit 4 notifies the abnormal installation state of the camera.

Accordingly, the user can recognize that the height position of the camera 19a is abnormal, and the heating cooker 1 can prompt the user to correct the height position of the camera 19a, thereby realizing appropriate imaging. In particular, when the camera 19a is disposed on the wall 37, it is necessary to adjust the height position of the camera 19a with high accuracy to appropriately set the imaging range, and therefore the present embodiment is useful.

In the present embodiment, when the 2 nd determination unit 35 determines that the height position of the camera 19a is not included in the range of the predetermined height position, the guidance information output unit 29 outputs guidance information for guiding the change in the installation state of the camera 19a to the notification unit 4 so that the height position of the camera 19a is included in the range of the predetermined height position. Accordingly, the heating cooker 1 can guide the user to a method of specifically correcting the height position of the camera 19a, and can realize appropriate imaging.

In the present embodiment, the deviation estimating unit 25c estimates the height position of the camera 19a as the setting information about the setting state of the camera 19a based on the distortion of the extracted marker information. The guidance information output unit 29 outputs guidance information based on the position adjustment data recorded in advance corresponding to the estimated height position. Thus, even if the mark information is distorted, the guide information can be appropriately output. Further, the deviation estimating unit 25c may estimate the tilt of the camera 19a in addition to the estimated height position or may estimate the tilt of the camera 19a instead of the estimated height position, based on the distortion. The guidance information output unit 29 outputs guidance information based on the position adjustment data recorded in advance corresponding to the estimated inclination.

In the present embodiment, the tilt of the camera 19a is determined by the 1 st determining unit 25b, and the height of the camera 19a is determined by the 2 nd determining unit 35. Note that the 2 nd determination unit 35 may perform determination on a part of the tilt of the camera 19 a.

For example, the 1 st determining unit 25b or the 2 nd determining unit 35 may determine whether or not the rotation angle with respect to the optical axis of the camera 19a is included in a predetermined rotation angle range, based on the inclination of the marker information extracted by the marker extracting unit 25 a. The optical axis extends in the same direction as the shooting direction of the camera 19 a.

In this case, the 1 st deciding part 25b or the 2 nd deciding part 35 decides whether or not the rotation angle with respect to the optical axis of the camera is included in the range of the predetermined rotation angle after step S3 and before step S11. If it is determined to be "contained" in this determination step, the flow proceeds to step S11. If it is determined in this determination step that the camera is "not included", guidance information for guiding the adjustment of the rotation angle of the camera 19a is output by the guidance information output unit 29. The user can recognize the guide information via the notification unit 4, and can adjust the rotation angle of the camera 19 a. After the rotation angle of the camera 19a is corrected, the heating cooking system 41 returns to step S1 again.

(embodiment mode 4)

Next, a heating cooking system 51 according to embodiment 4 will be described with reference to fig. 40. The heating cooking system 100 according to embodiment 1 outputs guidance for correcting the position of the cooking state recognition unit 19 from the notification unit 4 disposed in the main body 3. In contrast, the heating cooking system 51 according to embodiment 4 is configured to be able to output guidance for correcting the position of the cooking state recognition unit 19 from the portable terminal 47. The heating cooking system 51 according to embodiment 4 is similar to the heating cooking system 41 according to embodiment 3 except for the following matters.

The communication unit 21 of the main body 43 of the heating and cooking system 51 is wirelessly connected to the communication unit 23 of the cooking state recognition unit 19 via a router device 49 provided as an external device. That is, the cooking state recognition unit 19 and the control unit 45 are connected to the local area network 53 centering on the router device 49 so as to be able to communicate wirelessly. Further, the router apparatus 49 is connected to the internet 55. The router device 49 is connected to the user's mobile terminal 47 so as to be able to communicate wirelessly.

The mobile terminal 47 includes, for example: a display portion 47a having a liquid crystal display; and a sound output section 47b having a speaker. Thus, the mobile terminal 47 can function as a notification unit, and can receive the guidance information output from the guidance information output unit 29 via the communication unit 21 and the router device 49. Therefore, the same information as the guidance information notified from the notification unit 4 can be notified to the user from the display unit 47a and the sound output unit 47b of the portable terminal 47.

Since the portable terminal 47 notifies the voice guidance for the position adjustment of the cooking state recognition unit 19, for example, when a work is performed near the range hood 17, the guidance information that is difficult to see from the display unit 11 of the main body 3 can be seen by hand through the portable terminal 47, and therefore the efficiency of the position adjustment can be improved. The guidance information output from the guidance information output unit 29 may be transmitted to the outside via the internet 55. Instead of the portable terminal 47, the portable terminal may be connected to a general control unit that is disposed at home and can control other electric appliances.

In the present embodiment, the notification unit (for example, the display unit 47a and the sound output unit 47b) of the mobile terminal 47 and the notification unit 4 of the main body are used together, but only the notification unit of the mobile terminal 47 may be used.

As described above, in the present embodiment, the heating cooking system 51 includes the communication unit 21. The communication unit 21 wirelessly communicates the abnormal installation state of the camera 19a to a portable terminal 47 (an example of an external device of the present disclosure) having a display unit 47a and a sound output unit 47b (an example of a notification unit of the present disclosure). When the 1 st determination unit 25b determines that the extracted marker information is not included in the predetermined range of the image, the communication unit 21 transmits information on the abnormal installation state of the camera 19a to the mobile terminal 47. The display unit 47a and the sound output unit 47b notify the abnormal installation state of the camera 19 a. This makes it easier for the user to recognize the installation state of the camera 19a regardless of the position of the user.

In addition, the external device may be a comprehensive control unit disposed at home, instead of the portable terminal 47, or may be a comprehensive control unit disposed at home instead of the portable terminal 47. The integrated control unit has at least one of a display unit and a sound output unit. This enables the user to recognize the installation state of the camera by using the control unit shared by a plurality of home electric appliances.

(embodiment 5)

Next, a heating cooking system 61 of embodiment 5 will be described with reference to fig. 41 and 42. Fig. 41 is a block diagram showing a control system of a heating cooking system 61 according to embodiment 5. Fig. 42 is a diagram illustrating a schematic configuration of the heating cooking system 61. The cooking state recognition unit 19 of the heating cooking system 100 according to embodiment 1 includes the camera 19a, whereas the cooking state recognition unit 63 of the heating cooking system 61 according to embodiment 5 further includes the electric drive unit 67, and the electric drive unit 67 is capable of electrically adjusting the orientations of the temperature sensor 65 for detecting the temperature on the top plate 5 and the cooking state recognition unit 63, that is, the imaging direction of the camera 19 a. The heating cooking system 61 of embodiment 5 is the same as the heating cooking system 51 of embodiment 4 except for the following matters.

The camera 19a and the temperature sensor 65 are fixed to each other such that the temperature sensor 65 faces in the same direction as the camera 19 a. The camera 19a and the temperature sensor 65 constitute a detection unit 69. Therefore, as in embodiment 1, if the position and the imaging direction of the camera 19a are corrected, the position and the detection direction of the detection unit 69 are corrected, and therefore the position and the detection direction of the temperature sensor 65 are also corrected at the same time. The temperature sensor 65 is, for example, an infrared sensor. The temperature sensor 65 can detect the temperature state of the object to be cooked Tc in the container Cr from above. The detection direction of the temperature sensor 65 is a direction from the temperature sensor 65 toward the center of a range in which the temperature sensor 65 can absorb light of a specific wavelength. The specific wavelength of light is a wavelength in the infrared region in the case of an infrared sensor. The range capable of absorbing light of a particular wavelength may be either a point or a surface. The electric drive unit 67 is, for example, a motor, and adjusts the direction of the detection unit 69 according to the amount of rotation of the motor.

The position and detection direction of the detection unit 69 are corrected based on the image captured by the camera 19a having a higher resolution than the temperature sensor 65. This also enables the position and detection direction of the temperature sensor 65 with low resolution to be corrected with high accuracy.

Further, since the electric drive unit 67 is connected to the deviation estimating unit 25c via the

communication units

21 and 23, the direction of the detection unit 69 is automatically adjusted in accordance with the adjustment guidance output by the guidance information output unit 29. Therefore, the electric drive unit 67 can move the camera 19a according to the offset direction and the offset amount estimated by the offset estimation unit 25c, and the adjustment load of the user can be reduced.

In embodiment 5, the cooking state recognition unit 63 is configured to include both the temperature sensor 65 and the electric drive unit 67, but may be configured to include either one.

As described above, the heating cooking system 61 of the present embodiment includes the electric drive unit 67. The electric drive unit 67 can electrically adjust the shooting direction of the camera. The electric drive unit 67 automatically adjusts the shooting direction of the camera so that the 1 st determination unit 25b determines that the extracted marker information is included in a predetermined range of the image. In addition, when the 2 nd determination unit 35 determines that the tilt of the camera 19a is not included in the predetermined tilt range, the electric drive unit 67 may automatically adjust the shooting direction of the camera so as to determine that the tilt is included in the predetermined tilt range. This enables the heating cooking system 61 to more reliably realize appropriate imaging.

The heating cooking system 61 further includes a cooking state recognition unit 63. The cooking state recognition unit 63 includes a camera 19a and a temperature sensor 65 (an example of a temperature detection unit of the present disclosure). The temperature sensor 65 is disposed at a position spaced apart from the top plate 5 and faces the top plate 5. The camera 19a and the temperature sensor 65 are arranged to face the same direction.

In the present embodiment, the camera 19a and the temperature sensor 65 are disposed in the cooking state recognition unit 63 and are disposed so as to face the same direction. Therefore, by adjusting the shooting direction of the camera 19a, the detection direction of the temperature sensor 65 is also adjusted in conjunction therewith. This enables the detection direction of the temperature sensor 65 to be adjusted using the high-resolution image of the camera 19a, and the detection accuracy of the temperature sensor 65 to be improved.

In the present embodiment, the temperature sensor 65 is exemplified as the temperature detection unit, but the temperature detection unit may be a thermal camera.

(embodiment mode 6)

Next, a heating cooking system 71 according to embodiment 6 will be described with reference to fig. 43 to 47. Fig. 43 is a block diagram showing a control system of a heating cooking system 71 according to embodiment 6. Fig. 44 is a bottom view of the detection unit of the cooking state recognition unit. The heating cooking system 1 of embodiment 1 uses the mark or the display unit 11 displayed on the top plate 5 as the mark information. In contrast, the heating cooking system 71 according to embodiment 6 includes an adjustment guide projection unit 75 that faces the detection direction of the detection unit 69 of the cooking state recognition unit 73. The position of the cooking state recognition unit 73 is adjusted by the mark information projected from the adjustment guide projection unit 75 onto the top plate 5. The heating cooking system 71 according to embodiment 6 is similar to the heating cooking system 61 according to embodiment 5 except for the following matters.

The cooking state recognition unit 73 has an adjustment guide projection unit 75 that faces in the same direction as the camera 19a and the temperature sensor 19 b. Fig. 45 is a diagram illustrating a schematic configuration of a heating cooking system. The adjustment guide projection unit 75 projects a mark for position adjustment from above the top plate 5.

Fig. 46 is a diagram showing an example of the marker projected from the adjustment guide projection unit 75. The circular mark 77 is a projection mark projected from the adjustment guide projection unit 75 to the top plate 5. The projection mark indicates the shooting direction of the camera 19 a. In addition, a rectangular target mark 79 showing an area where the circular mark 77 should be located is printed on the top panel 5. That is, the rectangular target mark 79 indicates the adjustment target position of the circular mark 77.

Accordingly, the user can adjust the position and direction of the cooking state recognition part 73 so that the projected circular mark 77 is located at the position of the target mark 79. By reducing the difference in physical distance between the target mark 79 and the projected mark, the shooting direction of the camera 19a can be adjusted. The camera 19a may capture an image of the state in which the mark 77 is projected on the top plate 5, detect a difference between the target mark 79 and the mark 77 by performing image processing on the captured image, and automatically adjust the direction of the camera 19a by the electric driving unit 67. The target mark 79 is not limited to a rectangular mark, and may be a cross-shaped or triangular mark.

Fig. 47 is a diagram showing an example of the marker projected from the adjustment guide projection unit 75. In this example, the adjustment guide projection unit 75 projects the current imaging area 81 of the camera 19a on the top panel 5. Therefore, the user can adjust the position and direction of the cooking state recognition unit 73 so that the projected imaging region 81 includes the light emitting units 6A to 6C or the marks 8A to 8C and is located at an appropriate position. Further, the camera 19a may capture an image of the state in which the imaging region 81 is projected on the top plate 5, detect a difference between the imaging region 81 and the ideal region 83 by performing image processing on the captured image, and automatically adjust the direction of the camera 19a by the electric driving unit 67.

According to the heating cooking system 71 of embodiment 6, since the recognition area of the cooking state recognition unit 73 is directly displayed on the top plate 5, the user can intuitively understand the positional deviation of the cooking state recognition unit 73. Therefore, the time for position adjustment can be shortened.

As described above, the heating cooking system 71 according to the present embodiment includes the adjustment guide projection unit 75 (an example of the guide projection unit of the present disclosure), and the adjustment guide projection unit 75 is disposed at a position away from the top plate 5 and faces the top plate 5. The top plate 5 has a target mark (for example, a target mark 79, light emitting portions 6A to 6C, or marks 8A to 8C) indicating a predetermined adjustment target position. The adjustment guide projection unit 75 can project a projection mark (for example, the projection mark 77 or the imaging area 81) indicating the imaging direction of the camera 19 a. By reducing the difference in physical distance between the target mark and the projected mark, the shooting direction of the camera 19a can be adjusted. This enables the user to visually recognize the installation state of the camera 19 a.

The present disclosure is not limited to the above-described embodiments, and can be implemented as modifications as follows.

(1) In the above embodiment, the display unit 11 is configured using a liquid crystal display having a normal resolution, but is not limited thereto. For example, as shown in fig. 48, a dot-matrix liquid crystal display 11a may be provided in a part of the display unit 11.

When the display unit 11 includes the dot matrix liquid crystal display 11a, for example, when the captured image 19ag is in the off state shown in fig. 49, a dot matrix image shown in fig. 50 or 52 is displayed on the dot matrix liquid crystal display 11 a. That is, by causing the light emitting portions 6A to 6C or the marks 8A to 8C included in the region of the captured image 19ag to emit light by dot matrix, the user can be presented with the deviated state of the captured region in a more understandable manner. When the cooking state recognition unit 73 is disposed in an appropriate position and in an appropriate direction, the user can know that the cooking state recognition unit 73 is disposed appropriately by emitting light to all the dots of the dot matrix region indicating each heating region as shown in fig. 51 or 53.

Note that the notification may be performed in association with a positional deviation of the current state. For example, as shown in fig. 54, in the case where a right deviation occurs in the captured image 19ah, the deviation amount is displayed in a relative amount in the dot matrix liquid crystal display 11 a. The bar 85 indicates the amount of deviation, and the bar 85 becomes shorter as the cooking state recognition unit 19 is moved leftward. When the cooking state recognizing portion 19 is oriented in an appropriate direction, the display of the bar 85 is turned off.

Further, for example, as shown in fig. 55, in the case where rotational deviation occurs in the captured image 19ak, the deviation amount is expressed in a relative amount in the dot matrix liquid crystal display 11 a. The triangular guide information 87 indicates the amount of deviation, and the inclination of the triangle of the guide information 87 decreases as the cooking state recognition unit 19 rotates counterclockwise. When the cooking state recognizing section 19 is positioned at an appropriate angle, the guide information 87 is turned off.

As shown in fig. 56, the display unit 11 may have a high-resolution liquid crystal display 11 b. In this case, the imaging area of the camera 19a may be displayed in combination with the actual state. For example, in fig. 57, the photographed image 19am is deviated backward, and as shown in fig. 58, the high-resolution liquid crystal display 11b displays: a schematic diagram 89 showing the state of the state d; a bar 91 relatively showing the amount of deviation; and an arrow 93 showing the direction of the correction deviation direction.

Further, as shown in fig. 59, when the clockwise rotational misalignment occurs in the captured image 19an, the high-resolution liquid crystal display 11b displays: a triangle 95 showing the state f and the amount of deviation; and an arrow 97 for performing correction guidance in such a manner as to rotate counterclockwise.

In this way, by displaying the live image reflecting the deviation amount on the display unit 11, the cooking state recognition unit 19 can correct the cooking state more easily.

(2) In the above embodiment, when the cooking state recognition unit 19 is disposed in the range hood 17, it is disposed in the center of the cover portion 17a of the range hood 17, but the present invention is not limited thereto. Alternatively, for example, as shown in fig. 60, the cover portion may be disposed in front of the cover portion 17 a. When the image 19ap is arranged at the front portion of the cover portion 17a, the photographed image is a trapezoid whose front side is a long side as shown in fig. 61, and an image of an optimum position of such a trapezoid is stored in the storage unit 27 in advance. This enables the positional deviation to be guided as in embodiment 1.

As shown in fig. 62, the cooking state recognition unit 19 may be disposed at the rear of the cover portion 17 a. When the image 19aq is arranged at the rear of the cover portion 17a, the image is a trapezoid whose rear side is the long side as shown in fig. 63, and an image of the optimum position of such a trapezoid is stored in the storage unit 27 in advance. This enables the positional deviation to be guided as in embodiment 1. The cooking state recognition unit 19 may be disposed in the range hood 17 without the hood portion 17 a.

(3) In the above embodiment, the mark is extracted and the 1 st determination unit determines whether or not the mark information is included in a predetermined range of the image in a predetermined state, but the following processing may be performed after the camera position is corrected by this processing once. For example, the following processing is performed when the power of the heating cooker 1 is turned on and when the battery of the heating cooker 1 is replaced. The setting information of the camera 19a estimated by the deviation estimating unit 25c is stored in the storage unit 27. The setting information is information on at least any one of the horizontal position, the vertical position, and the shooting direction (including the inclination) of the camera 19 a. The determination by the 1 st determining unit may be performed when the difference between the setting information obtained based on the image captured by the camera 19a last time and the position information obtained by pattern matching between the images at various positions stored in advance in the storage unit 27 based on the image captured next time by the control unit 25 exceeds a predetermined range.

(4) In the above embodiment, the confirmation of the position of the cooking state recognition unit 19 is performed when cooking is not performed, but is not limited thereto. For example, during cooking, the flag information is extracted from the image captured by the camera 19a of the cooking state recognition unit 19, and the determination by the 1 st determination unit 25b is performed to check whether or not the installation state of the camera 19a has changed. The change in the setting state is a change in at least any one of the horizontal position, the vertical position, and the shooting direction (including the inclination) of the camera 19 a. When a change in the installation state is detected, the guidance information output unit 29 outputs guidance information to the notification unit 4. The guidance information is reported to the user from the reporting unit 4. When a change in the installation state is detected, the deviation estimating unit 25C may instruct the coil control unit 10 to stop heating of the heating coils 7A to 7C. Thereby, the coil control unit 10 stops the heating by the heating coils 7A to 7C.

(5) In the above embodiment, the mark is printed on the top plate 5, but is not limited thereto. For example, the guidance information output unit 29 may use a predetermined symbol or pattern displayed on the display unit 11 as the mark information.

(6) In the above embodiment, the heating cooker 1 is an induction heating cooker that inductively heats the container Cr using the heating coils 7A to 7C, but is not limited thereto. For example, the heating cooker 1 may be a gas cooker. In the case of a gas cooker, the vessel Cr is placed on a pot holder as a vessel placing portion provided on the top plate 5 of the main body 3, and is heated from below by a gas burner as a heating portion.

(7) In the above embodiment, the heating cooker 1 includes the mark extracting unit 25a, the 1 st determining unit 25b, the deviation estimating unit 25c, and the 2 nd determining unit 35, but at least one of these may be provided in an external device such as a portable terminal. In this case, the heating cooking system includes an external device.

In addition, by appropriately combining any of the various embodiments and modifications described above, the effects each has can be obtained.

The present disclosure has been fully described in connection with the preferred embodiments with reference to the accompanying drawings, but it is needless to say that various modifications and corrections can be made by those skilled in the art. Such variations and modifications are to be understood as being included in the appended claims, unless they depart from the scope of the disclosure as set forth in the following claims. Further, combinations of elements and changes in the order of the elements in the embodiments can be implemented without departing from the scope and spirit of the present disclosure.

Description of the reference symbols

1: a heating cooker; 3. 43: a main body; 4: a notification unit; 5: a top plate; 5 b: the front side; 6A, 6B, 6C: a light emitting section; 7A, 7B, 7C: a heating coil; 8A, 8B, 8C: marking; 9A, 9B, 9C: an operation input unit; 10: a coil control unit; 11: a display unit; 11 a: a dot matrix liquid crystal display; 11 b: a high resolution liquid crystal display; 13: a setting unit; 13 a: a setting key; 13 b: a setting display unit; 15: a sound output unit; 17: a range hood; 17 a: a cover portion; 19. 63, 73: a cooking state recognition unit; 19 a: a camera; 19 aa: an image; 19 ab: the front side; 19 ac: an image; 19 ad: an image; 19 ae: an image; 19 af: an image; 19 ag: an image; 19 ah: an image; 19 ak: an image; 19am, and the ratio of: an image; 19 an: an image; 19 ap: an image; 19 aq: an image; 19 b: a temperature sensor; 19 c: an effective range; 21: a communication unit; 23: a communication unit; 25. 45, and (2) 45: a control unit; 25 a: a marker extraction unit; 25 b: a 1 st judgment unit; 25 c: a deviation estimation unit; 27: a storage unit; 29: a guidance information output unit; 31. 33, 35, 38: a circular dashed line; 32: a triangle shape; 34: a triangle shape; 35: a 2 nd judgment unit; 37: a wall; 38: a circular dashed line; 39: the angle of view; 41. 51, 61, 71, 100: a heating cooking system; 44: the angle of view; 47: a portable terminal; 47 a: a display unit; 47 b: a sound output unit; 49: a router; 53: a local area network; 55: an internet; 65: a temperature sensor; 67: an electric drive section; 69: a detection unit; 75: an adjustment guide projection unit; 77: a circular mark; 79: marking; 81: a shooting area; 83: an ideal region; 85: (ii) a strip; 87: a guidance message; 89: a schematic diagram; 91: (ii) a strip; 93: an arrow; 95: a triangle shape; 97: an arrow; cr: a container; tc: an object to be heated.

Claims

1. A heat cooking system, the heat cooking system having:

a top plate on which a container for accommodating an object to be heated is placed and which has mark information;

a heating unit that heats the container from below;

a heating control unit that controls an amount of heat applied to the container from the heating unit;

a camera disposed at a position apart from the top plate and facing the top plate;

a marker information extracting unit that extracts the marker information included in the image captured by the camera;

a 1 st determination unit that determines whether or not the extracted marker information is included in a predetermined range of the image; and

and a notification unit that notifies the installation state of the camera based on the determination result of the 1 st determination unit.

2. The heat cooking system according to claim 1,

the notification unit notifies an abnormal installation state of the camera when the 1 st determination unit determines that the extracted marker information is not included in the predetermined range of the image.

3. The heat cooking system according to claim 2,

the heating cooking system has a communication section that wirelessly communicates the abnormal installation state of the camera to an external device having the notification section,

the communication unit transmits information of the abnormal installation state of the camera to the external device when the 1 st determination unit determines that the extracted flag information is not included in the predetermined range of the image,

the notification portion of the external device notifies the abnormal setting state of the camera.

4. The heating cooking system according to claim 2 or 3,

the heating cooking system includes a 2 nd determination unit that determines whether or not the height position of the camera is included in a range of a predetermined height position based on the extracted mark information,

when the 2 nd determination unit determines that the height position of the camera is not included in the range of the predetermined height position, the notification unit notifies the abnormal installation state of the camera.

5. The heat cooking system according to any one of claims 2 to 4,

the heating cooking system has a guidance information output unit that outputs guidance information for adjusting the position of the camera in accordance with the installation state of the camera,

the guidance information output unit outputs the guidance information for guiding the change of the installation state of the camera to the notification unit so that the extracted flag information is included in the predetermined range of the image, when the 1 st determination unit determines that the extracted flag information is not included in the predetermined range of the image.

6. The heat cooking system according to claim 4,

the guide information output unit outputs the guide information for guiding the change of the installation state of the camera to the notification unit so that the height position of the camera is included in the range of the predetermined height position, when the 2 nd determination unit determines that the height position of the camera is not included in the range of the predetermined height position.

7. The heat cooking system according to claim 6,

the heating cooking system has a camera position estimating section that estimates the height position of the camera as setting information about the setting state of the camera based on distortion of the extracted mark information,

the guidance information output unit outputs the guidance information based on pre-recorded position adjustment data corresponding to the estimated height position.

8. The heat cooking system according to claim 7,

the heating cooking system has a storage unit that records the estimated setting information,

the determination by the 1 st determining unit is performed when a difference between the setting information obtained based on the image captured by the camera last time and setting information obtained based on an image captured thereafter exceeds a predetermined range.

9. The heat cooking system according to any one of claims 5 to 8,

the camera also takes pictures during the cooking of the object to be heated,

the 1 st determination unit determines whether or not the installation state of the camera has changed by performing determination also during cooking of the object to be heated,

when the change in the installation state is detected, the guidance information output unit outputs the guidance information, or the heating control unit stops heating from the heating unit.

10. The heat cooking system according to any one of claims 5 to 9,

the marker information is lighted or blinked in at least one of a predetermined position, a predetermined color, and a predetermined order.

11. The heat cooking system according to any one of claims 5 to 10,

the guide information output unit displays a predetermined symbol or pattern as the mark information.

12. The heat cooking system according to claim 3,

the external device is a portable terminal having at least one of a display unit and a sound output unit, or an integrated control unit having at least one of a display unit and a sound output unit and disposed at home.

13. The heat cooking system according to any one of claims 1 to 12,

the heating cooking system has an electric drive section capable of electrically adjusting a photographing direction of the camera,

the electric drive unit automatically adjusts the shooting direction of the camera so that the 1 st determination unit determines that the extracted marker information is included in the predetermined range of the image.

14. The heat cooking system according to any one of claims 1 to 13,

the heating cooking system includes a cooking state recognition unit including the camera and a temperature detection unit disposed at a position apart from the top plate and facing the top plate,

the camera and the temperature detection portion are arranged to face in the same direction.

15. The heat cooking system according to any one of claims 1 to 12,

the heating cooking system has a guide projection unit disposed at a position separated from the top plate and facing the top plate,

the top plate has a target mark indicating a prescribed adjustment target position,

the guide projection unit can project a projection mark indicating a shooting direction of the camera,

the photographing direction of the camera can be adjusted by reducing a difference in physical distance between the target mark and the projected mark.

16. The heat cooking system according to claim 13,

the guide projection unit can project a projection mark indicating the shooting direction of the camera,

17. The heat cooking system according to any one of claims 1 to 16,

the heating part has a heating coil that generates an induction magnetic field to heat the container,

the heating control unit supplies a high-frequency current to the heating coil to heat the container.

18. The heat cooking system according to any one of claims 1 to 17,

the marker information on the top board has a size of 1/100 or more, which is the recognizable number of pixels of the camera, in the image captured by the camera.

19. The heat cooking system according to any one of claims 1 to 18,

the distance from the camera to the top plate is 600mm or more and 2000mm or less.

20. A method for informing the installation state of a camera for photographing a heating cooker,

the heating cooker comprises:

a top plate on which a container for accommodating an object to be heated is placed and which has mark information; and

a heating unit that heats the container from below,

in the method:

an image captured by the camera is input,

extracting the marker information included in the image,

determining whether the extracted marker information is included in a predetermined range of the image,

based on the result of the determination, an alarm signal for informing the installation state of the camera is output.