WO2019202951A1 - Heating cooking system, and method for notifying installation state of camera for capturing image of heating cooker. - Google Patents

Heating cooking system, and method for notifying installation state of camera for capturing image of heating cooker. Download PDF

Info

Publication number
WO2019202951A1
WO2019202951A1 PCT/JP2019/014064 JP2019014064W WO2019202951A1 WO 2019202951 A1 WO2019202951 A1 WO 2019202951A1 JP 2019014064 W JP2019014064 W JP 2019014064W WO 2019202951 A1 WO2019202951 A1 WO 2019202951A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
unit
image
information
heating
Prior art date
Application number
PCT/JP2019/014064
Other languages
French (fr)
Japanese (ja)
Inventor
幸 裕弘
貞平 匡史
藤濤 知也
ザリナ ラフィー
Original Assignee
パナソニックIpマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックIpマネジメント株式会社 filed Critical パナソニックIpマネジメント株式会社
Priority to CN201980003899.3A priority Critical patent/CN111034355A/en
Publication of WO2019202951A1 publication Critical patent/WO2019202951A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H05ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05BELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
    • H05B6/00Heating by electric, magnetic or electromagnetic fields
    • H05B6/02Induction heating
    • H05B6/10Induction heating apparatus, other than furnaces, for specific applications
    • H05B6/12Cooking devices

Definitions

  • the present disclosure relates to a heating cooking system and a method for notifying an installation state of a camera that photographs a cooking device.
  • a cooking device equipped with a cooking status recognition unit that recognizes the cooking status of a heated object to be cooked.
  • a temperature sensor is arranged in the range hood.
  • the temperature sensor measures the temperature of the food to be heated by the cooking device.
  • the air volume of the range hood is controlled according to the measured temperature.
  • Patent Literature 1 describes that the cooking status recognition unit recognizes the cooking status using the temperature sensor.
  • an object of the present disclosure is to solve the above-described problem, and to realize appropriate photographing by making the user recognize the presence / absence of a positional deviation of a camera that photographs the cooking device from above.
  • a cooking system includes a top plate, a heating unit, a heating control unit, a camera, a marker information extraction unit, a first determination unit, and a notification unit. And comprising.
  • a container for storing an object to be heated is placed and has marker information.
  • the heating unit heats the container from below.
  • the heating control unit controls a heating amount from the heating unit to the container.
  • the camera is disposed at a position away from the top plate and is directed toward the top plate.
  • the marker information extraction unit extracts the marker information included in an image photographed by the camera.
  • the first determination unit determines whether or not the extracted marker information is included in a prescribed range of the image.
  • the notification unit notifies the installation state of the camera based on a determination result by the first determination unit.
  • a method for notifying the installation state of a camera in a heating cooker includes: a top plate on which a container that accommodates an object to be heated is placed; marker plate information; And a heating unit that performs a notification of an installation state of a camera that photographs a heating cooker.
  • an image taken by the camera is input.
  • the marker information included in the image is extracted. Further, it is determined whether or not the extracted marker information is included in a prescribed range of the image. Further, based on the determination result, a notification signal for notifying the installation state of the camera is output.
  • the present disclosure can realize appropriate shooting by making the user recognize the presence or absence of a positional shift of the camera that shoots the cooking device from above.
  • FIG. Top view of cooking device The block diagram which shows the control system of the heat cooking system which concerns on Embodiment 1.
  • FIG. Side view showing the installed state of the cooking system The figure which shows an example of the picked-up image of a camera
  • the figure which shows an example of the guidance of the position correction of a cooking condition recognition part The figure which shows an example of the picked-up image of a camera
  • the figure which shows an example of the guidance of the installation state of a camera The figure which shows an example of the picked-up image of a camera
  • the figure which shows an example of the guidance of the position correction of a cooking condition recognition part The figure which shows an example of the picked-up image of a camera
  • the figure which shows an example of the guidance of the position correction of a cooking condition recognition part The figure which shows an example of the picked-up image of a camera
  • the figure which shows an example of the guidance of the position correction of a cooking condition recognition part The figure which shows an example of the picked-up image of a camera
  • FIG. Side view showing the installed state of the cooking system The figure which shows an example of the picked-up image of a camera
  • the figure which shows an example of the picked-up image of a camera The figure which shows an example of the picked-up image of a camera
  • the figure explaining the height position of a cooking condition recognition part The figure which shows an example of the picked-up image of a camera
  • the figure which shows an example of the picked-up image of a camera The figure which shows an example of the picked-up image of a camera
  • Flow chart showing the flow of camera position correction guidance The block diagram which shows the control system of the heat cooking system which concerns on Embodiment 4.
  • Block diagram showing a control system of a cooking system according to Embodiment 5 The figure explaining schematic structure of a heating cooking system
  • a block diagram showing a control system of a cooking system according to a sixth embodiment Bottom view of the detection unit of the cooking status recognition unit
  • the figure explaining schematic structure of a heating cooking system The figure which shows an example of the marker projected from the adjustment guide projection part
  • the figure which shows an example of the marker projected from the adjustment guide projection part The figure which shows an example of a display part
  • the figure which shows an example of a display part The figure which shows an example of a display part
  • the figure which shows an example of a display part The figure which shows an example of a display part
  • the figure which shows an example of a display part The figure which shows the positional relationship of the main body of a heating cooker, and the picked-up image of a camera
  • a cooking system including a top plate, a heating unit, a heating control unit, a camera, a marker information extraction unit, a first determination unit, and a notification unit.
  • the On the top plate a container for storing an object to be heated is placed and has marker information.
  • the heating unit heats the container from below.
  • the heating control unit controls a heating amount from the heating unit to the container.
  • the camera is disposed at a position away from the top plate and is directed toward the top plate.
  • the marker information extraction unit extracts the marker information included in an image photographed by the camera.
  • the first determination unit determines whether or not the extracted marker information is included in a prescribed range of the image.
  • the notification unit notifies the installation state of the camera based on a determination result by the first determination unit.
  • the notification unit may notify the abnormal installation state of the camera. Good.
  • the heating cooking system may include a communication unit that wirelessly communicates the abnormal installation state of the camera to an external device having the notification unit.
  • the communication unit displays information on the abnormal installation state of the camera.
  • the information may be transmitted to an external device, and the notification unit of the external device may notify the abnormal installation state of the camera.
  • the cooking system may include a second determination unit that determines whether or not the height position of the camera is included in a range of a specified height position based on the extracted marker information.
  • the notification unit may notify the abnormal installation state of the camera. Good.
  • the cooking system may include a guide information output unit that outputs guide information for adjusting the position of the camera in accordance with the installation state of the camera.
  • the guidance information output unit stores the extracted marker information in the image
  • the guidance information for guiding the change of the installation state of the camera may be output to the notification unit so as to be included in the prescribed range.
  • the cooking system may include a guide information output unit that outputs guide information for adjusting the position of the camera in accordance with the installation state of the camera.
  • the guidance information output unit determines the height position of the camera. You may output the said guidance information which guides the change of the said installation state of the said camera to the said alerting
  • the heating cooking system may include a camera position estimating unit that estimates the height position of the camera as installation information related to the installation state of the camera based on distortion of the extracted marker information.
  • the guide information output unit may output the guide information according to position adjustment data recorded in advance corresponding to the estimated height position.
  • the heating cooking system may include a storage unit that records the estimated installation information.
  • the first determination unit The determination by may be performed.
  • the camera may take a picture during cooking of the object to be heated.
  • the first determination unit may detect whether or not the installation state of the camera has changed by making a determination even during cooking of the object to be heated.
  • the guide information output unit may output the guide information, or the heating control unit may stop heating from the heating unit.
  • the marker information may be turned on or blinked in at least one of a specified position, a specified color, and a specified order.
  • the guidance information output unit may display a specified symbol or pattern as the marker information.
  • the external device may be a mobile terminal or an integrated control unit disposed in a house having at least one of a display unit and an audio output unit.
  • the heating cooking system may include an electric drive unit that can electrically adjust the shooting direction of the camera.
  • the electric drive unit may automatically adjust the shooting direction of the camera so that the first determination unit determines that the extracted marker information is included in the prescribed range of the image. Good.
  • the cooking system may include the camera and a cooking status recognition unit that is disposed at a position away from the top plate and includes a temperature detection unit directed to the top plate.
  • the camera and the temperature detection unit may be arranged in the same direction.
  • the heating cooking system may include a guide projection unit disposed at a position away from the top plate and directed toward the top plate.
  • the top plate may have a target marker indicating a predetermined adjustment target position.
  • the guide projection unit may be capable of projecting a projection marker indicating a shooting direction of the camera. It may be possible to adjust the shooting direction of the camera by reducing a difference in physical distance between the target marker and the projection marker.
  • the heating cooking system may be provided at a position away from the top plate and may include a guide projection unit directed to the top plate.
  • the top plate may have a target marker indicating a predetermined adjustment target position.
  • the guide projection unit may be capable of projecting a projection marker indicating the shooting direction of the camera. It may be possible to adjust the shooting direction of the camera by reducing a difference in physical distance between the target marker and the projection marker.
  • the heating unit may include a heating coil that generates an induction magnetic field to heat the container.
  • the heating control unit may heat the container by supplying a high frequency current to the heating coil.
  • the marker information of the top plate may be a size that is 1/100 or more of the number of recognizable pixels of the camera in an image taken by the camera.
  • the distance from the camera to the top plate may be 600 mm or more and 2000 mm or less.
  • a heating cooker including a top plate that has a container for storing an object to be heated and has marker information and a heating unit that heats the container from below is photographed.
  • a method for notifying the installation state of a camera is provided. In this method, an image taken by the camera is input. In addition, the marker information included in the image is extracted. Further, it is determined whether or not the extracted marker information is included in a prescribed range of the image. Further, based on the determination result, a notification signal for notifying the installation state of the camera is output.
  • FIG. 1 is a perspective view of a cooking system 100 according to Embodiment 1 of the present disclosure.
  • FIG. 2 is a top view of the heating cooker 1 according to the first embodiment.
  • FIG. 3 is a block diagram showing a control system of the heating cooking system 100.
  • FIG. 4 is a side view showing an installation state of the cooking system.
  • the X-axis direction indicates the longitudinal direction of the heating cooker 1 when viewed from above, and the Y-axis direction indicates the front-rear direction.
  • the Z-axis direction indicates the height direction.
  • the positive direction of the X axis is the right side
  • the negative direction is the left side.
  • the positive direction of the Y axis is the rear and the negative direction is the front.
  • the cooking system 100 includes a cooking device 1 and a cooking status recognition unit 19.
  • the heating cooker 1 includes a main body 3 and a top plate 5 on which the container Cr is placed as an upper portion of the main body 3.
  • a heated object Tc as a cooking target such as a stew is accommodated.
  • the heating cooker 1 is an induction heating cooker, Comprising: As shown in FIG. 1, below the container mounting area
  • the light emitting portions 6A, 6B, and 6C that shine in a ring shape are arranged on the top plate 5 outside the heating coils 7A, 7B, and 7C, respectively.
  • the light emitting units 6A, 6B, and 6C emit light when current flows through the corresponding heating coils 7A, 7B, and 7C.
  • the light emitting units 6A to 6C have, for example, LED light emitting substrates.
  • a plurality of operation input units 9A, 9B, and 9C are arranged on the front side of the top plate 5 of the heating cooker 1 as operation units for the user to operate each of the heating coils 7A to 7C.
  • the operation input units 9A to 9C may be touch keys or a touch panel, for example.
  • the operation input unit 9A and the heating coil 7A, the operation input unit 9B and the heating coil 7B, and the operation input unit 9C and the heating coil 7C correspond to each other.
  • the coil control unit 10 controls the start or stop of heating of the heating coil 7A.
  • the coil control unit 10 adjusts the heating level of the heating coil 7A in, for example, four stages. Similarly, the coil control unit 10 controls the heating of the heating coil 7B according to the operation instruction received by the operation input unit 9B. Further, the coil control unit 10 controls the heating of the heating coil 7C according to the operation instruction received by the operation input unit 9C.
  • the main body 3 includes a notification unit 4 that notifies information related to heating of the heating coils 7A to 7C.
  • the notification unit 4 includes a display unit 11 and an audio output unit 15.
  • the display unit 11 is disposed on the front side of the top plate 5 of the heating cooker 1 and displays the heating level of the heating coils 7A to 7C.
  • the display unit 11 has, for example, a band shape extending in the longitudinal direction of the top plate 5.
  • the display unit 11 is a monochrome liquid crystal panel, but may be a color liquid crystal panel.
  • a setting unit 13 is provided on the front side of the main body 3 of the heating cooker 1 in order for the user to set heating by the heating coils 7A to 7C in detail.
  • the setting unit 13 can be inserted into and removed from the main body 3, and includes a setting key 13a for setting heating by the heating coils 7A to 7C in detail, the setting contents, the detailed state of the heating coils 7A to 7C, and the like.
  • a setting display unit 13b for displaying.
  • the setting unit 13 sets the heating temperature, heating time, timer, and the like of the heating coils 7A to 7C.
  • the heating cooker 1 includes a voice output unit 15 that outputs voice guidance to the user on the front side.
  • the audio output unit 15 is, for example, a speaker.
  • a range hood 17 is installed above the heating cooker 1.
  • the range hood 17 sucks the air above the heating cooker 1 into the inside of the range hood 17 through a hood portion 17a provided at the lower portion, and exhausts it from a discharge port communicated outdoors.
  • the heating cooker 1 includes a cooking status recognition unit 19 that recognizes the cooking status of the object to be heated Tc on the top plate 5 from above.
  • the cooking status recognition unit 19 is disposed at a position away from the top plate 5, for example, at the center of the hood portion 17 a of the range hood 17.
  • the cooking status recognition unit 19 has a camera 19a.
  • the camera 19a is a visible light camera, for example, a CCD (Charge Coupled Device) camera or a CMOS (Complementary Metal Oxide Semiconductor) camera.
  • the camera 19a can shoot the entire top plate 5 from above if an appropriate angle of view and shooting direction are set.
  • the cooking status recognition unit 19 may be arranged on the ceiling or wall in addition to the range hood 17.
  • the distance from the cooking status recognition unit 19 to the top plate 5 is 400 mm or more, for example, 600 mm or more and 2000 mm or less. That is, since the camera 19a is exposed on the outer surface of the cooking condition recognition unit 19, the distance from the camera 19a to the top plate 5 is 400 mm or more, for example, 600 mm or more and 2000 mm or less.
  • the main body 3 has a communication unit 21, and the cooking status recognition unit 19 has a communication unit 23.
  • Image information captured by the camera 19 a is transmitted by the communication unit 23 and received by the main body 3 by the communication unit 21.
  • Each of the communication units 21 and 23 has an antenna and is wirelessly connected by wireless communication such as Wi-Fi (registered trademark), Bluetooth (registered trademark), or BLE (Bluetooth Low Energy).
  • Wi-Fi registered trademark
  • Bluetooth registered trademark
  • BLE Bluetooth Low Energy
  • the heating cooker 1 includes a control unit 25, a storage unit 27, and a guidance information output unit 29 inside the main body 3.
  • the control unit 25 and the guidance information output unit 29 are, for example, a processing device or processing circuit such as a CPU (Central Processing Unit) or a microprocessor, and are a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, or an SSD.
  • Various functions are performed by executing a program stored in the storage unit 27 such as (Solid State Drive).
  • the control unit 25, the storage unit 27, and the guidance information output unit 29 may be arranged in the cooking status recognition unit 19 instead of being arranged in the main body 3.
  • the control unit 25 includes a marker extraction unit 25a, a first determination unit 25b, and a deviation estimation unit 25c.
  • the deviation estimation unit 25c corresponds to the camera position estimation unit of the present disclosure.
  • the marker extraction unit 25a, the first determination unit 25b, and the deviation estimation unit 25c may each be configured with hardware such as a circuit or a device, or may be configured with software.
  • the marker extraction unit 25a, the first determination unit 25b, and the deviation estimation unit 25c may be configured independently or may be configured integrally. Further, at least one of the marker extraction unit 25a, the first determination unit 25b, and the deviation estimation unit 25c may be integrated with the coil control unit 10.
  • the marker extraction unit 25a extracts marker information included in an image photographed by the camera 19a.
  • the display unit 11 and the light emitting units 6A to 6C are displayed as marker information. For example, at least any one of these may be displayed on the top plate 5. Alternatively, other marker information may be displayed. That is, the marker information is not limited to the markers 8A to 8C, the display unit 11, and the light emitting units 6A to 6C, and may be any information that can be recognized as a reference for the shooting direction of the camera.
  • the marker information that the top plate 5 has is a size that is 1/100 or more of the number of recognizable pixels of the camera 19a in the image taken by the camera 19a. Thereby, marker information can be extracted appropriately.
  • the first determination unit 25b determines whether or not the extracted marker information is included in a specified range of the image of the camera 19a in a specified state.
  • the prescribed state means a state in which the first determination unit 25b is instructed to execute the determination.
  • the specified state may mean “when the power is turned on”, may mean “always during cooking”, or may mean “under certain conditions”.
  • the cooking state recognition unit 19 is installed in the correct direction from the notification unit 4. It is notified that it is being done. That is, the notification unit 4 notifies that the shooting direction of the camera 19a is correct.
  • the deviation estimation unit 25c is based on the position of the marker information in the image.
  • the type of deviation from the installation state of the prescribed camera 19a is estimated.
  • the normal installation state of the camera 19a is defined as state a.
  • types of displacement for example, a state b with a displacement parallel to the left direction, a state c with a displacement parallel to the right direction, a state d with a displacement parallel to the rear direction, and a state e with a displacement parallel to the front direction e.
  • the deviation estimation unit 25c estimates the state of deviation and the amount of deviation by image processing.
  • the guide information output unit 29 displays the guide information for position adjustment of the camera 19a stored in the storage unit 27 in correspondence with the type and amount of shift of the camera 19a estimated by the shift estimation unit 25c. Output to the audio output unit 15.
  • the display unit 11 on the top plate 5 is used as the marker information.
  • a single black belt may be displayed on the top plate 5 instead of the display unit 11. .
  • FIG. 5 shows a simplified image of the camera 19a taken from above the heating cooker 1.
  • the broken line area in FIG. 5 indicates the area of the image 19aa of the camera 19a.
  • the marker extraction unit 25a extracts the display unit 11 as marker information from the image 19aa.
  • the marker information extraction method uses image processing such as template matching or edge detection.
  • the display 11 displays, for example, “Installed in the correct direction” shown in FIG. Is done.
  • the voice output unit 15 outputs a voice guidance saying “Installed in the correct direction”.
  • the storage unit 27 stores the image 19aa of FIG. 5 as a state (state a) in which the extracted marker information is included in a specified range in a specified state.
  • An image 19aa in FIG. 5 is image data in an appropriate arrangement of the camera 19a.
  • FIG. 7 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above.
  • the display unit 11 extracted from the image 19 aa is cut off on the right side as indicated by a circular broken line 31.
  • This state is referred to as state b.
  • the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa of the camera 19a. Since the marker information is cut off on the right side of the image 19aa, the deviation estimating unit 25c instructs the guidance information output unit 29 so that the angle of view of the camera 19a is further on the right side. As shown in FIG.
  • the guidance information output unit 29 causes the display unit 11 to display guidance information indicated by a right arrow. Further, the voice output unit 15 outputs a voice guidance “Please turn right”. Accordingly, the user can be guided to move the position of the camera 19a to the right or to turn the shooting direction to the right.
  • FIG. 9 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above.
  • the display unit 11 extracted from the image 19 aa is cut off on the left side as indicated by a circular broken line 33.
  • This state is referred to as state c. Therefore, the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa of the camera 19a. Since the marker information is cut off on the left side of the image 19aa, the deviation estimating unit 25c instructs the guidance information output unit 29 so that the angle of view of the camera 19a is further on the left side. As shown in FIG.
  • the guide information output unit 29 causes the display unit 11 to display the guide information indicated by the left arrow. Further, the voice output unit 15 outputs a voice guidance “Please turn left”. Thus, the user can be guided to move the position of the camera 19a to the left or to turn the shooting direction to the left.
  • FIG. 11 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above.
  • the display unit 11 is not extracted as marker information from the image 19aa because the position or shooting direction of the camera 19a is shifted backward.
  • This state is referred to as state d. Therefore, the first determination unit 25b determines that the marker information is not included in the specified range of the image 19aa of the camera 19a. Since the marker information is not included in the image 19aa, the deviation estimation unit 25c instructs the guidance information output unit 29 so that the angle of view of the camera 19a is directed further forward.
  • the guide information output unit 29 causes the display unit 11 to display guide information of a forward arrow.
  • the voice output unit 15 outputs a voice guidance “Please turn to the front”. Thus, it is possible to guide the user to move the position of the camera 19a forward or to turn the shooting direction forward.
  • FIG. 13 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above.
  • the position or shooting direction of the camera 19a is shifted forward, the number of pixels equal to or larger than a predetermined number is included in the distance PL from the display unit 11 extracted from the image 19aa to the lower end of the image.
  • This state is referred to as state e. Therefore, the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa of the camera 19a in a specified state. Since the marker information is far away from the front end of the image 19aa, the deviation estimation unit 25c instructs the guidance information output unit 29 so that the angle of view of the camera 19a is directed further rearward. As shown in FIG.
  • the guidance information output unit 29 causes the display unit 11 to display guidance information with a backward arrow. Further, the voice output unit 15 outputs a voice guidance “Please turn to the back”. Thus, it is possible to guide the user to move the position of the camera 19a backward or to turn the shooting direction backward.
  • FIG. 15 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above.
  • the photographing direction of the camera 19a is rotated clockwise, the left front end portion of the display unit 11 extracted from the image 19aa is cut off.
  • This state is referred to as state f. Therefore, the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa of the camera 19a in a specified state.
  • the deviation estimation unit 25c instructs the guidance information output unit 29 to rotate the angle of view of the camera 19a more counterclockwise from the angle formed by the front side 19ab of the image 19aa and the linear portion of the display unit 11 in the longitudinal direction. . As shown in FIG.
  • the guide information output unit 29 causes the display unit 11 to display the guide information of the counterclockwise arrow.
  • the voice output unit 15 outputs a voice guidance “Please move counterclockwise”.
  • the user can be guided to rotate the camera 19a counterclockwise.
  • the rotation angle may be displayed as both an image and a number.
  • the first determination unit 25b includes the extracted marker information within the specified range of the image 19aa of the camera 19a in a specified state. Judge that it is not. This state is referred to as state g.
  • the deviation estimation unit 25c instructs the guidance information output unit 29 to rotate the angle of view of the camera 19a clockwise from the angle formed by the front side 19ab of the image 19aa and the linear portion of the display unit 11 in the longitudinal direction.
  • the guide information output unit 29 causes the display unit 11 to display clockwise arrow guide information.
  • the voice output unit 15 outputs a voice guidance “Please move clockwise”. Thus, the user can be guided to rotate the camera 19a clockwise.
  • the rotation angle may be displayed as both an image and a number.
  • FIG. 18 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above.
  • the extracted display unit 11 in the image 19aa is indicated by a circular broken line 38. Both ends are cut off. This state is referred to as state h. Therefore, the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa of the camera 19a in a specified state.
  • the shift estimation unit 25c instructs the guide information output unit 29 to move the installation position of the camera 19a to a higher position because the marker information is cut off on both sides of the image 19aa.
  • the guidance information output unit 29 causes the display unit 11 to display guidance information “please raise the installation height”.
  • the voice output unit 15 outputs a voice guidance such as “Please raise the installation height”, for example.
  • the user can be guided to increase the height of the installation position of the camera 19a.
  • FIG. 19 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above.
  • the display unit 11 since the installation position of the camera 19a is not sufficiently separated from the top plate 5, that is, the height position of the camera 19a is low, the display unit 11 is not extracted in the image 19aa. Further, the image 19aa has a part of the marker 8C cut off, and the entire image 19aa is not included in the image 19aa. This state is also referred to as state h.
  • the first determination unit 25b determines that the extracted marker information is in the specified state of the image 19aa of the camera 19a. It is determined that it is not included in the range.
  • the deviation estimation unit 25c estimates that the installation position of the camera 19a is low and moves to a higher position.
  • the guidance information output unit 29 is instructed as follows. As shown in FIG. 20, the guidance information output unit 29 displays guidance information “Please raise the installation height” on the display unit 11, thereby increasing the height of the installation position of the camera 19 a to the user. Can be guided.
  • the display color may be changed according to the amount of deviation. For example, when the amount of deviation is large, guidance display may be performed in red or warm colors. For example, when the amount of deviation is small, guidance display may be performed in blue or cold colors.
  • FIG. 21 is a flowchart showing the flow of camera position guidance. Confirmation of the installation state of the cooking status recognition unit 19 is performed by a construction installer when the heating cooker 1 is installed for the first time, or by a general user when a failure of the heating cooker 1 is dealt with.
  • the direction adjustment mode of the cooking status recognition unit 19 is activated by an input from the setting key 13a.
  • the control unit 25 sends a shooting instruction to the camera 19a.
  • the camera 19a When the camera 19a receives the shooting instruction, the camera 19a takes an image in step S2. The captured image is sent to the control unit 25.
  • the marker extraction unit 25a extracts marker information from the image sent to the control unit 25.
  • the marker information is extracted using image processing techniques such as template matching or feature point extraction.
  • step S4 the first determination unit 25b determines whether the extracted marker information is included in a specified range of the image in a specified state.
  • the guide information output unit 29 displays the display unit 11 or the audio output unit 15 in the step S5. Instruct them to guide you through the proper installation.
  • the message “installed in the correct direction” is displayed on the display unit 11 or the voice output unit 15 provides voice guidance “installed in the correct direction”. Alternatively, guidance is provided from both the display unit 11 and the audio output unit 15.
  • step S6 the shift estimation unit 25c detects the shift of the cooking status recognition unit 19. Estimate the type.
  • the type of deviation includes the direction and amount of deviation, and the guide information output unit 29 eliminates the deviation in the display unit 11 or the audio output unit 15 in step S7 according to the estimated type of deviation.
  • the position correction guidance information is output.
  • the user can confirm the type of deviation by the display unit 11 or the audio output unit 15, and can correct the deviation of the cooking state recognition unit 19, that is, the deviation of the photographing direction of the camera 19a.
  • the flow of the installation position check is started again from step S1 after a predetermined time has elapsed or by an input from the setting key 13a.
  • the shooting direction of the camera 19a is a direction from the camera 19a toward the center of the visual field range of the camera 19a.
  • the cooking system 100 according to Embodiment 1 can confirm whether or not the installation position of the cooking status recognition unit 19 arranged away from the top plate 5 is appropriate. Further, when the installation position is inappropriate, the display unit 11 or the audio output unit 15 guides the shift direction, the shift amount, and the like, so that the user can adjust according to the guidance. As a result, the cooking status recognition unit 19 can be installed at an appropriate position, and the status of cooking on the top plate 5 can be properly recognized.
  • the cooking system 100 includes a top plate 5, heating coils 7A to 7C (an example of the heating unit of the present disclosure), a coil control unit 10 (an example of the heating control unit of the present disclosure), and a camera 19a. And a marker extraction unit 25a, a first determination unit 25b, and a notification unit 4.
  • the top plate 5 is mounted with a container Cr that accommodates the article to be heated Tc, and has at least one or more marker information (for example, at least one of the display unit 11 and the markers 8A to 8C).
  • the heating coils 7A to 7C heat the container Cr from below.
  • the coil controller 10 controls the amount of heating from the heating coils 7A to 7C to the container Cr.
  • the camera 19 a is disposed at a position away from the top plate 5 and is directed toward the top plate 5.
  • the marker extraction unit 25a extracts marker information included in an image 19aa photographed by the camera 19a.
  • the first determination unit 25b determines whether or not the extracted marker information is included in a prescribed range of the image 19aa.
  • reports the installation state of the camera 19a based on the determination result of the 1st determination part 25b.
  • the notification unit 4 determines that the installation state of the camera 19a is normal. Outputs a signal to be recognized.
  • the notification unit 4 informs the user that the installation state of the camera 19a is abnormal. Output the signal to be recognized.
  • the specified range may be, for example, the entire area of the image 19aa or a part of the predetermined area of the image 19aa.
  • the user can recognize whether or not the camera 19a is displaced. That is, the cooking system 100 can prompt the user to correct the positional deviation of the camera 19a, and can realize appropriate photographing.
  • reporting part 4 is abnormal installation of the camera 19a. Announce the condition.
  • the user can recognize the positional deviation of the camera 19a. That is, the cooking system 100 can prompt the user to correct the positional deviation of the camera 19a, and can realize appropriate photographing.
  • the means for notifying the abnormal installation state may be means for notifying that the normal installation state is always normal and not normal in the abnormal installation state.
  • the means for notifying the abnormal installation state may be a means for outputting the notification signal only in the abnormal installation state without outputting the notification signal in the normal installation state. In a normal installation state, it is considered that there are more cases than in an abnormal installation state. Therefore, by outputting a notification signal only in an abnormal installation state, the power required for notification can be reduced.
  • the means for notifying the abnormal installation state may be a means for outputting a signal different from the signal output in the normal installation state. Thereby, the user can recognize more accurately whether the camera 19a is in a normal installation state or an abnormal installation state.
  • the cooking system 100 of the present embodiment includes a guidance information output unit 29 that outputs guidance information for position adjustment of the camera 19a in accordance with the installation state of the camera 19a.
  • the guidance information output unit 29 extracts the extracted marker information from the specified value of the image 19aa.
  • Guidance information for guiding the change of the installation state of the camera 19a is output to the notification unit 4 so as to be included in the range.
  • the guidance information for guiding the change of the installation state is information regarding guidance output from the display unit 11 and the audio output unit 15.
  • the cooking system 100 can specifically show the user how to correct the positional deviation of the camera 19a, and can realize appropriate photographing.
  • the heating cooker 1 is an induction heating cooker. That is, the heating unit includes heating coils 7A to 7C that generate an induction magnetic field to heat the container Cr.
  • the coil controller 10 heats the container Cr by supplying a high-frequency current to the heating coil. That is, the camera 19a, the marker extraction unit 25a, the first determination unit 25b, and the notification unit 4 of the present embodiment can be applied to a heating cooker such as a gas stove, but is also suitable for an induction heating cooker.
  • the marker information of the top plate 5 has a size that is 1/100 or more of the number of recognizable pixels of the camera in the image 19aa photographed by the camera 19a. Thereby, the marker extraction part 25a can extract marker information appropriately.
  • the distance from the camera 19a to the top plate 5 is 600 mm or more and 2000 mm or less.
  • a wide area of the top plate 5 can be easily photographed using the general-purpose camera 19a.
  • this Embodiment discloses the method of alert
  • the heating cooker 1 includes a top plate 5 and heating coils 7A to 7C. On the top plate 5, a container Cr that accommodates the article to be heated Tc is placed.
  • the top plate 5 has marker information (for example, at least one of the display unit 11 and the markers 8A to 8C).
  • This method includes a step of inputting an image photographed by the camera 19a.
  • the method also includes a step of extracting marker information included in the image.
  • the method also includes the step of determining whether the extracted marker information is included within a prescribed range of the image.
  • This method includes a step of outputting a notification signal for notifying the installation state of the camera based on the determination result of the determination step.
  • the heating cooker 1 can prompt the user to correct the positional deviation of the camera 19a, and can realize appropriate photographing.
  • Embodiment 2 Next, a heat cooking system according to Embodiment 2 will be described with reference to FIGS.
  • the cooking system 100 according to the first embodiment extracts the display unit 11 or the black belt as marker information and determines the deviation of the cooking status recognition unit 19, the cooking system according to the second embodiment
  • the ring-shaped light emitting units 6A to 6C are extracted as marker information to determine the deviation of the cooking state recognition unit 19, that is, the deviation of the photographing direction of the camera 19a.
  • the heat cooking system in Embodiment 2 is common in the heat cooking system 100 of Embodiment 1 except for the matters described below.
  • the marker extracting unit 25a in the second embodiment extracts the rings of the light emitting units 6A to 6C as marker information.
  • the light emitting units 6A to 6C can be extracted by taking the difference between the image before the light emitting units 6A to 6C are turned on and the image after the light is turned on.
  • the light emitting units 6A to 6C are turned on or blinked by the control unit 25 in at least one of a specified position, a specified color, and a specified order.
  • FIG. 22 shows an image obtained by simplifying an image taken by the camera 19a from above.
  • a rectangular broken line area in FIG. 22 indicates an area of an image 19ac photographed by the camera 19a.
  • a broken line of the triangle 32 is an index for detecting a rotational shift of the image 19ac.
  • the marker extraction unit 25a extracts the light emitting units 6A to 6C as marker information from the image 19ac.
  • the image 19ac is an image when the camera 19a is placed at the correct position. That is, since it is the image 19ac in the state a, it is processed in the same manner as in the first embodiment, and guidance corresponding to the state a is output from the display unit 11 and the audio output unit 15.
  • FIG. 23 shows an image 19ac obtained by simplifying an image taken by the camera 19a from above.
  • the position of the camera 19a or the shooting direction is shifted to the left. Accordingly, among the light emitting units 6A to 6C extracted from the image 19ac, the right side of the light emitting unit 6C arranged on the right side is cut. That is, since it is the image 19ac in the state b, it is processed in the same manner as in the first embodiment, and guidance corresponding to the state b is output from the display unit 11 and the audio output unit 15.
  • FIG. 24 shows an image 19ac obtained by simplifying an image taken by the camera 19a from above.
  • the position of the camera 19a or the shooting direction is shifted to the right. Accordingly, among the light emitting units 6A to 6C extracted from the image 19ac, the left side of the light emitting unit 6A arranged on the left side is cut. That is, since it is the image 19ac in the state c, it is processed in the same manner as in the first embodiment, and guidance corresponding to the state c is output from the display unit 11 and the audio output unit 15.
  • FIG. 25 shows an image 19ac obtained by simplifying an image taken by the camera 19a from above.
  • the position of the camera 19a or the shooting direction is shifted backward. Accordingly, among the light emitting units 6A to 6C extracted from the image 19ac, the front side of the light emitting units 6A and 6B arranged on the front side is cut off. That is, since the image 19ac in the state d is processed in the same manner as in the first embodiment, guidance corresponding to the state d is output from the display unit 11 and the audio output unit 15.
  • FIG. 26 shows an image 19ac obtained by simplifying an image taken by the camera 19a from above.
  • the position of the camera 19a or the shooting direction is shifted forward. Therefore, among the light emitting units 6A to 6C extracted from the image 19ac, the rear side of the light emitting unit 6C arranged on the rear side is cut off. That is, since it is the image 19ac in the state e, it is processed in the same manner as in the first embodiment, and guidance corresponding to the state e is output from the display unit 11 and the audio output unit 15.
  • FIG. 27 shows an image 19ac obtained by simplifying the image taken by the camera 19a from above.
  • the shooting direction of the camera 19a is rotated clockwise.
  • the rotational deviation can be detected by, for example, a rotational deviation from the mutually defined positional relationship of the marker information.
  • positions on the captured image of the camera 19a corresponding to the left end of the light emitting unit 6A, the right end of the light emitting unit 6B, and the upper end of the light emitting unit 6C are stored.
  • An angle formed by the base of the triangle 32 connecting these points and the base of the triangle 34 connecting the corresponding points of the light emitting units 6A to 6C detected from the captured image by template matching or the like is detected.
  • the deviation estimation unit 25c performs processing in the same manner as in the first embodiment, and guidance corresponding to the state f is displayed from the display unit 11 and the audio output unit 15. Is output. Also, when the shooting direction of the camera 19a is deviated counterclockwise, it is processed as the state g, and guidance corresponding to the state g is output from the display unit 11 and the audio output unit 15.
  • FIG. 28 shows an image 19ac obtained by simplifying an image taken by the camera 19a from above.
  • the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19ac of the camera 19a in the specified state.
  • the deviation estimation unit 25c estimates the deviation in the state h, and instructs the guidance information output unit 29 to move the installation position of the camera 19a to a higher position. Thereby, guidance corresponding to the state h is output from the display unit 11 and the audio output unit 15.
  • the light emitting units 6A to 6C corresponding to the heating coils 7A to 7C are used as marker information, so that each heating coil 7A to 7C is photographed more appropriately.
  • the installation position of the camera 19a can be adjusted. Therefore, the accuracy of the position adjustment of the camera 19a can be improved.
  • the marker information is lit or blinked in at least one of the specified position, the specified color, and the specified order.
  • the marker extraction part 25a can extract marker information easily.
  • a heat cooking system 41 according to Embodiment 3 will be described with reference to FIGS. 29 to 38.
  • the cooking status recognition unit 19 is arranged in the range hood 17 installed above the main body 3.
  • the cooking system 41 according to the third embodiment arranges the cooking status recognition unit 19 on the wall 37 extending upward behind the main body 3.
  • the cooking system 41 in Embodiment 3 is the same as the cooking system 100 of Embodiment 1 or 2 except for the matters described below.
  • FIG. 29 is a block diagram showing a control system of the cooking system 41 according to the third embodiment.
  • the main body 43 of the cooking device of the cooking system 41 according to Embodiment 3 has a second determination unit 35 in the control unit 45 disposed therein. That is, the control unit 45 of the third embodiment is obtained by adding the second determination unit 35 to the control unit 25 of the first embodiment.
  • the second determination unit 35 includes, based on the marker information extracted by the marker extraction unit 25a, the height position of the camera 19a included in the range of the specified height position associated with the angle of view of the camera 19a. Determine whether or not.
  • To be included in the range of the specified height position may indicate that the reference height position is set with a certain predetermined width and is included in the reference range.
  • a reference difference value is set for the reference height position, and the difference between the height position of the camera 19a and the reference height position is equal to or less than the reference difference value. You may point out that it is less than.
  • the top plate 5 of the heating cooker 1 is You can shoot properly. That is, the tilt of the camera 19a at the angle of view 39 is normal, and is included in the specified tilt range.
  • the light emitting units 6A to 6C are included in the photographed image 19ad.
  • the markers 8A to 8C or the display unit 11 may be used as marker information.
  • the image 19ad is an image extending in the forward direction.
  • the camera 19 a of the cooking situation recognition unit 19 is installed on the wall 37 at an angle having an angle of view 44 indicated by a one-dot chain line, for example, the top plate 5 is appropriately photographed. I can't. That is, the tilt of the camera 19a at the angle of view 44 is abnormal and is not included in the specified tilt range.
  • the photographed image 19ad includes more front regions of the top plate 5.
  • the image 19ad in FIG. 32 is an image in which the rear portion of the light emitting unit 6C is cut.
  • the deviation estimation unit 25c it is estimated by the deviation estimation unit 25c that there is a deviation e in the forward direction, and the guidance information output unit 29 is guided to correct the direction of the camera 19a in the backward direction. Further, the deviation estimation unit 25c may guide angle adjustment by estimating the angle of the camera with respect to the top plate 5. Further, since the left side of the display unit 11 is cut off, it is also estimated by the shift estimation unit 25c that the shift is occurring in the right direction, and guidance is provided to correct the direction of the camera 19a in the left direction. Is done. With the two correction guides, the orientation of the camera 19a is corrected, and the image shown in FIG. 33 can be obtained. Thereafter, the control unit 45 cuts out the image within the effective range 19c within the angle of view of the camera 19a. Alternatively, the control unit 45 adjusts the zoom of the camera 19a.
  • FIG. 34 is a diagram illustrating the height position of the cooking status recognition unit.
  • FIG. 35 shows an image 19ae obtained by simplifying the photographed image when the cooking situation recognition unit 19 is installed at the point k in the center of the range hood 17. Since the image 19ae taken from the point k is taken from directly above the top plate 5, no distortion occurs in the markers 8A to 8C in the taken image. The markers 8A to 8C are perfect circles.
  • the image 19ae in this state is stored in the storage unit 27 as an image in a normal state.
  • an image 19af taken from a point m at a height of 800 mm from the top plate 5 is shown by a solid line in FIG.
  • broken lines indicate the markers 8A to 8C in FIG. 35 without distortion as a comparison.
  • the markers 8A to 8C in the image 19af are distorted from a perfect circle to an ellipse. Based on the degree of the distortion, it is possible to detect at which height of the wall the cooking state recognition unit 19 is attached.
  • an image taken from a point n at a height of 600 mm from the top plate 5 is indicated by a solid line in FIG.
  • the broken lines show the markers 8A to 8C in FIG. 35 without distortion as a comparison.
  • the image 19af at 600 mm is taken with each of the markers 8A to 8C being more distorted than the image at 800 mm.
  • an image taken from a point p at a height of 400 mm from the top plate 5 is indicated by a solid line in FIG.
  • the broken lines indicate the markers 8A to 8C in the undistorted state in FIG. 35 for comparison.
  • the image 19af at 400 mm is taken with the markers 8A to 8C being more distorted than the images at 600 and 800 mm.
  • the shift estimation unit 25c estimates the state h, and outputs a guidance corresponding to the state h from the display unit 11 and the audio output unit 15. As a result, the user is guided to increase the height of the cooking status recognition unit 19.
  • the deviation estimation unit 25c estimates the height of the camera as the position information of the camera based on the distortion of the extracted marker information.
  • the storage unit 27 stores image data in a state a that is a normal state at each height of 400, 600, and 800 mm. Therefore, even if the marker information extracted from the photographed image is distorted as compared with the image photographed from directly above, the type of deviation can be estimated. Further, the long side and the short side of each ellipse are detected by image processing, and the height of the cooking condition recognition unit 19 is estimated by judging the degree of distortion of the ellipse from the ratio of the detected long side and short side. Good.
  • the deviation estimation unit 25c estimates the type of deviation of the captured image according to each detected height.
  • FIG. 39 is a flowchart showing a flow of camera position correction guidance in the third embodiment. Steps S1 to S3 are the same as those in the first embodiment, and a description thereof will be omitted.
  • the second determination unit 35 determines whether the height position of the camera is included in the range of the specified height position. When the second determination unit 35 determines that the height position of the camera is included in the range of the specified height position (Yes in step S11), the processing after step S4 in the first embodiment is similarly performed.
  • the second determination unit 35 determines that the height position of the camera is not included in the range of the specified height position (No in step S11)
  • the second determination unit 35 sends the cooking information to the guide information output unit 29. It instructs to output guidance information for changing the height position of the situation recognition unit 19.
  • the guidance information output unit 29 guides the same guidance as in the state h from the display unit 11 and the voice output unit 15 of the notification unit 4. Thereafter, the process is started again from step S1.
  • the cooking status recognition unit 19 When the cooking status recognition unit 19 is attached to the wall 37, it can be attached at various height positions as compared with the case where it is attached to the range hood 17. Therefore, the possibility that the user mistakes the attachment position (that is, the height position of the camera 19a) may increase.
  • the cooking system 41 according to the third embodiment even when the cooking status recognition unit 19 is attached to the wall 37, it is possible to guide the user whether or not the height position is appropriate. Moreover, since the guidance which corrects it is alert
  • the shooting direction of the camera 19a can be corrected.
  • the first determination unit 25b may acquire a specified range using reference image data corresponding to the height position. That is, the specified range may change depending on the height position. Thereby, determination of step S4 can be performed with higher precision.
  • guide information may be output using reference image data corresponding to the height position. That is, the guidance information may change depending on the height position.
  • the guide information output unit 29 can output highly accurate guide information so as to correct the inclination with higher accuracy.
  • the second determination unit 35 determines whether the height position of the camera 19a is included in the range of the specified height position based on the extracted marker information.
  • the notification unit 4 notifies the abnormal installation state of the camera.
  • the user can recognize that the height position of the camera 19a is abnormal, and the heating cooker 1 can prompt the user to correct the height position of the camera 19a, thereby realizing appropriate photographing.
  • the camera 19a is disposed on the wall 37, it is necessary to accurately adjust the height position of the camera 19a in order to appropriately set the shooting range, and thus this embodiment is useful.
  • the guidance information output unit 29 determines that the camera 19a has the height position of the camera 19a when the second determination unit 35 determines that the height position of the camera 19a is not included in the specified height position range.
  • Guidance information for guiding the change in the installation state of the camera 19a is output to the notification unit 4 so that the height position is included in the range of the specified height position.
  • the heating cooker 1 can guide the user how to specifically correct the height position of the camera 19a, and can realize appropriate photographing.
  • the deviation estimation unit 25c estimates the height position of the camera 19a as installation information related to the installation state of the camera 19a based on the extracted distortion of the marker information.
  • the guide information output unit 29 outputs guide information in accordance with pre-recorded position adjustment data corresponding to the estimated height position. Thereby, even if marker information is distorted, guidance information can be appropriately output.
  • the deviation estimation unit 25c may estimate the tilt of the camera 19a based on the distortion, in addition to the height position or instead of the height position.
  • the guidance information output unit 29 outputs guidance information according to the pre-recorded position adjustment data corresponding to the estimated inclination.
  • the first determination unit 25b determines the deviation of the tilt of the camera 19a
  • the second determination unit 35 determines the deviation of the height of the camera 19a. A determination may be performed. In addition, a part of the tilt deviation of the camera 19a may be determined by the second determination unit 35.
  • the first determination unit 25b or the second determination unit 35 includes the rotation angle with respect to the optical axis of the camera 19a within the specified rotation angle range based on the inclination of the marker information extracted by the marker extraction unit 25a. It may be determined whether or not.
  • the optical axis extends in the same direction as the shooting direction of the camera 19a.
  • the first determination unit 25b or the second determination unit 35 determines whether the rotation angle with respect to the optical axis of the camera is included in the specified rotation angle range after step S3 and before step S11. Determine. If it is determined that “included” in this determination step, the process proceeds to step S11. If it is determined that it is not included in this determination step, the guide information output unit 29 outputs guide information for guiding the adjustment of the rotation angle of the camera 19a. The user can recognize the guidance information via the notification unit 4 and can adjust the rotation angle of the camera 19a. After the rotation angle of the camera 19a is corrected, the cooking system 41 returns to step S1 again.
  • the heating and cooking system 100 according to the first embodiment outputs the position correction guidance of the cooking status recognition unit 19 from the notification unit 4 arranged in the main body 3.
  • the cooking system 51 according to the fourth embodiment is configured to be able to guide the position correction of the cooking status recognition unit 19 from the portable terminal 47.
  • the cooking system 51 in Embodiment 4 is the same as the cooking system 41 in Embodiment 3 except for the items described below.
  • the communication unit 21 of the main body 43 of the cooking system 51 is wirelessly connected to the communication unit 23 of the cooking status recognition unit 19 via a router device 49 installed as an external device. That is, the cooking status recognition unit 19 and the control unit 45 are connected to a local area network 53 centering on the router device 49 so as to be capable of wireless communication.
  • the router device 49 is connected to the Internet 55. Further, the router device 49 is connected to the user's portable terminal 47 so as to be able to perform wireless communication.
  • the portable terminal 47 includes, for example, a display unit 47a having a liquid crystal display and an audio output unit 47b having a speaker.
  • the portable terminal 47 can function as a notification unit, the guide information output from the guide information output unit 29 can be received via the communication unit 21 and the router device 49. Therefore, the same information as the guidance information notified from the notification unit 4 can be notified to the user from the display unit 47a and the voice output unit 47b of the portable terminal 47.
  • the portable terminal 47 Since the portable terminal 47 notifies the guidance of the position adjustment of the cooking status recognition unit 19, for example, when working near the range hood 17, guidance information that is difficult to see from the display unit 11 of the main body 3 is also displayed by the portable terminal 47. Since it can be seen at hand, the position adjustment efficiency can be improved.
  • the guide information output from the guide information output unit 29 can be transmitted to the outside via the Internet 55.
  • the portable terminal 47 instead of the portable terminal 47, it may be connected to an integrated control unit that is also arranged in the house and can also control other electrical products.
  • the notification unit for example, the display unit 47a and the audio output unit 47b of the mobile terminal 47 and the notification unit 4 of the main body are used together, but only the notification unit of the mobile terminal 47 may be used. Good.
  • the cooking system 51 includes the communication unit 21 in the present embodiment.
  • the communication unit 21 wirelessly communicates the abnormal installation state of the camera 19a to a portable terminal 47 (an example of an external device according to the present disclosure) having a display unit 47a and an audio output unit 47b (an example of a notification unit according to the present disclosure).
  • the communication unit 21 transmits information on the abnormal installation state of the camera 19a to the portable terminal 47.
  • the display unit 47a and the audio output unit 47b notify an abnormal installation state of the camera 19a. This makes it easier for the user to recognize the installation state of the camera 19a regardless of the position of the user.
  • the external device may be an integrated control unit arranged in the house in addition to the mobile terminal 47 or in place of the mobile terminal 47.
  • the integrated control unit has at least one of a display unit and an audio output unit. Thereby, a user can be made to recognize the installation state of a camera using a control part common with several household appliances.
  • FIG. 41 is a block diagram illustrating a control system of the cooking system 61 according to the fifth embodiment.
  • FIG. 42 is a diagram illustrating a schematic configuration of the heating cooking system 61.
  • the cooking status recognition unit 19 of the heating and cooking system 100 according to the first embodiment has the camera 19a, whereas the cooking status recognition unit 63 of the heating and cooking system 61 according to the fifth embodiment further includes a top.
  • a temperature sensor 65 that detects the temperature on the plate 5 and an electric drive unit 67 that can electrically adjust the orientation of the cooking condition recognition unit 63, that is, the photographing direction of the camera 19a, are provided.
  • the cooking system 61 in Embodiment 5 is the same as the cooking system 51 in Embodiment 4 except for the items described below.
  • the camera 19a and the temperature sensor 65 are fixed to each other so that the temperature sensor 65 faces the same direction as the camera 19a.
  • the camera 19a and the temperature sensor 65 constitute a detection unit 69. Therefore, as in the first embodiment, if the position and the shooting direction of the camera 19a are corrected, the position and the detection direction of the detection unit 69 are corrected, so the position and the detection direction of the temperature sensor 65 are also corrected at the same time.
  • the temperature sensor 65 is, for example, an infrared sensor.
  • the temperature sensor 65 can detect the temperature state of the object to be heated Tc that is the cooking target in the container Cr from above.
  • the detection direction of the temperature sensor 65 is a direction from the temperature sensor 65 toward the center of the range in which the temperature sensor 65 can absorb light of a specific wavelength.
  • the specific wavelength light is a wavelength in the infrared region.
  • the range that can absorb light of a specific wavelength may be a point or a surface.
  • the electric drive unit 67 includes, for example, a motor, and adjusts the direction of the detection unit 69 according to the rotation amount of the motor.
  • the position and detection direction of the detection unit 69 are corrected based on the captured image of the camera 19a having a higher resolution than the temperature sensor 65. Thereby, the temperature sensor 65 with low resolution can also correct the position and the detection direction with high accuracy.
  • the electric drive unit 67 is connected to the deviation estimation unit 25c via the communication units 21 and 23, the direction of the detection unit 69 is automatically adjusted according to the adjustment guidance output by the guidance information output unit 29. . Therefore, since the electric drive unit 67 moves the camera 19a according to the shift direction and the shift amount estimated by the shift estimation unit 25c, the adjustment burden on the user can be reduced.
  • the cooking condition recognition part 63 was the structure provided with both the temperature sensor 65 and the electric drive part 67, the structure provided with either one may be sufficient.
  • the cooking system 61 includes the electric drive unit 67.
  • the electric drive unit 67 can adjust the shooting direction of the camera electrically.
  • the electric drive unit 67 automatically adjusts the shooting direction of the camera so that the first determination unit 25b determines that the extracted marker information is included in the prescribed range of the image. If the second determination unit 35 does not determine that the tilt of the camera 19a is not included in the specified tilt range, the electric driving unit 67 automatically determines that the camera 19a is included in the specified tilt range. You may adjust the shooting direction of the camera. Thereby, the heating cooking system 61 can implement
  • the heating cooking system 61 includes a cooking status recognition unit 63.
  • the cooking status recognition unit 63 includes a camera 19a and a temperature sensor 65 (an example of a temperature detection unit of the present disclosure).
  • the temperature sensor 65 is disposed at a position away from the top plate 5 and is directed toward the top plate 5.
  • the camera 19a and the temperature sensor 65 are arranged in the same direction.
  • the camera 19a and the temperature sensor 65 are arranged in the cooking state recognition unit 63 and arranged in the same direction. Therefore, by adjusting the shooting direction of the camera 19a, the detection direction of the temperature sensor 65 is also adjusted in conjunction. Thereby, the detection direction of the temperature sensor 65 can be adjusted using the high-resolution image by the camera 19a, and the detection accuracy of the temperature sensor 65 improves.
  • the temperature sensor 65 is taken as an example of the temperature detection unit, but the temperature detection unit may be a thermal camera.
  • FIG. 43 is a block diagram illustrating a control system of the cooking system 71 according to the sixth embodiment.
  • FIG. 44 is a bottom view of the detection unit of the cooking status recognition unit.
  • the cooking system 1 according to the first embodiment uses a marker or display unit 11 displayed on the top plate 5 as marker information.
  • the heating cooking system 71 according to the sixth embodiment includes the adjustment guide projection unit 75 directed in the detection direction of the detection unit 69 of the cooking state recognition unit 73. Using the marker information projected on the top plate 5 from the adjustment guide projection unit 75, the position of the cooking condition recognition unit 73 is adjusted.
  • the cooking system 71 in Embodiment 6 is the same as the cooking system 61 in Embodiment 5 except for the items described below.
  • the cooking status recognition unit 73 includes an adjustment guide projection unit 75 that is directed in the same direction as the camera 19a and the temperature sensor 19b.
  • FIG. 45 is a diagram illustrating a schematic configuration of a cooking system.
  • the adjustment guide projection unit 75 projects a position adjustment marker from above the top plate 5.
  • FIG. 46 is a diagram illustrating an example of a marker projected from the adjustment guide projecting unit 75.
  • a circle 77 is a projection marker projected from the adjustment guide projection unit 75 onto the top plate 5.
  • the projection marker indicates the shooting direction of the camera 19a.
  • the user can adjust the position and direction of the cooking status recognition unit 73 so that the projected circle 77 is located at the position of the target marker 79.
  • the shooting direction of the camera 19a can be adjusted.
  • the camera 19a captures the state in which the marker 77 is projected on the top plate 5, detects the difference between the target marker 79 and the marker 77 by image processing on the captured image, and is automatically performed by the electric drive unit 67.
  • the direction of the camera 19a may be adjusted.
  • the target marker 79 is not limited to a rectangular marker, and may be a cross-shaped or triangular marker.
  • FIG. 47 is a diagram illustrating an example of a marker projected from the adjustment guide projection unit 75.
  • the adjustment guide projection unit 75 projects the current shooting area 81 of the camera 19a onto the top plate 5. Therefore, the user can adjust the position and direction of the cooking status recognition unit 73 so that the projected photographing region 81 includes the light emitting units 6A to 6C or the markers 8A to 8C and is positioned at an appropriate position.
  • the camera 19a captures a state in which the imaging region 81 is projected on the top plate 5, detects a difference between the imaging region 81 and the ideal region 83 by image processing on the captured image, and the electric drive unit 67 You may adjust the direction of the camera 19a automatically.
  • the heating and cooking system 71 of the sixth embodiment since the recognition area of the cooking situation recognition unit 73 is directly displayed on the top plate 5, the user understands the positional deviation of the cooking situation recognition unit 73 sensuously. can do. Therefore, the position adjustment time can be shortened.
  • the heating and cooking system 71 of the present embodiment includes the adjustment guide projection unit 75 (an example of the guide projection unit of the present disclosure) that is disposed at a position away from the top plate 5 and directed toward the top plate 5.
  • the top plate 5 has a target marker (for example, the target marker 79, the light emitting units 6A to 6C, or the markers 8A to 8C) indicating a predetermined adjustment target position.
  • the adjustment guide projection unit 75 can project a projection marker (for example, the projection marker 77 or the imaging region 81) indicating the imaging direction of the camera 19a. By reducing the difference in physical distance between the target marker and the projection marker, the shooting direction of the camera 19a can be adjusted. Thereby, the user can grasp the installation state of the camera 19a more visually.
  • the display unit 11 is configured using a liquid crystal display having a normal resolution, but is not limited thereto.
  • a dot liquid crystal display 11a may be provided in a part of the display unit 11.
  • the display unit 11 includes the dot liquid crystal display 11a
  • the dot picture shown in FIG. 50 or 52 is displayed from the dot liquid crystal display 11a. That is, by causing the light emitting units 6A to 6C or the markers 8A to 8C included in the region of the captured image 19ag to emit light with dots, it is possible to present the user with an easier understanding of the shift state of the captured region.
  • the cooking status recognition unit 73 is arranged in an appropriate direction at an appropriate position, as shown in FIG. 51 or FIG. 53, the user can cook by emitting all the dots in the dot area indicating each heating area. It can be known that the situation recognition unit 73 is appropriately arranged.
  • notification may be made according to the current position shift. For example, as shown in FIG. 54, when a right shift occurs in the captured image 19ah, the shift amount is displayed on the dot liquid crystal display 11a as a relative amount.
  • the bar 85 indicates the amount of deviation, and the bar 85 becomes shorter as the cooking state recognition unit 19 is turned to the left. When the cooking status recognition unit 19 faces in an appropriate direction, the display of the bar 85 disappears.
  • the shift amount is expressed as a relative amount on the dot liquid crystal display 11a.
  • the triangular guide information 87 indicates the amount of deviation, and as the cooking status recognition unit 19 rotates counterclockwise, the triangle of the guide information 87 becomes slanted. When the cooking status recognition unit 19 is positioned at an appropriate angle, the guide information 87 disappears.
  • the display unit 11 may include a high-resolution liquid crystal display 11b as shown in FIG.
  • the shooting area of the camera 19a may be displayed according to the actual situation.
  • the photographed image 19am is misaligned, but as shown in FIG. 58, the high resolution liquid crystal display 11b has a relative amount of misalignment compared to the schematic diagram 89 showing the state d.
  • the schematic diagram 89 showing the state d.
  • the arrow 93 indicating the direction in which the displacement direction is corrected is displayed.
  • the high-resolution liquid crystal display 11b rotates in a counterclockwise direction with a triangle 95 indicating the state of the state f and the shift amount.
  • An arrow 97 for guidance for correction is displayed.
  • the cooking status recognition unit 19 can be corrected more easily.
  • the cooking status recognition unit 19 when the cooking status recognition unit 19 is arranged in the range hood 17, it is arranged in the center of the hood portion 17 a of the range hood 17, but is not limited thereto. In addition to this, for example, as shown in FIG. 60, it may be arranged at the front portion of the hood portion 17a.
  • the captured image 19ap When arranged in the front portion of the hood portion 17a, the captured image 19ap has a trapezoidal shape with a long front side as shown in FIG. 61. An image of such an optimal position of the trapezoidal shape is stored in advance in the storage unit 27. To remember. Thereby, similarly to Embodiment 1, position shift can be guided.
  • the cooking status recognition unit 19 may be arranged at the rear of the hood portion 17a as shown in FIG.
  • the photographed image 19aq has a trapezoidal shape with a long rear side as shown in FIG. I remember it. Thereby, similarly to Embodiment 1, position shift can be guided.
  • the marker is extracted and the first determination unit determines whether the marker information is included in the specified range of the image in a specified state.
  • the following processing is performed when the power of the cooking device 1 is turned on and when the battery of the cooking device 1 is replaced.
  • the installation information of the camera 19a estimated by the deviation estimation unit 25c is stored in the storage unit 27.
  • the installation information is information related to at least one of the horizontal position, vertical position, and shooting direction (including tilt) of the camera 19a. Obtained by pattern matching between the installation information obtained based on the image previously captured by the camera 19a and the images at various positions previously stored in the storage unit 27 by the control unit 25 based on the next captured image.
  • the determination by the first determination unit may be performed when the difference from the position information exceeds a predetermined range.
  • the position confirmation of the cooking status recognition unit 19 is performed when cooking is not performed, but is not limited thereto.
  • the marker information is extracted based on the image captured by the camera 19a of the cooking status recognition unit 19, and the determination by the first determination unit 25b is performed, so that there is a change in the installation state of the camera 19a.
  • the change in the installation state is a change in at least one of the horizontal position, vertical position, and shooting direction (including tilt) of the camera 19a.
  • the guidance information output unit 29 causes the notification unit 4 to output guidance information.
  • the guidance information is notified to the user from the notification unit 4.
  • the deviation estimation unit 25c may instruct the coil control unit 10 to stop heating the heating coils 7A to 7C. Thereby, the coil control unit 10 stops the heating from the heating coils 7A to 7C.
  • the marker is printed on the top plate 5, but the present invention is not limited to this.
  • the guidance information output unit 29 may use a specified symbol or pattern displayed on the display unit 11 as marker information.
  • the heating cooker 1 is an induction heating cooker that induction-heats the container Cr using the heating coils 7A to 7C, but is not limited thereto.
  • the cooking device 1 may be a gas cooking device.
  • the container Cr is placed on the five virtues as a container placement portion provided on the top plate 5 of the main body 3, and is heated from below by a gas burner as a heating portion.
  • the heating cooker 1 includes the marker extraction unit 25a, the first determination unit 25b, the shift estimation unit 25c, and the second determination unit 35. At least one of these includes a mobile terminal or the like May be provided in the external device. In that case, the cooking system includes an external device.

Landscapes

  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Induction Heating Cooking Devices (AREA)

Abstract

A heating cooking system, provided with: a top plate having marker information; a heating unit; a heating control unit for controlling the amount of heating of a cooking container by the heating unit; a camera disposed at a position set away from the top plate, the camera pointing at the top plate; a marker information extraction unit for extracting the marker information included in an image captured by the camera; a first determining unit for determining whether or not the extracted marker information is included in a stipulated range of the image; and a notification unit for notifying the installation state of the camera on the basis of the result of the determination by the first determining unit.

Description

加熱調理システムおよび加熱調理器を撮影するカメラの設置状態を報知する方法Heat cooking system and method for notifying the installation state of a camera for photographing a heating cooker
 本開示は、加熱調理システムと、加熱調理器を撮影するカメラの設置状態を報知する方法に関する。 The present disclosure relates to a heating cooking system and a method for notifying an installation state of a camera that photographs a cooking device.
 従来、調理される被加熱物の調理状況を認識する調理状況認識部を備える加熱調理器がある。 Conventionally, there is a cooking device equipped with a cooking status recognition unit that recognizes the cooking status of a heated object to be cooked.
 例えば、特許文献1の加熱調理器では、レンジフードに温度センサが配置されている。温度センサは、加熱調理器により加熱される調理物の温度を測定する。測定された温度に応じて、レンジフードの風量が制御される。このように、特許文献1には、調理状況認識部として、温度センサを用いて調理状況を認識することが記載されている。 For example, in the heating cooker of Patent Document 1, a temperature sensor is arranged in the range hood. The temperature sensor measures the temperature of the food to be heated by the cooking device. The air volume of the range hood is controlled according to the measured temperature. As described above, Patent Literature 1 describes that the cooking status recognition unit recognizes the cooking status using the temperature sensor.
日本国特許第5887481号公報Japanese Patent No. 5887481
 被加熱物の調理状況を認識するために、加熱調理器の上方にカメラを設置することで、より詳細な調理情報を得ることが予想される。しかしながら、カメラの位置ずれにより、被加熱物または被加熱物を収容する鍋を適切に撮影することができない場合がある。 It is expected that more detailed cooking information can be obtained by installing a camera above the cooking device in order to recognize the cooking status of the object to be heated. However, there may be a case where the object to be heated or the pan that accommodates the object to be heated cannot be properly photographed due to the displacement of the camera.
 したがって、本開示の目的は、前記課題を解決することにあって、加熱調理器を上方から撮影するカメラの位置ずれの有無をユーザに認識させることにより、適切な撮影を実現することにある。 Therefore, an object of the present disclosure is to solve the above-described problem, and to realize appropriate photographing by making the user recognize the presence / absence of a positional deviation of a camera that photographs the cooking device from above.
 前記目的を達成するために、本開示の一態様に係る加熱調理システムは、トッププレートと、加熱部と、加熱制御部と、カメラと、マーカ情報抽出部と、第1判定部と、報知部と、を備える。前記トッププレートは、被加熱物を収容する容器が載置され、マーカ情報を有する。前記加熱部は、前記容器を下方から加熱する。前記加熱制御部は、前記加熱部から前記容器への加熱量を制御する。前記カメラは、前記トッププレートから離れた位置に配置され、前記トッププレートに向けられる。前記マーカ情報抽出部は、前記カメラにより撮影された画像に含まれる前記マーカ情報を抽出する。前記第1判定部は、抽出されたマーカ情報が、前記画像の規定の範囲内に含まれている否かを判定する。前記報知部は、前記第1判定部による判定結果に基づいて、前記カメラの設置状態を報知する。 In order to achieve the above object, a cooking system according to one aspect of the present disclosure includes a top plate, a heating unit, a heating control unit, a camera, a marker information extraction unit, a first determination unit, and a notification unit. And comprising. On the top plate, a container for storing an object to be heated is placed and has marker information. The heating unit heats the container from below. The heating control unit controls a heating amount from the heating unit to the container. The camera is disposed at a position away from the top plate and is directed toward the top plate. The marker information extraction unit extracts the marker information included in an image photographed by the camera. The first determination unit determines whether or not the extracted marker information is included in a prescribed range of the image. The notification unit notifies the installation state of the camera based on a determination result by the first determination unit.
 また、本開示の一態様に係る、加熱調理器におけるカメラの設置状態を報知する方法は、被加熱物を収容する容器が載置され、マーカ情報を有するトッププレートと、前記容器を下方から加熱する加熱部と、を備えた加熱調理器を撮影するカメラの設置状態を報知する方法である。この方法では、前記カメラにより撮影された画像を入力する。また、前記画像に含まれる前記マーカ情報を抽出する。また、前記抽出されたマーカ情報が、前記画像の規定の範囲内に含まれているか否かを判定する。また、その判定結果に基づいて、前記カメラの設置状態を報知する報知信号を出力する。 In addition, according to one aspect of the present disclosure, a method for notifying the installation state of a camera in a heating cooker includes: a top plate on which a container that accommodates an object to be heated is placed; marker plate information; And a heating unit that performs a notification of an installation state of a camera that photographs a heating cooker. In this method, an image taken by the camera is input. In addition, the marker information included in the image is extracted. Further, it is determined whether or not the extracted marker information is included in a prescribed range of the image. Further, based on the determination result, a notification signal for notifying the installation state of the camera is output.
 本開示は、加熱調理器を上方から撮影するカメラの位置ずれの有無をユーザに認識させることにより、適切な撮影を実現できる。 The present disclosure can realize appropriate shooting by making the user recognize the presence or absence of a positional shift of the camera that shoots the cooking device from above.
実施の形態1に係る加熱調理システムの斜視図The perspective view of the heat cooking system which concerns on Embodiment 1. FIG. 加熱調理器の上面図Top view of cooking device 実施の形態1に係る加熱調理システムの制御系を示すブロック図The block diagram which shows the control system of the heat cooking system which concerns on Embodiment 1. FIG. 加熱調理システムの設置状態を示す側面図Side view showing the installed state of the cooking system カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera 調理状況認識部の位置修正の案内の一例を示す図The figure which shows an example of the guidance of the position correction of a cooking condition recognition part カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの設置状態の案内の一例を示す図The figure which shows an example of the guidance of the installation state of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera 調理状況認識部の位置修正の案内の一例を示す図The figure which shows an example of the guidance of the position correction of a cooking condition recognition part カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera 調理状況認識部の位置修正の案内の一例を示す図The figure which shows an example of the guidance of the position correction of a cooking condition recognition part カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera 調理状況認識部の位置修正の案内の一例を示す図The figure which shows an example of the guidance of the position correction of a cooking condition recognition part カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera 調理状況認識部の位置修正の案内の一例を示す図The figure which shows an example of the guidance of the position correction of a cooking condition recognition part 調理状況認識部の位置修正の案内の一例を示す図The figure which shows an example of the guidance of the position correction of a cooking condition recognition part カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera 調理状況認識部の位置修正の案内の一例を示す図The figure which shows an example of the guidance of the position correction of a cooking condition recognition part カメラ位置の修正案内の流れを示すフローチャートFlow chart showing the flow of camera position correction guidance カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera 実施の形態3に係る加熱調理システムの制御系を示すブロック図The block diagram which shows the control system of the heat cooking system which concerns on Embodiment 3. FIG. 加熱調理システムの設置状態を示す側面図Side view showing the installed state of the cooking system カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera 調理状況認識部の高さ位置を説明する図The figure explaining the height position of a cooking condition recognition part カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラの撮影画像の一例を示す図The figure which shows an example of the picked-up image of a camera カメラ位置の修正案内の流れを示すフローチャートFlow chart showing the flow of camera position correction guidance 実施の形態4に係る加熱調理システムの制御系を示すブロック図The block diagram which shows the control system of the heat cooking system which concerns on Embodiment 4. FIG. 実施の形態5に係る加熱調理システムの制御系を示すブロック図Block diagram showing a control system of a cooking system according to Embodiment 5 加熱調理システムの概略構成を説明する図The figure explaining schematic structure of a heating cooking system 実施の形態6に係る加熱調理システムの制御系を示すブロック図A block diagram showing a control system of a cooking system according to a sixth embodiment 調理状況認識部の検知部の下面図Bottom view of the detection unit of the cooking status recognition unit 加熱調理システムの概略構成を説明する図The figure explaining schematic structure of a heating cooking system 調整ガイド投影部から投影されるマーカの一例を示す図The figure which shows an example of the marker projected from the adjustment guide projection part 調整ガイド投影部から投影されるマーカの一例を示す図The figure which shows an example of the marker projected from the adjustment guide projection part 表示部の一例を示す図The figure which shows an example of a display part 加熱調理器の本体とカメラの撮影画像との位置関係を示す図The figure which shows the positional relationship of the main body of a heating cooker, and the picked-up image of a camera 表示部の一例を示す図The figure which shows an example of a display part 表示部の一例を示す図The figure which shows an example of a display part 表示部の一例を示す図The figure which shows an example of a display part 表示部の一例を示す図The figure which shows an example of a display part 加熱調理器の本体とカメラの撮影画像との位置関係を示す図The figure which shows the positional relationship of the main body of a heating cooker, and the picked-up image of a camera 加熱調理器の本体とカメラの撮影画像との位置関係を示す図The figure which shows the positional relationship of the main body of a heating cooker, and the picked-up image of a camera 加熱調理器の一例を示す上面図Top view showing an example of a cooking device 加熱調理器の本体とカメラの撮影画像との位置関係を示す図The figure which shows the positional relationship of the main body of a heating cooker, and the picked-up image of a camera 表示部に表示される案内情報の一例を示す図The figure which shows an example of the guidance information displayed on a display part 加熱調理器の本体とカメラの撮影画像との位置関係を示す図The figure which shows the positional relationship of the main body of a heating cooker, and the picked-up image of a camera 加熱調理システムの設置状態を示す側面図Side view showing the installed state of the cooking system 加熱調理器の本体とカメラの撮影画像との位置関係を示す図The figure which shows the positional relationship of the main body of a heating cooker, and the picked-up image of a camera 加熱調理システムの設置状態を示す側面図Side view showing the installed state of the cooking system 加熱調理器の本体とカメラの撮影画像との位置関係を示す図The figure which shows the positional relationship of the main body of a heating cooker, and the picked-up image of a camera
 本開示の一態様によれば、トッププレートと、加熱部と、加熱制御部と、カメラと、マーカ情報抽出部と、第1判定部と、報知部と、を備えた加熱調理システムが提供される。前記トッププレートは、被加熱物を収容する容器が載置され、マーカ情報を有する。前記加熱部は、前記容器を下方から加熱する。前記加熱制御部は、前記加熱部から前記容器への加熱量を制御する。前記カメラは、前記トッププレートから離れた位置に配置され、前記トッププレートに向けられる。前記マーカ情報抽出部は、前記カメラにより撮影された画像に含まれる前記マーカ情報を抽出する。前記第1判定部は、抽出されたマーカ情報が、前記画像の規定の範囲内に含まれている否かを判定する。前記報知部は、前記第1判定部による判定結果に基づいて、前記カメラの設置状態を報知する。 According to one aspect of the present disclosure, there is provided a cooking system including a top plate, a heating unit, a heating control unit, a camera, a marker information extraction unit, a first determination unit, and a notification unit. The On the top plate, a container for storing an object to be heated is placed and has marker information. The heating unit heats the container from below. The heating control unit controls a heating amount from the heating unit to the container. The camera is disposed at a position away from the top plate and is directed toward the top plate. The marker information extraction unit extracts the marker information included in an image photographed by the camera. The first determination unit determines whether or not the extracted marker information is included in a prescribed range of the image. The notification unit notifies the installation state of the camera based on a determination result by the first determination unit.
 前記第1判定部が、前記抽出されたマーカ情報が、前記画像の前記規定の範囲内に含まれていないと判定した場合、前記報知部は、前記カメラの異常な設置状態を報知してもよい。 When the first determination unit determines that the extracted marker information is not included in the specified range of the image, the notification unit may notify the abnormal installation state of the camera. Good.
 前記加熱調理システムは、前記カメラの前記異常な設置状態を、前記報知部を有する外部機器に無線通信する通信部を備えてもよい。前記第1判定部が、前記抽出されたマーカ情報が、前記画像の前記規定の範囲内に含まれていないと判定した場合、前記通信部は、前記カメラの前記異常な設置状態の情報を前記外部機器へ送信し、前記外部機器の前記報知部は、前記カメラの前記異常な設置状態を報知してもよい。 The heating cooking system may include a communication unit that wirelessly communicates the abnormal installation state of the camera to an external device having the notification unit. When the first determination unit determines that the extracted marker information is not included in the specified range of the image, the communication unit displays information on the abnormal installation state of the camera. The information may be transmitted to an external device, and the notification unit of the external device may notify the abnormal installation state of the camera.
 前記加熱調理システムは、前記抽出されたマーカ情報を基に、前記カメラの高さ位置が、規定の高さ位置の範囲に含まれている否かを判定する第2判定部を備えてもよい。前記第2判定部が、前記カメラの高さ位置が規定の高さ位置の範囲に含まれていないと判定した場合に、前記報知部は、前記カメラの前記異常な設置状態を報知してもよい。 The cooking system may include a second determination unit that determines whether or not the height position of the camera is included in a range of a specified height position based on the extracted marker information. . When the second determination unit determines that the height position of the camera is not included in the range of the specified height position, the notification unit may notify the abnormal installation state of the camera. Good.
 前記加熱調理システムは、前記カメラの前記設置状態に対応して、前記カメラの位置調整用の案内情報を出力する案内情報出力部を備えてもよい。前記案内情報出力部は、前記第1判定部により、前記抽出されたマーカ情報が、前記画像の前記規定の範囲内に含まれていないと判断された場合、前記抽出されたマーカ情報が前記画像の前記規定の範囲内に含まれるように、前記カメラの前記設置状態の変更を案内する前記案内情報を前記報知部に出力してもよい。 The cooking system may include a guide information output unit that outputs guide information for adjusting the position of the camera in accordance with the installation state of the camera. When the first determination unit determines that the extracted marker information is not included in the specified range of the image, the guidance information output unit stores the extracted marker information in the image The guidance information for guiding the change of the installation state of the camera may be output to the notification unit so as to be included in the prescribed range.
 前記加熱調理システムは、前記カメラの前記設置状態に対応して、前記カメラの位置調整用の案内情報を出力する案内情報出力部を備えてもよい。前記案内情報出力部は、前記第2判定部により、前記カメラの前記高さ位置が前記規定の高さ位置の範囲に含まれていないと判定された場合に、前記前記カメラの高さ位置が前記規定の高さ位置の範囲に含まれるように、前記カメラの前記設置状態の変更を案内する前記案内情報を前記報知部に出力してもよい。 The cooking system may include a guide information output unit that outputs guide information for adjusting the position of the camera in accordance with the installation state of the camera. When the second determination unit determines that the height position of the camera is not included in the range of the specified height position, the guidance information output unit determines the height position of the camera. You may output the said guidance information which guides the change of the said installation state of the said camera to the said alerting | reporting part so that it may be contained in the range of the said specified height position.
 前記加熱調理システムは、前記抽出されたマーカ情報の歪みを基に、前記カメラの前記設置状態に関する設置情報として、前記カメラの前記高さ位置を推定するカメラ位置推定部を有してもよい。前記案内情報出力部は、推定された前記高さ位置に対応する予め記録された位置調整データに応じて前記案内情報を出力してもよい。 The heating cooking system may include a camera position estimating unit that estimates the height position of the camera as installation information related to the installation state of the camera based on distortion of the extracted marker information. The guide information output unit may output the guide information according to position adjustment data recorded in advance corresponding to the estimated height position.
 前記加熱調理システムは、推定された前記設置情報を記録する記憶部を備えてもよい。前記カメラが前回撮影した前記画像を基に得られた前記設置情報と、その後に撮影した画像を基に得られた設置情報との差異が既定の範囲を超えた場合に、前記第1判定部による判定が実施されてもよい。 The heating cooking system may include a storage unit that records the estimated installation information. When the difference between the installation information obtained based on the image taken by the camera last time and the installation information obtained based on the image taken thereafter exceeds a predetermined range, the first determination unit The determination by may be performed.
 前記カメラは、前記被加熱物の加熱調理中にも撮影を行ってもよい。前記第1判定部は、前記被加熱物の加熱調理中にも判定を行うことで、前記カメラの前記設置状態の変化の有無が検出されてもよい。前記設置状態の前記変化が検出された場合、前記案内情報出力部は前記案内情報を出力してもよく、または、前記加熱制御部は前記加熱部からの加熱を停止してもよい。 The camera may take a picture during cooking of the object to be heated. The first determination unit may detect whether or not the installation state of the camera has changed by making a determination even during cooking of the object to be heated. When the change in the installation state is detected, the guide information output unit may output the guide information, or the heating control unit may stop heating from the heating unit.
 前記マーカ情報を規定位置、規定色、および、規定順の少なくとも1つで、点灯、または、点滅させてもよい。 The marker information may be turned on or blinked in at least one of a specified position, a specified color, and a specified order.
 前記案内情報出力部は、前記マーカ情報として規定の記号または文様を表示してもよい。 The guidance information output unit may display a specified symbol or pattern as the marker information.
 前記外部機器は、表示部および音声出力部の少なくとも1つを有する、携帯端末または家の中に配置される統合制御部であってもよい。 The external device may be a mobile terminal or an integrated control unit disposed in a house having at least one of a display unit and an audio output unit.
 前記加熱調理システムは、前記カメラの撮影方向を電動で調整可能な電動駆動部を備えてもよい。前記第1判定部が、前記抽出されたマーカ情報が、前記画像の前記規定の範囲内に含まれると判断するように、前記電動駆動部は、自動で前記カメラの撮影方向を調整してもよい。 The heating cooking system may include an electric drive unit that can electrically adjust the shooting direction of the camera. The electric drive unit may automatically adjust the shooting direction of the camera so that the first determination unit determines that the extracted marker information is included in the prescribed range of the image. Good.
 前記加熱調理システムは、前記カメラと、前記トッププレートから離れた位置に配置され、前記トッププレートに向けられた温度検知部を含む調理状況認識部を備えてもよい。前記カメラと前記温度検知部とが同じ方向に向けて配置されていてもよい。 The cooking system may include the camera and a cooking status recognition unit that is disposed at a position away from the top plate and includes a temperature detection unit directed to the top plate. The camera and the temperature detection unit may be arranged in the same direction.
 前記加熱調理システムは、前記トッププレートから離れた位置に配置され、前記トッププレートに向けられたガイド投影部を備えてもよい。前記トッププレートは、規定の調整目標位置を示す目標マーカを有してもよい。前記ガイド投影部は、前記カメラの撮影方向を示す投影マーカを投影可能であってもよい。前記目標マーカと前記投影マーカとの物理的な距離の差異を縮めることにより、前記カメラの前記撮影方向を調整可能であってもよい。 The heating cooking system may include a guide projection unit disposed at a position away from the top plate and directed toward the top plate. The top plate may have a target marker indicating a predetermined adjustment target position. The guide projection unit may be capable of projecting a projection marker indicating a shooting direction of the camera. It may be possible to adjust the shooting direction of the camera by reducing a difference in physical distance between the target marker and the projection marker.
 前記加熱調理システムは前記トッププレートから離れた位置に配置され、前記トッププレートに向けられたガイド投影部を備えてもよい。前記トッププレートは、規定の調整目標位置を示す目標マーカを有してもよい。前記ガイド投影部は、前記カメラの前記撮影方向を示す投影マーカを投影可能であってもよい。前記目標マーカと前記投影マーカとの物理的な距離の差異を縮めることにより、前記カメラの前記撮影方向を調整可能であってもよい。 The heating cooking system may be provided at a position away from the top plate and may include a guide projection unit directed to the top plate. The top plate may have a target marker indicating a predetermined adjustment target position. The guide projection unit may be capable of projecting a projection marker indicating the shooting direction of the camera. It may be possible to adjust the shooting direction of the camera by reducing a difference in physical distance between the target marker and the projection marker.
 前記加熱部は、前記容器を加熱するために誘導磁界を発生させる加熱コイルを有してもよい。前記加熱制御部は、前記加熱コイルに高周波電流を供給して前記容器の加熱を行ってもよい。 The heating unit may include a heating coil that generates an induction magnetic field to heat the container. The heating control unit may heat the container by supplying a high frequency current to the heating coil.
 前記トッププレートが有する前記マーカ情報は、前記カメラにより撮影された画像において前記カメラの認識可能画素数の1/100以上になる大きさであってもよい。 The marker information of the top plate may be a size that is 1/100 or more of the number of recognizable pixels of the camera in an image taken by the camera.
 前記カメラから前記トッププレートまでの距離は600mm以上、2000mm以下であってもよい。 The distance from the camera to the top plate may be 600 mm or more and 2000 mm or less.
 また、本開示の一態様によれば、被加熱物を収容する容器が載置され、マーカ情報を有するトッププレートと、前記容器を下方から加熱する加熱部と、を備えた加熱調理器を撮影するカメラの設置状態を報知する方法が提供される。この方法では、前記カメラにより撮影された画像を入力する。また、前記画像に含まれる前記マーカ情報を抽出する。また、前記抽出されたマーカ情報が、前記画像の規定の範囲内に含まれているか否かを判定する。また、その判定結果に基づいて、前記カメラの設置状態を報知する報知信号を出力する。 Moreover, according to one aspect of the present disclosure, a heating cooker including a top plate that has a container for storing an object to be heated and has marker information and a heating unit that heats the container from below is photographed. A method for notifying the installation state of a camera is provided. In this method, an image taken by the camera is input. In addition, the marker information included in the image is extracted. Further, it is determined whether or not the extracted marker information is included in a prescribed range of the image. Further, based on the determination result, a notification signal for notifying the installation state of the camera is output.
 (実施の形態1)
 以下に、本開示の実施の形態1に係る加熱調理システムについて図1から図4を参照して説明する。図1は、本開示の実施の形態1に係る加熱調理システム100の斜視図である。図2は、実施の形態1に係る加熱調理器1の上面図である。図3は、加熱調理システム100の制御系を示すブロック図である。図4は、加熱調理システムの設置状態を示す側面図である、なお、図において、X軸方向は、上面から見た場合の加熱調理器1の長手方向を示し、Y軸方向は前後方向を示し、Z軸方向は高さ方向を示す。また、X軸の正の方向を右方、負の方向を左方とする。またY軸の正の方向を後方、負の方向を前方とする。
(Embodiment 1)
Hereinafter, the cooking system according to Embodiment 1 of the present disclosure will be described with reference to FIGS. 1 to 4. FIG. 1 is a perspective view of a cooking system 100 according to Embodiment 1 of the present disclosure. FIG. 2 is a top view of the heating cooker 1 according to the first embodiment. FIG. 3 is a block diagram showing a control system of the heating cooking system 100. FIG. 4 is a side view showing an installation state of the cooking system. In the figure, the X-axis direction indicates the longitudinal direction of the heating cooker 1 when viewed from above, and the Y-axis direction indicates the front-rear direction. The Z-axis direction indicates the height direction. Further, the positive direction of the X axis is the right side, and the negative direction is the left side. The positive direction of the Y axis is the rear and the negative direction is the front.
 図1に示すように、加熱調理システム100は、加熱調理器1と、調理状況認識部19とを備える。加熱調理器1は、本体3と、本体3の上側部として、容器Crが載置されるトッププレート5を有する。容器Crには、例えば、シチューなどの調理対象としての被加熱物Tcが収容されている。 As shown in FIG. 1, the cooking system 100 includes a cooking device 1 and a cooking status recognition unit 19. The heating cooker 1 includes a main body 3 and a top plate 5 on which the container Cr is placed as an upper portion of the main body 3. In the container Cr, for example, a heated object Tc as a cooking target such as a stew is accommodated.
 また、実施の形態1の場合、加熱調理器1は、誘導加熱調理器であって、図1に示すように、トッププレート5における容器載置領域の下方には、本体3の内部に加熱調理器1の加熱部として加熱コイル7A、7B、7Cが配置されている。容器載置領域を示すリング状のマーカ8A、8B、8Cが、それぞれ、対応する加熱コイル7A、7B、7Cの上方のトッププレート5上に印刷されている。加熱コイル7A~7Cは、容器Crを加熱するために誘導磁界を発生させる。コイル制御部10は、加熱コイル7A~7Cに高周波電流を供給して容器Crの加熱を行う。また、コイル制御部10は、加熱コイル7A~7Cに流す電流量を制御する。 Moreover, in the case of Embodiment 1, the heating cooker 1 is an induction heating cooker, Comprising: As shown in FIG. 1, below the container mounting area | region in the top plate 5, it cooks in the inside of the main body 3. Heating coils 7 </ b> A, 7 </ b> B, and 7 </ b> C are arranged as heating portions of the vessel 1. Ring-shaped markers 8A, 8B, and 8C indicating the container placement areas are printed on the top plate 5 above the corresponding heating coils 7A, 7B, and 7C, respectively. The heating coils 7A to 7C generate an induction magnetic field to heat the container Cr. The coil controller 10 supplies the high frequency current to the heating coils 7A to 7C to heat the container Cr. The coil controller 10 controls the amount of current that flows through the heating coils 7A to 7C.
 また、上面視において、加熱コイル7A、7B、7Cのそれぞれの外側には、リング状に光る発光部6A、6B、6Cがトッププレ-ト5に配置されている。発光部6A、6B、6Cは、例えば、対応するそれぞれの加熱コイル7A、7B、7Cに電流が流れているときに発光する。発光部6A~6Cは、例えば、LED発光基板を有する。 Further, in the top view, the light emitting portions 6A, 6B, and 6C that shine in a ring shape are arranged on the top plate 5 outside the heating coils 7A, 7B, and 7C, respectively. For example, the light emitting units 6A, 6B, and 6C emit light when current flows through the corresponding heating coils 7A, 7B, and 7C. The light emitting units 6A to 6C have, for example, LED light emitting substrates.
 加熱コイル7A~7Cのそれぞれをユーザが操作するための操作部として、複数の操作入力部9A、9B、9Cが加熱調理器1のトッププレート5の前側に配置されている。操作入力部9A~9Cは、例えば、タッチキーでもよいし、タッチパネルでもよい。また、操作入力部9Aと加熱コイル7A、操作入力部9Bと加熱コイル7B、操作入力部9Cと加熱コイル7Cとは、それぞれ対応している。操作入力部9Aが受け付けた操作指示に応じて、コイル制御部10は、加熱コイル7Aの加熱の開始または停止を制御する。また、操作入力部9Aが受け付けた操作指示に応じて、コイル制御部10は、加熱コイル7Aの加熱レベルを例えば4段階に調節する。同様に、操作入力部9Bが受け付けた操作指示に応じて、コイル制御部10は、加熱コイル7Bの加熱を制御する。また、操作入力部9Cが受け付けた操作指示に応じて、コイル制御部10は、加熱コイル7Cの加熱を制御する。 A plurality of operation input units 9A, 9B, and 9C are arranged on the front side of the top plate 5 of the heating cooker 1 as operation units for the user to operate each of the heating coils 7A to 7C. The operation input units 9A to 9C may be touch keys or a touch panel, for example. The operation input unit 9A and the heating coil 7A, the operation input unit 9B and the heating coil 7B, and the operation input unit 9C and the heating coil 7C correspond to each other. In response to the operation instruction received by the operation input unit 9A, the coil control unit 10 controls the start or stop of heating of the heating coil 7A. Moreover, according to the operation instruction received by the operation input unit 9A, the coil control unit 10 adjusts the heating level of the heating coil 7A in, for example, four stages. Similarly, the coil control unit 10 controls the heating of the heating coil 7B according to the operation instruction received by the operation input unit 9B. Further, the coil control unit 10 controls the heating of the heating coil 7C according to the operation instruction received by the operation input unit 9C.
 また、本体3は、加熱コイル7A~7Cの加熱に関する情報を報知する報知部4を備える。報知部4は、表示部11と音声出力部15とを有する。表示部11は加熱調理器1のトッププレート5の前側に配置され、加熱コイル7A~7Cの加熱レベルを表示する。表示部11は、例えば、トッププレート5の長手方向に延びる帯形状を有する。表示部11は、白黒の液晶パネルであるが、カラーの液晶パネルでもよい。 The main body 3 includes a notification unit 4 that notifies information related to heating of the heating coils 7A to 7C. The notification unit 4 includes a display unit 11 and an audio output unit 15. The display unit 11 is disposed on the front side of the top plate 5 of the heating cooker 1 and displays the heating level of the heating coils 7A to 7C. The display unit 11 has, for example, a band shape extending in the longitudinal direction of the top plate 5. The display unit 11 is a monochrome liquid crystal panel, but may be a color liquid crystal panel.
 なお、ユーザが加熱コイル7A~7Cによる加熱を詳細に設定するために、設定部13が加熱調理器1の本体3の前面側に備えられている。設定部13は、本体3に対して出し入れ可能であって、加熱コイル7A~7Cによる加熱を詳細に設定するための設定キー13aと、その設定内容および加熱コイル7A~7Cの詳細な状態などを表示する設定表示部13bとを備える。この設定部13により、加熱コイル7A~7Cの加熱温度、加熱時間、およびタイマーなどが設定される。 A setting unit 13 is provided on the front side of the main body 3 of the heating cooker 1 in order for the user to set heating by the heating coils 7A to 7C in detail. The setting unit 13 can be inserted into and removed from the main body 3, and includes a setting key 13a for setting heating by the heating coils 7A to 7C in detail, the setting contents, the detailed state of the heating coils 7A to 7C, and the like. And a setting display unit 13b for displaying. The setting unit 13 sets the heating temperature, heating time, timer, and the like of the heating coils 7A to 7C.
 また、加熱調理器1は、ユーザに対して音声案内を出力する音声出力部15を、前面側に備える。音声出力部15は、例えば、スピーカである。 Moreover, the heating cooker 1 includes a voice output unit 15 that outputs voice guidance to the user on the front side. The audio output unit 15 is, for example, a speaker.
 加熱調理器1の上方には、レンジフード17が設置されている。レンジフード17は、加熱調理器1の上方の空気を、下部に設けられたフード部分17aを介してレンジフード17の内部に吸い込み、屋外に連通した吐出口から排気する。 A range hood 17 is installed above the heating cooker 1. The range hood 17 sucks the air above the heating cooker 1 into the inside of the range hood 17 through a hood portion 17a provided at the lower portion, and exhausts it from a discharge port communicated outdoors.
 また、加熱調理器1は、トッププレート5上の被加熱物Tcの調理状況を上方から認識する調理状況認識部19を備える。調理状況認識部19は、トッププレート5から離れた位置に配置され、例えば、レンジフード17のフード部分17aの中央部に配置されている。 Moreover, the heating cooker 1 includes a cooking status recognition unit 19 that recognizes the cooking status of the object to be heated Tc on the top plate 5 from above. The cooking status recognition unit 19 is disposed at a position away from the top plate 5, for example, at the center of the hood portion 17 a of the range hood 17.
 調理状況認識部19は、カメラ19aを有する。カメラ19aは、可視光カメラであり、例えば、CCD(Charge Coupled Device)カメラまたはCMOS(Complementary Metal Oxide Semiconductor)カメラである。カメラ19aは、適切な画角と撮影方向が設定されていれば、トッププレート5全体を上方から撮影可能である。なお、調理状況認識部19は、レンジフード17の他にも、天井または壁に配置されてもよい。調理状況認識部19からトッププレート5までの距離は400mm以上であり、例えば、600mm以上、2000mm以下である。つまり、カメラ19aは調理状況認識部19の外表面に露呈するため、カメラ19aからトッププレート5までの距離は400mm以上であり、例えば、600mm以上、2000mm以下である。 The cooking status recognition unit 19 has a camera 19a. The camera 19a is a visible light camera, for example, a CCD (Charge Coupled Device) camera or a CMOS (Complementary Metal Oxide Semiconductor) camera. The camera 19a can shoot the entire top plate 5 from above if an appropriate angle of view and shooting direction are set. The cooking status recognition unit 19 may be arranged on the ceiling or wall in addition to the range hood 17. The distance from the cooking status recognition unit 19 to the top plate 5 is 400 mm or more, for example, 600 mm or more and 2000 mm or less. That is, since the camera 19a is exposed on the outer surface of the cooking condition recognition unit 19, the distance from the camera 19a to the top plate 5 is 400 mm or more, for example, 600 mm or more and 2000 mm or less.
 本体3と調理状況認識部19との間の無線通信用に、本体3は通信部21を有し、調理状況認識部19は通信部23を有する。カメラ19aにより撮影された画像情報は、通信部23により送信され、通信部21により本体3で受信される。通信部21、23はそれぞれアンテナを有し、例えば、Wi-Fi(登録商標)、Bluetooth(登録商標)、または、BLE(Bluetooth Low Energy)などの無線通信により無線接続されている。なお、通信部21、23を備える替わりに有線により、本体3と調理状況認識部19とが接続されていてもよい。 For the wireless communication between the main body 3 and the cooking status recognition unit 19, the main body 3 has a communication unit 21, and the cooking status recognition unit 19 has a communication unit 23. Image information captured by the camera 19 a is transmitted by the communication unit 23 and received by the main body 3 by the communication unit 21. Each of the communication units 21 and 23 has an antenna and is wirelessly connected by wireless communication such as Wi-Fi (registered trademark), Bluetooth (registered trademark), or BLE (Bluetooth Low Energy). In addition, instead of providing the communication units 21 and 23, the main body 3 and the cooking status recognition unit 19 may be connected by wire.
 加熱調理器1は、本体3の内部に、制御部25、記憶部27、案内情報出力部29と、を備える。制御部25および案内情報出力部29は、例えばCPU(Central Processing Unit)またはマイクロプロセッサなどの処理装置または処理回路であって、ROM(Read Only Memory)、RAM(Random Access Memory)、ハードディスク、またはSSD(Solid State Drive)などの記憶部27に記憶されているプログラムを実行することによって種々の機能を果たすように構成されている。なお、制御部25、記憶部27、案内情報出力部29の少なくとも一つは、本体3に配置されるのではなく、調理状況認識部19に配置されていてもよい。 The heating cooker 1 includes a control unit 25, a storage unit 27, and a guidance information output unit 29 inside the main body 3. The control unit 25 and the guidance information output unit 29 are, for example, a processing device or processing circuit such as a CPU (Central Processing Unit) or a microprocessor, and are a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, or an SSD. Various functions are performed by executing a program stored in the storage unit 27 such as (Solid State Drive). Note that at least one of the control unit 25, the storage unit 27, and the guidance information output unit 29 may be arranged in the cooking status recognition unit 19 instead of being arranged in the main body 3.
 制御部25は、マーカ抽出部25aと、第1判定部25bと、ズレ推定部25cと、を備える。ズレ推定部25cは、本開示のカメラ位置推定部に相当する。マーカ抽出部25a、第1判定部25b、ズレ推定部25cは、それぞれ回路または装置などのハードウェアで構成されてもよく、ソフトウェアで構成されてもよい。また、マーカ抽出部25a、第1判定部25b、ズレ推定部25cは、それぞれ独立して構成されてもよく、一体で構成されてもよい。また、マーカ抽出部25a、第1判定部25b、ズレ推定部25cの少なくとも一つは、コイル制御部10と一体であってもよい。 The control unit 25 includes a marker extraction unit 25a, a first determination unit 25b, and a deviation estimation unit 25c. The deviation estimation unit 25c corresponds to the camera position estimation unit of the present disclosure. The marker extraction unit 25a, the first determination unit 25b, and the deviation estimation unit 25c may each be configured with hardware such as a circuit or a device, or may be configured with software. In addition, the marker extraction unit 25a, the first determination unit 25b, and the deviation estimation unit 25c may be configured independently or may be configured integrally. Further, at least one of the marker extraction unit 25a, the first determination unit 25b, and the deviation estimation unit 25c may be integrated with the coil control unit 10.
 マーカ抽出部25aは、カメラ19aにより撮影された画像に含まれるマーカ情報を抽出する。トッププレート5上には、マーカ8A~8C以外にも、表示部11および発光部6A~6Cがマーカ情報として表示されている。たとえば、これらのうち、少なくともいずれか1つがトッププレート5上に表示されていればよい。または、他のマーカ情報が表示されていてもよい。つまり、マーカ情報は、マーカ8A~8C、表示部11、発光部6A~6Cに限定されず、カメラの撮影方向の基準として認識されるものであればよい。 The marker extraction unit 25a extracts marker information included in an image photographed by the camera 19a. On the top plate 5, in addition to the markers 8A to 8C, the display unit 11 and the light emitting units 6A to 6C are displayed as marker information. For example, at least any one of these may be displayed on the top plate 5. Alternatively, other marker information may be displayed. That is, the marker information is not limited to the markers 8A to 8C, the display unit 11, and the light emitting units 6A to 6C, and may be any information that can be recognized as a reference for the shooting direction of the camera.
 トッププレート5が有するマーカ情報は、カメラ19aにより撮影された画像においてカメラ19aの認識可能画素数の1/100以上になる大きさである。これにより、マーカ情報を適切に抽出することができる。 The marker information that the top plate 5 has is a size that is 1/100 or more of the number of recognizable pixels of the camera 19a in the image taken by the camera 19a. Thereby, marker information can be extracted appropriately.
 第1判定部25bは、抽出されたマーカ情報が、規定の状態でカメラ19aの画像の規定の範囲内に含まれている否かを判定する。規定の状態とは、第1判定部25bが判定を実行するように指示された状態を意味する。たとえば規定の状態とは、「電源がONになったとき」の意味でもよく、「調理中は常に」の意味でもよく、その他「所定の条件下」の意味であってもよい。抽出されたマーカ情報が、規定の状態でカメラ19aの画像の規定の範囲内に含まれていると第1判定部25bが判定すると、報知部4から、調理状況認識部19が正しい方向に設置されていることが報知される。つまり報知部4は、カメラ19aの撮影方向が正しいことを報知する。 The first determination unit 25b determines whether or not the extracted marker information is included in a specified range of the image of the camera 19a in a specified state. The prescribed state means a state in which the first determination unit 25b is instructed to execute the determination. For example, the specified state may mean “when the power is turned on”, may mean “always during cooking”, or may mean “under certain conditions”. When the first determination unit 25b determines that the extracted marker information is included in the specified range of the image of the camera 19a in a specified state, the cooking state recognition unit 19 is installed in the correct direction from the notification unit 4. It is notified that it is being done. That is, the notification unit 4 notifies that the shooting direction of the camera 19a is correct.
 抽出されたマーカ情報が規定の状態でカメラ19aの画像の規定の範囲内に含まれていないと第1判定部25bが判定すると、ズレ推定部25cは、画像中のマーカ情報の位置を基に、規定のカメラ19aの設置状態からのズレの種類を推定する。カメラ19aの正常な設置状態を状態aとする。ズレの種類として、例えば、左方向に平行なズレのある状態b、右方向に平行なズレのある状態c、後方向に平行なズレのある状態d、前方向に平行なズレのある状態e、時計回りに回転したズレのある状態f、反時計回りに回転したズレのある状態g、設置された高さ位置が低くて画角が狭い状態hが挙げられる。ズレ推定部25cは、これらのズレの状態およびズレ量を画像処理により推定する。 When the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image of the camera 19a in a specified state, the deviation estimation unit 25c is based on the position of the marker information in the image. The type of deviation from the installation state of the prescribed camera 19a is estimated. The normal installation state of the camera 19a is defined as state a. As types of displacement, for example, a state b with a displacement parallel to the left direction, a state c with a displacement parallel to the right direction, a state d with a displacement parallel to the rear direction, and a state e with a displacement parallel to the front direction e. There are a state f in which there is a displacement rotated clockwise, a state g in which there is a displacement rotated counterclockwise, and a state h in which the installed height position is low and the angle of view is narrow. The deviation estimation unit 25c estimates the state of deviation and the amount of deviation by image processing.
 案内情報出力部29は、ズレ推定部25cが推定するカメラ19aのズレの種類およびズレ量に対応して、記憶部27に記憶されているカメラ19aの位置調整用の案内情報を表示部11および音声出力部15へ出力する。 The guide information output unit 29 displays the guide information for position adjustment of the camera 19a stored in the storage unit 27 in correspondence with the type and amount of shift of the camera 19a estimated by the shift estimation unit 25c. Output to the audio output unit 15.
 次に、図5を参照して、調理状況認識部19のカメラ19aの設置状態について説明する。なお、以下の例においては、トッププレート5上の表示部11がマーカ情報として用いられるが、表示部11の替わりに、例えば、一本の黒帯がトッププレート5上に表示されていてもよい。 Next, the installation state of the camera 19a of the cooking status recognition unit 19 will be described with reference to FIG. In the following example, the display unit 11 on the top plate 5 is used as the marker information. However, for example, a single black belt may be displayed on the top plate 5 instead of the display unit 11. .
 図5は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化して示している。図5の破線領域は、カメラ19aの画像19aaの領域を示す。マーカ抽出部25aは、画像19aaから、表示部11をマーカ情報として抽出する。マーカ情報の抽出方法は、テンプレートマッチングまたはエッジ検出等の画像処理を用いる。図5に示すように、抽出されたマーカ情報が規定の状態で規定の範囲内に含まれていると、表示部11に、例えば図6に示す、「正しい方向に設置されました」という表示がされる。また、音声出力部15からも同様に「正しい方向に設置されました」と音声案内が出力される。なお、記憶部27には、抽出されたマーカ情報が規定の状態で規定の範囲内に含まれている状態(状態a)として、図5の画像19aaが記憶されている。図5の画像19aaは、カメラ19aの適切な配置における画像データである。 FIG. 5 shows a simplified image of the camera 19a taken from above the heating cooker 1. The broken line area in FIG. 5 indicates the area of the image 19aa of the camera 19a. The marker extraction unit 25a extracts the display unit 11 as marker information from the image 19aa. The marker information extraction method uses image processing such as template matching or edge detection. As shown in FIG. 5, when the extracted marker information is included in a specified range in a specified state, the display 11 displays, for example, “Installed in the correct direction” shown in FIG. Is done. Similarly, the voice output unit 15 outputs a voice guidance saying “Installed in the correct direction”. Note that the storage unit 27 stores the image 19aa of FIG. 5 as a state (state a) in which the extracted marker information is included in a specified range in a specified state. An image 19aa in FIG. 5 is image data in an appropriate arrangement of the camera 19a.
 図7は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19aaを示している。図7は、カメラ19aの位置または撮影方向が左方へズレているので、画像19aaから抽出された表示部11は、丸破線31で示すように、右側で切れている。この状態を状態bとする。第1判定部25bは、抽出されたマーカ情報が、カメラ19aの画像19aaの規定の範囲内に含まれていないと判定する。ズレ推定部25cは、マーカ情報が画像19aaの右側で切れているので、カメラ19aの画角がより右側へ向くように案内情報出力部29へ指示する。案内情報出力部29は、図8に示すように、右矢印の案内情報を表示部11に表示させる。また、音声出力部15からは「右方向に向けてください」と音声案内が出力される。これらにより、ユーザにカメラ19aの位置を右方へ移動または撮影方向を右方へ向けるように案内することができる。 FIG. 7 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above. In FIG. 7, since the position of the camera 19 a or the shooting direction is shifted to the left, the display unit 11 extracted from the image 19 aa is cut off on the right side as indicated by a circular broken line 31. This state is referred to as state b. The first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa of the camera 19a. Since the marker information is cut off on the right side of the image 19aa, the deviation estimating unit 25c instructs the guidance information output unit 29 so that the angle of view of the camera 19a is further on the right side. As shown in FIG. 8, the guidance information output unit 29 causes the display unit 11 to display guidance information indicated by a right arrow. Further, the voice output unit 15 outputs a voice guidance “Please turn right”. Accordingly, the user can be guided to move the position of the camera 19a to the right or to turn the shooting direction to the right.
 図9は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19aaを示している。図9は、カメラ19aの位置または撮影方向が右方へズレているので、画像19aaから抽出された表示部11は、丸破線33で示すように、左側で切れている。この状態を状態cとする。したがって、第1判定部25bは、抽出されたマーカ情報が、カメラ19aの画像19aaの規定の範囲内に含まれていないと判定する。ズレ推定部25cは、マーカ情報が画像19aaの左側で切れているので、カメラ19aの画角がより左側へ向くように案内情報出力部29へ指示する。案内情報出力部29は、図10に示すように、左矢印の案内情報を表示部11に表示させる。また、音声出力部15からは「左方向に向けてください」と音声案内が出力される。これらにより、ユーザにカメラ19aの位置を左方へ移動または撮影方向を左方へ向けるように案内することができる。 FIG. 9 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above. In FIG. 9, since the position of the camera 19 a or the shooting direction is shifted to the right, the display unit 11 extracted from the image 19 aa is cut off on the left side as indicated by a circular broken line 33. This state is referred to as state c. Therefore, the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa of the camera 19a. Since the marker information is cut off on the left side of the image 19aa, the deviation estimating unit 25c instructs the guidance information output unit 29 so that the angle of view of the camera 19a is further on the left side. As shown in FIG. 10, the guide information output unit 29 causes the display unit 11 to display the guide information indicated by the left arrow. Further, the voice output unit 15 outputs a voice guidance “Please turn left”. Thus, the user can be guided to move the position of the camera 19a to the left or to turn the shooting direction to the left.
 図11は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19aaを示している。図11は、カメラ19aの位置または撮影方向が後方へズレているので、画像19aaからはマーカ情報として表示部11が抽出されない。この状態を状態dとする。したがって、第1判定部25bは、カメラ19aの画像19aaの規定の範囲内にマーカ情報が含まれていないと判定する。ズレ推定部25cは、マーカ情報が画像19aa内に含まれていないので、カメラ19aの画角がより前方へ向くように案内情報出力部29へ指示する。案内情報出力部29は、図12に示すように、前向きの矢印の案内情報を表示部11に表示させる。また、音声出力部15からは「手前に向けてください」と音声案内が出力される。これらにより、ユーザにカメラ19aの位置を前方へ移動または撮影方向を前方へ向けるように案内することができる。 FIG. 11 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above. In FIG. 11, the display unit 11 is not extracted as marker information from the image 19aa because the position or shooting direction of the camera 19a is shifted backward. This state is referred to as state d. Therefore, the first determination unit 25b determines that the marker information is not included in the specified range of the image 19aa of the camera 19a. Since the marker information is not included in the image 19aa, the deviation estimation unit 25c instructs the guidance information output unit 29 so that the angle of view of the camera 19a is directed further forward. As shown in FIG. 12, the guide information output unit 29 causes the display unit 11 to display guide information of a forward arrow. Further, the voice output unit 15 outputs a voice guidance “Please turn to the front”. Thus, it is possible to guide the user to move the position of the camera 19a forward or to turn the shooting direction forward.
 図13は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19aaを示している。図13は、カメラ19aの位置または撮影方向が前方へズレているので、画像19aaから抽出された表示部11から画像下端までの距離PL間に、予め定められた数以上の画素数を含む。この状態を状態eとする。したがって、第1判定部25bは、抽出されたマーカ情報が、規定の状態でカメラ19aの画像19aaの規定の範囲内に含まれていないと判定する。ズレ推定部25cは、マーカ情報が画像19aaの前端から大きく離れているので、カメラ19aの画角がより後方へ向くように案内情報出力部29へ指示する。案内情報出力部29は、図14に示すように、後ろ向きの矢印の案内情報を表示部11に表示させる。また、音声出力部15からは「奥に向けてください」と音声案内が出力される。これらにより、ユーザにカメラ19aの位置を後方へ移動または撮影方向を後方へ向けるように案内することができる。 FIG. 13 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above. In FIG. 13, since the position or shooting direction of the camera 19a is shifted forward, the number of pixels equal to or larger than a predetermined number is included in the distance PL from the display unit 11 extracted from the image 19aa to the lower end of the image. This state is referred to as state e. Therefore, the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa of the camera 19a in a specified state. Since the marker information is far away from the front end of the image 19aa, the deviation estimation unit 25c instructs the guidance information output unit 29 so that the angle of view of the camera 19a is directed further rearward. As shown in FIG. 14, the guidance information output unit 29 causes the display unit 11 to display guidance information with a backward arrow. Further, the voice output unit 15 outputs a voice guidance “Please turn to the back”. Thus, it is possible to guide the user to move the position of the camera 19a backward or to turn the shooting direction backward.
 図15は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19aaを示している。図15は、カメラ19aの撮影方向が時計回りに回転ズレしているので、画像19aaから抽出された表示部11の左前端部が切れている。この状態を状態fとする。したがって、第1判定部25bは、抽出されたマーカ情報が、規定の状態でカメラ19aの画像19aaの規定の範囲内に含まれていないと判定する。ズレ推定部25cは、画像19aaの前辺19abと表示部11の長手方向の直線部分との成す角度からカメラ19aの画角をより反時計回りに回転させるように案内情報出力部29へ指示する。案内情報出力部29は、図16に示すように、反時計回りの矢印の案内情報を表示部11に表示させる。また、音声出力部15からは「反時計回りに動かして下さい」と音声案内が出力される。これらにより、ユーザにカメラ19aを反時計回りに回転させるように案内することができる。また、回転角度もイメージと数字の両方で表示されてもよい。 FIG. 15 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above. In FIG. 15, since the photographing direction of the camera 19a is rotated clockwise, the left front end portion of the display unit 11 extracted from the image 19aa is cut off. This state is referred to as state f. Therefore, the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa of the camera 19a in a specified state. The deviation estimation unit 25c instructs the guidance information output unit 29 to rotate the angle of view of the camera 19a more counterclockwise from the angle formed by the front side 19ab of the image 19aa and the linear portion of the display unit 11 in the longitudinal direction. . As shown in FIG. 16, the guide information output unit 29 causes the display unit 11 to display the guide information of the counterclockwise arrow. The voice output unit 15 outputs a voice guidance “Please move counterclockwise”. Thus, the user can be guided to rotate the camera 19a counterclockwise. Also, the rotation angle may be displayed as both an image and a number.
 また、カメラ19aの撮影方向が反時計回りに回転ズレしている場合も、第1判定部25bは、抽出されたマーカ情報が、規定の状態でカメラ19aの画像19aaの規定の範囲内に含まれていないと判定する。この状態を状態gとする。ズレ推定部25cは、画像19aaの前辺19abと表示部11の長手方向の直線部分との成す角度からカメラ19aの画角を時計回りに回転させるように案内情報出力部29へ指示する。案内情報出力部29は、図17に示すように、時計回りの矢印の案内情報を表示部11に表示させる。また、音声出力部15からは「時計回りに動かしてください」と音声案内が出力される。これらにより、ユーザにカメラ19aを時計回りに回転させるように案内することができる。また、回転角度もイメージと数字の両方で表示されてもよい。 Further, even when the shooting direction of the camera 19a is rotated counterclockwise, the first determination unit 25b includes the extracted marker information within the specified range of the image 19aa of the camera 19a in a specified state. Judge that it is not. This state is referred to as state g. The deviation estimation unit 25c instructs the guidance information output unit 29 to rotate the angle of view of the camera 19a clockwise from the angle formed by the front side 19ab of the image 19aa and the linear portion of the display unit 11 in the longitudinal direction. As shown in FIG. 17, the guide information output unit 29 causes the display unit 11 to display clockwise arrow guide information. The voice output unit 15 outputs a voice guidance “Please move clockwise”. Thus, the user can be guided to rotate the camera 19a clockwise. Also, the rotation angle may be displayed as both an image and a number.
 図18は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19aaを示している。図18は、カメラ19aの設置位置がトッププレート5から充分に離れていない、すなわち、カメラ19aの高さ位置が低いので、画像19aaにおいて、抽出された表示部11は、丸破線38で示すように、両端が切れている。この状態を状態hとする。したがって、第1判定部25bは、抽出されたマーカ情報が、規定の状態でカメラ19aの画像19aaの規定の範囲内に含まれていないと判定する。 FIG. 18 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above. In FIG. 18, since the installation position of the camera 19a is not sufficiently separated from the top plate 5, that is, the height position of the camera 19a is low, the extracted display unit 11 in the image 19aa is indicated by a circular broken line 38. Both ends are cut off. This state is referred to as state h. Therefore, the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa of the camera 19a in a specified state.
 ズレ推定部25cは、マーカ情報が画像19aaの両側で切れているので、カメラ19aの設置位置をより高い位置へと移動するように案内情報出力部29へ指示する。案内情報出力部29は、例えば、図20に示すように、「設置する高さを上げてください」との案内情報を表示部11に表示させる。また、音声出力部15からは、例えば、「設置する高さを上げて下さい」と音声案内が出力される。これらにより、ユーザにカメラ19aの設置位置の高さを上げるように案内することができる。 The shift estimation unit 25c instructs the guide information output unit 29 to move the installation position of the camera 19a to a higher position because the marker information is cut off on both sides of the image 19aa. For example, as shown in FIG. 20, the guidance information output unit 29 causes the display unit 11 to display guidance information “please raise the installation height”. Further, the voice output unit 15 outputs a voice guidance such as “Please raise the installation height”, for example. Thus, the user can be guided to increase the height of the installation position of the camera 19a.
 また、図19は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19aaを示している。図19は、カメラ19aの設置位置がトッププレート5から充分に離れていない、すなわち、カメラ19aの高さ位置が低いので、画像19aaにおいて、表示部11が抽出されていない。また、画像19aaには、マーカ8Cの一部が切れており、その全体が画像19aa内に含まれていない。この状態も状態hとする。このように、画像19aaに表示部11とマーカ8Cの一部が含まれていないことから、第1判定部25bは、抽出されたマーカ情報が、規定の状態でカメラ19aの画像19aaの規定の範囲内に含まれていないと判定する。 FIG. 19 shows an image 19aa obtained by simplifying an image taken by the camera 19a from above. In FIG. 19, since the installation position of the camera 19a is not sufficiently separated from the top plate 5, that is, the height position of the camera 19a is low, the display unit 11 is not extracted in the image 19aa. Further, the image 19aa has a part of the marker 8C cut off, and the entire image 19aa is not included in the image 19aa. This state is also referred to as state h. Thus, since the image 19aa does not include a part of the display unit 11 and the marker 8C, the first determination unit 25b determines that the extracted marker information is in the specified state of the image 19aa of the camera 19a. It is determined that it is not included in the range.
 ズレ推定部25cは、画像19aa内に、表示部11とマーカ8Cの一部とが含まれていないことから、カメラ19aの設置位置が低い状態であると推定し、より高い位置へと移動するように案内情報出力部29へ指示する。案内情報出力部29は、図20に示すように、「設置する高さを上げてください」との案内情報を表示部11に表示させることで、ユーザにカメラ19aの設置位置の高さを上げるように案内することができる。 Since the image 19aa does not include the display unit 11 and part of the marker 8C, the deviation estimation unit 25c estimates that the installation position of the camera 19a is low and moves to a higher position. The guidance information output unit 29 is instructed as follows. As shown in FIG. 20, the guidance information output unit 29 displays guidance information “Please raise the installation height” on the display unit 11, thereby increasing the height of the installation position of the camera 19 a to the user. Can be guided.
 なお、表示部11として、カラー液晶パネルが採用されている場合、ズレ量に応じて表示色を変えてもよい。例えば、ズレ量が大きい場合、赤色または暖色系で案内表示してもよい。また、例えば、ズレ量が小さい場合、青色または寒色系で案内表示してもよい。 In addition, when a color liquid crystal panel is adopted as the display unit 11, the display color may be changed according to the amount of deviation. For example, when the amount of deviation is large, guidance display may be performed in red or warm colors. For example, when the amount of deviation is small, guidance display may be performed in blue or cold colors.
 次に、調理状況認識部19の設置案内の流れについて、図21を参照して説明する。図21は、カメラ位置の案内の流れを示すフローチャートである。調理状況認識部19の設置状態の確認は、加熱調理器1を初めて設置したときに工事設置業者により行われるか、または、加熱調理器1の故障に対応したときに一般ユーザにより行われる。 Next, the flow of installation guidance for the cooking status recognition unit 19 will be described with reference to FIG. FIG. 21 is a flowchart showing the flow of camera position guidance. Confirmation of the installation state of the cooking status recognition unit 19 is performed by a construction installer when the heating cooker 1 is installed for the first time, or by a general user when a failure of the heating cooker 1 is dealt with.
 ユーザは、レンジフード17に調理状況認識部19を取り付けると、設定キー13aからの入力により調理状況認識部19の方向調整モードを起動する。方向調整モードが起動すると、ステップS1において、制御部25は、カメラ19aに撮影指示を送る。 When the user attaches the cooking status recognition unit 19 to the range hood 17, the direction adjustment mode of the cooking status recognition unit 19 is activated by an input from the setting key 13a. When the direction adjustment mode is activated, in step S1, the control unit 25 sends a shooting instruction to the camera 19a.
 カメラ19aは、撮影指示を受信すると、ステップS2において、画像を撮影する。撮影された画像は、制御部25へ送られる。 When the camera 19a receives the shooting instruction, the camera 19a takes an image in step S2. The captured image is sent to the control unit 25.
 次に、ステップS3において、マーカ抽出部25aは、制御部25へ送られた画像からマーカ情報を抽出する。マーカ情報の抽出は、テンプレートマッチングまたは特徴点抽出などの画像処理技術を用いて行う。 Next, in step S3, the marker extraction unit 25a extracts marker information from the image sent to the control unit 25. The marker information is extracted using image processing techniques such as template matching or feature point extraction.
 次に、ステップS4において、第1判定部25bは、抽出されたマーカ情報が、規定の状態で、画像の規定の範囲内に含まれるかを判定する。ステップS4のYesのように、抽出されたマーカ情報が、規定の状態で、画像の規定の範囲内に含まれる場合、ステップS5において、案内情報出力部29は、表示部11または音声出力部15に正常に設置されていることを案内するように指示する。 Next, in step S4, the first determination unit 25b determines whether the extracted marker information is included in a specified range of the image in a specified state. When the extracted marker information is included in the specified range of the image in a specified state as in step S4 Yes, in step S5, the guide information output unit 29 displays the display unit 11 or the audio output unit 15 in the step S5. Instruct them to guide you through the proper installation.
 これにより、表示部11に「正しい方向に設置されました」と表示されるか、または、音声出力部15から「正しい方向に設置されました」と音声案内される。または、表示部11と音声出力部15との両方から案内される。 Thereby, the message “installed in the correct direction” is displayed on the display unit 11 or the voice output unit 15 provides voice guidance “installed in the correct direction”. Alternatively, guidance is provided from both the display unit 11 and the audio output unit 15.
 ステップS4のNoのように、抽出されたマーカ情報が、規定の状態で、画像の規定の範囲内に含まれない場合、ステップS6において、ズレ推定部25cは、調理状況認識部19のズレの種類を推定する。このズレの種類には、ズレの方向およびズレ量も含まれ、推定されたズレの種類に応じて、ステップS7において、案内情報出力部29は、表示部11または音声出力部15にズレを解消する位置修正用の案内情報を出力する。 When the extracted marker information is not included in the specified range of the image in the specified state as in step S4 No, in step S6, the shift estimation unit 25c detects the shift of the cooking status recognition unit 19. Estimate the type. The type of deviation includes the direction and amount of deviation, and the guide information output unit 29 eliminates the deviation in the display unit 11 or the audio output unit 15 in step S7 according to the estimated type of deviation. The position correction guidance information is output.
 これにより、ユーザは、表示部11または音声出力部15により、ズレの種類を確認することができ、調理状況認識部19のズレ、つまりカメラ19aの撮影方向のズレを修正することができる。表示部11または音声出力部15から位置修正の案内があった後は、所定時間経過後、または、設定キー13aからの入力により、再び、ステップS1から設置位置確認のフローが開始される。なお、カメラ19aの撮影方向とは、カメラ19aからカメラ19aの視野範囲の中心に向かう方向とする。 Thereby, the user can confirm the type of deviation by the display unit 11 or the audio output unit 15, and can correct the deviation of the cooking state recognition unit 19, that is, the deviation of the photographing direction of the camera 19a. After receiving the position correction guidance from the display unit 11 or the voice output unit 15, the flow of the installation position check is started again from step S1 after a predetermined time has elapsed or by an input from the setting key 13a. The shooting direction of the camera 19a is a direction from the camera 19a toward the center of the visual field range of the camera 19a.
 以上より、実施の形態1による加熱調理システム100は、トッププレート5から離れて配置された調理状況認識部19の設置位置が適切であるか否かを確認することができる。また、設置位置が不適切な場合、表示部11または音声出力部15から、ズレ方向、ズレ量等が案内されるので、ユーザはその案内にしたがって調整することができる。この結果、調理状況認識部19を適切な位置に設置することができ、トッププレート5上の調理中の状況を適切に認識することができる。 As described above, the cooking system 100 according to Embodiment 1 can confirm whether or not the installation position of the cooking status recognition unit 19 arranged away from the top plate 5 is appropriate. Further, when the installation position is inappropriate, the display unit 11 or the audio output unit 15 guides the shift direction, the shift amount, and the like, so that the user can adjust according to the guidance. As a result, the cooking status recognition unit 19 can be installed at an appropriate position, and the status of cooking on the top plate 5 can be properly recognized.
 本実施の形態の加熱調理システム100は、トッププレート5と、加熱コイル7A~7C(本開示の加熱部の一例)と、コイル制御部10(本開示の加熱制御部の一例)と、カメラ19aと、マーカ抽出部25aと、第1判定部25bと、報知部4と、を備える。 The cooking system 100 according to the present embodiment includes a top plate 5, heating coils 7A to 7C (an example of the heating unit of the present disclosure), a coil control unit 10 (an example of the heating control unit of the present disclosure), and a camera 19a. And a marker extraction unit 25a, a first determination unit 25b, and a notification unit 4.
 トッププレート5は、被加熱物Tcを収容する容器Crが載置され、少なくとも1つ以上のマーカ情報(たとえば、表示部11およびマーカ8A~8Cの少なくとも一方)を有する。加熱コイル7A~7Cは、容器Crを下方から加熱する。コイル制御部10は、加熱コイル7A~7Cから容器Crへの加熱量を制御する。カメラ19aは、トッププレート5から離れた位置に配置され、トッププレート5に向けられる。マーカ抽出部25aは、カメラ19aにより撮影された画像19aaに含まれるマーカ情報を抽出する。第1判定部25bは、抽出されたマーカ情報が、画像19aaの規定の範囲内に含まれている否かを判定する。報知部4は、第1判定部25bの判定結果に基づいて、カメラ19aの設置状態を報知する。 The top plate 5 is mounted with a container Cr that accommodates the article to be heated Tc, and has at least one or more marker information (for example, at least one of the display unit 11 and the markers 8A to 8C). The heating coils 7A to 7C heat the container Cr from below. The coil controller 10 controls the amount of heating from the heating coils 7A to 7C to the container Cr. The camera 19 a is disposed at a position away from the top plate 5 and is directed toward the top plate 5. The marker extraction unit 25a extracts marker information included in an image 19aa photographed by the camera 19a. The first determination unit 25b determines whether or not the extracted marker information is included in a prescribed range of the image 19aa. The alerting | reporting part 4 alert | reports the installation state of the camera 19a based on the determination result of the 1st determination part 25b.
 たとえば、第1判定部25bが、抽出されたマーカ情報が画像19aaの規定の範囲内に含まれていると判断する場合は、報知部4は、カメラ19aの設置状態が正常であることをユーザに認識させる信号を出力する。または第1判定部25bが、抽出されたマーカ情報が画像19aaの規定の範囲内に含まれていないと判断する場合は、報知部4は、カメラ19aの設置状態が異常であることをユーザに認識させる信号を出力する。規定の範囲とは、たとえば画像19aaの領域全体であってもよいし、あらかじめ定められた画像19aaの領域の一部であってもよい。 For example, when the first determination unit 25b determines that the extracted marker information is included in the prescribed range of the image 19aa, the notification unit 4 determines that the installation state of the camera 19a is normal. Outputs a signal to be recognized. Alternatively, when the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa, the notification unit 4 informs the user that the installation state of the camera 19a is abnormal. Output the signal to be recognized. The specified range may be, for example, the entire area of the image 19aa or a part of the predetermined area of the image 19aa.
 これにより、ユーザは、カメラ19aの位置ずれの有無を認識することができる。つまり、加熱調理システム100は、ユーザにカメラ19aの位置ずれの是正を促すことができ、適切な撮影を実現できる。 Thereby, the user can recognize whether or not the camera 19a is displaced. That is, the cooking system 100 can prompt the user to correct the positional deviation of the camera 19a, and can realize appropriate photographing.
 また、本実施の形態では、第1判定部25bが、抽出されたマーカ情報が、画像19aaの規定の範囲内に含まれていないと判定した場合、報知部4は、カメラ19aの異常な設置状態を報知する。 Moreover, in this Embodiment, when the 1st determination part 25b determines with the extracted marker information not being contained in the prescription | regulation range of image 19aa, the alerting | reporting part 4 is abnormal installation of the camera 19a. Announce the condition.
 これにより、ユーザは、カメラ19aの位置ずれを認識することができる。つまり、加熱調理システム100は、ユーザにカメラ19aの位置ずれの是正を促すことができ、適切な撮影を実現できる。 Thereby, the user can recognize the positional deviation of the camera 19a. That is, the cooking system 100 can prompt the user to correct the positional deviation of the camera 19a, and can realize appropriate photographing.
 なお、異常な設置状態を報知する手段は、正常な設置状態のときに常時正常であることを報知し、異常な設置状態のときに正常であることを報知しない手段であってもよい。または、異常な設置状態を報知する手段は、正常な設置状態のときには報知信号を出力せず、異常な設置状態のときのみ報知信号を出力する手段であってもよい。正常な設置状態である場合は、異常な設置状態である場合よりも多いと考えられるため、異常な設置状態である場合のみ報知信号を出力することで、報知に要する電力を低減できる。または、異常な設置状態を報知する手段は、正常な設置状態のときに出力する信号と異なる信号を出力する手段であってもよい。これにより、ユーザは、カメラ19aが正常な設置状態であるか、異常な設置状態であるかをより的確に認識できる。 It should be noted that the means for notifying the abnormal installation state may be means for notifying that the normal installation state is always normal and not normal in the abnormal installation state. Alternatively, the means for notifying the abnormal installation state may be a means for outputting the notification signal only in the abnormal installation state without outputting the notification signal in the normal installation state. In a normal installation state, it is considered that there are more cases than in an abnormal installation state. Therefore, by outputting a notification signal only in an abnormal installation state, the power required for notification can be reduced. Alternatively, the means for notifying the abnormal installation state may be a means for outputting a signal different from the signal output in the normal installation state. Thereby, the user can recognize more accurately whether the camera 19a is in a normal installation state or an abnormal installation state.
 また、本実施の形態の加熱調理システム100は、カメラ19aの設置状態に対応して、カメラ19aの位置調整用の案内情報を出力する案内情報出力部29を備える。案内情報出力部29は、第1判定部25bにより、抽出されたマーカ情報が、画像19aaの規定の範囲内に含まれていないと判断された場合、抽出されたマーカ情報が画像19aaの規定の範囲内に含まれるように、カメラ19aの設置状態の変更を案内する案内情報を報知部4に出力する。設置状態の変更を案内する案内情報とは、表示部11および音声出力部15から出力する案内に関する情報である。 Also, the cooking system 100 of the present embodiment includes a guidance information output unit 29 that outputs guidance information for position adjustment of the camera 19a in accordance with the installation state of the camera 19a. When the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19aa, the guidance information output unit 29 extracts the extracted marker information from the specified value of the image 19aa. Guidance information for guiding the change of the installation state of the camera 19a is output to the notification unit 4 so as to be included in the range. The guidance information for guiding the change of the installation state is information regarding guidance output from the display unit 11 and the audio output unit 15.
 これにより、加熱調理システム100は、ユーザにカメラ19aの位置ずれの是正方法を具体的に示すことができ、適切な撮影を実現できる。 Thereby, the cooking system 100 can specifically show the user how to correct the positional deviation of the camera 19a, and can realize appropriate photographing.
 また、本実施の形態では、加熱調理器1は、誘導加熱調理器である。つまり加熱部は、容器Crを加熱するために誘導磁界を発生させる加熱コイル7A~7Cを有する。コイル制御部10は、加熱コイルに高周波電流を供給して容器Crの加熱を行う。つまり、本実施の形態のカメラ19a、マーカ抽出部25a、第1判定部25b、および報知部4は、ガスコンロなどの加熱調理器にも適用できるが、誘導加熱調理器にも適している。 Further, in the present embodiment, the heating cooker 1 is an induction heating cooker. That is, the heating unit includes heating coils 7A to 7C that generate an induction magnetic field to heat the container Cr. The coil controller 10 heats the container Cr by supplying a high-frequency current to the heating coil. That is, the camera 19a, the marker extraction unit 25a, the first determination unit 25b, and the notification unit 4 of the present embodiment can be applied to a heating cooker such as a gas stove, but is also suitable for an induction heating cooker.
 また、本実施の形態では、トッププレート5が有するマーカ情報は、カメラ19aにより撮影された画像19aaにおいてカメラの認識可能画素数の1/100以上になる大きさである。これにより、マーカ抽出部25aはマーカ情報を適切に抽出することができる。 In the present embodiment, the marker information of the top plate 5 has a size that is 1/100 or more of the number of recognizable pixels of the camera in the image 19aa photographed by the camera 19a. Thereby, the marker extraction part 25a can extract marker information appropriately.
 また、本実施の形態では、カメラ19aからトッププレート5までの距離は600mm以上、2000mm以下である。これにより、汎用のカメラ19aを用いて、容易にトッププレート5の広い領域を撮影できる。 In the present embodiment, the distance from the camera 19a to the top plate 5 is 600 mm or more and 2000 mm or less. Thus, a wide area of the top plate 5 can be easily photographed using the general-purpose camera 19a.
 また、本実施の形態は、加熱調理器1を撮影するカメラ19aの設置状態を報知する方法を開示する。加熱調理器1は、トッププレート5と、加熱コイル7A~7Cとを含む。トッププレート5には、被加熱物Tcを収容する容器Crが載置される。トッププレート5は、マーカ情報(たとえば表示部11およびマーカ8A~8Cの少なくともいずれか一つ)を有する。この方法は、カメラ19aにより撮影された画像を入力するステップを含む。また、この方法は、画像に含まれるマーカ情報を抽出するステップを含む。また、この方法は、抽出されたマーカ情報が、画像の規定の範囲内に含まれているか否かを判定するステップを含む。この方法は、判定ステップの判定結果に基づいて、カメラの設置状態を報知する報知信号を出力するステップを含む。 Moreover, this Embodiment discloses the method of alert | reporting the installation state of the camera 19a which image | photographs the heating cooker 1. FIG. The heating cooker 1 includes a top plate 5 and heating coils 7A to 7C. On the top plate 5, a container Cr that accommodates the article to be heated Tc is placed. The top plate 5 has marker information (for example, at least one of the display unit 11 and the markers 8A to 8C). This method includes a step of inputting an image photographed by the camera 19a. The method also includes a step of extracting marker information included in the image. The method also includes the step of determining whether the extracted marker information is included within a prescribed range of the image. This method includes a step of outputting a notification signal for notifying the installation state of the camera based on the determination result of the determination step.
 これにより、ユーザは、カメラ19aの位置ずれの有無を認識することができる。つまり、加熱調理器1は、ユーザにカメラ19aの位置ずれの是正を促すことができ、適切な撮影を実現できる。 Thereby, the user can recognize whether or not the camera 19a is displaced. That is, the heating cooker 1 can prompt the user to correct the positional deviation of the camera 19a, and can realize appropriate photographing.
 (実施の形態2)
 次に、実施の形態2に係る加熱調理システムについて図22-図28を参照して説明する。実施の形態1の加熱調理システム100は表示部11または黒帯をマーカ情報として抽出して調理状況認識部19のズレを判定していたのに対して、実施の形態2に係る加熱調理システムはリング状の発光部6A~6Cをマーカ情報として抽出して調理状況認識部19のズレ、つまりカメラ19aの撮影方向のズレを判定する。なお、実施の形態2における加熱調理システムは、以下に記載した事項以外の構成は、実施の形態1の加熱調理システム100と共通である。
(Embodiment 2)
Next, a heat cooking system according to Embodiment 2 will be described with reference to FIGS. Whereas the cooking system 100 according to the first embodiment extracts the display unit 11 or the black belt as marker information and determines the deviation of the cooking status recognition unit 19, the cooking system according to the second embodiment The ring-shaped light emitting units 6A to 6C are extracted as marker information to determine the deviation of the cooking state recognition unit 19, that is, the deviation of the photographing direction of the camera 19a. In addition, the heat cooking system in Embodiment 2 is common in the heat cooking system 100 of Embodiment 1 except for the matters described below.
 実施の形態2におけるマーカ抽出部25aは、発光部6A~6Cのリングをマーカ情報として抽出する。抽出方法は、発光部6A~6Cが点灯する前の画像と点灯後の画像との差分をとることで、発光部6A~6Cを抽出することができる。発光部6A~6Cは、制御部25により、規定位置、規定色、および、規定順の少なくとも1つで、点灯または、点滅される。 The marker extracting unit 25a in the second embodiment extracts the rings of the light emitting units 6A to 6C as marker information. In the extraction method, the light emitting units 6A to 6C can be extracted by taking the difference between the image before the light emitting units 6A to 6C are turned on and the image after the light is turned on. The light emitting units 6A to 6C are turned on or blinked by the control unit 25 in at least one of a specified position, a specified color, and a specified order.
 図22は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像を示している。図22の矩形の破線領域は、カメラ19aにより撮影された画像19acの領域を示す。三角形32の破線は、画像19acの回転ズレを検出するための指標である。マーカ抽出部25aは、画像19acから、発光部6A~6Cをマーカ情報として抽出する。図22に示すように、画像19acは、カメラ19aが正しい位置に配置された際の画像である。すなわち、状態aにおける画像19acであるので、実施の形態1と同様に処理され、表示部11および音声出力部15から状態aに対応する案内が出力される。 FIG. 22 shows an image obtained by simplifying an image taken by the camera 19a from above. A rectangular broken line area in FIG. 22 indicates an area of an image 19ac photographed by the camera 19a. A broken line of the triangle 32 is an index for detecting a rotational shift of the image 19ac. The marker extraction unit 25a extracts the light emitting units 6A to 6C as marker information from the image 19ac. As shown in FIG. 22, the image 19ac is an image when the camera 19a is placed at the correct position. That is, since it is the image 19ac in the state a, it is processed in the same manner as in the first embodiment, and guidance corresponding to the state a is output from the display unit 11 and the audio output unit 15.
 図23は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19acを示している。図23は、カメラ19aの位置または撮影方向が左方へズレている。したがって、画像19acから抽出された発光部6A~6Cの中で、右側に配置された発光部6Cの右側が切れている。すなわち、状態bにおける画像19acであるので、実施の形態1と同様に処理され、表示部11および音声出力部15から状態bに対応する案内が出力される。 FIG. 23 shows an image 19ac obtained by simplifying an image taken by the camera 19a from above. In FIG. 23, the position of the camera 19a or the shooting direction is shifted to the left. Accordingly, among the light emitting units 6A to 6C extracted from the image 19ac, the right side of the light emitting unit 6C arranged on the right side is cut. That is, since it is the image 19ac in the state b, it is processed in the same manner as in the first embodiment, and guidance corresponding to the state b is output from the display unit 11 and the audio output unit 15.
 図24は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19acを示している。図24は、カメラ19aの位置または撮影方向が右方へズレている。したがって、画像19acから抽出された発光部6A~6Cの中で、左側に配置された発光部6Aの左側が切れている。すなわち、状態cにおける画像19acであるので、実施の形態1と同様に処理され、表示部11および音声出力部15から状態cに対応する案内が出力される。 FIG. 24 shows an image 19ac obtained by simplifying an image taken by the camera 19a from above. In FIG. 24, the position of the camera 19a or the shooting direction is shifted to the right. Accordingly, among the light emitting units 6A to 6C extracted from the image 19ac, the left side of the light emitting unit 6A arranged on the left side is cut. That is, since it is the image 19ac in the state c, it is processed in the same manner as in the first embodiment, and guidance corresponding to the state c is output from the display unit 11 and the audio output unit 15.
 図25は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19acを示している。図25は、カメラ19aの位置または撮影方向が後方へズレている。したがって、画像19acから抽出された発光部6A~6Cの中で、前側に配置された発光部6Aおよび6Bの前側が切れている。すなわち、状態dにおける画像19acであるので、実施の形態1と同様に処理され、表示部11および音声出力部15から状態dに対応する案内が出力される。 FIG. 25 shows an image 19ac obtained by simplifying an image taken by the camera 19a from above. In FIG. 25, the position of the camera 19a or the shooting direction is shifted backward. Accordingly, among the light emitting units 6A to 6C extracted from the image 19ac, the front side of the light emitting units 6A and 6B arranged on the front side is cut off. That is, since the image 19ac in the state d is processed in the same manner as in the first embodiment, guidance corresponding to the state d is output from the display unit 11 and the audio output unit 15.
 図26は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19acを示している。図26は、カメラ19aの位置または撮影方向が前方へズレている。したがって、画像19acから抽出された発光部6A~6Cの中で、後側に配置された発光部6Cの後側が切れている。すなわち、状態eにおける画像19acであるので、実施の形態1と同様に処理され、表示部11および音声出力部15から状態eに対応する案内が出力される。 FIG. 26 shows an image 19ac obtained by simplifying an image taken by the camera 19a from above. In FIG. 26, the position of the camera 19a or the shooting direction is shifted forward. Therefore, among the light emitting units 6A to 6C extracted from the image 19ac, the rear side of the light emitting unit 6C arranged on the rear side is cut off. That is, since it is the image 19ac in the state e, it is processed in the same manner as in the first embodiment, and guidance corresponding to the state e is output from the display unit 11 and the audio output unit 15.
 図27は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19acを示している。図27は、カメラ19aの撮影方向が時計回りに回転ズレしている。回転ズレは、例えば、マーカ情報の相互の規定された位置関係からの回転ズレにより検出することができる。例えば、正常な状態において、発光部6A左端と、発光部6Bの右端と、発光部6Cの上端に対応するカメラ19aの撮影画像上の位置を記憶しておく。これらの点を結ぶ三角形32の底辺と、撮影画像からテンプレ-トマッチング等により検出された、発光部6A~6Cの対応する各点を結ぶ三角形34の底辺との成す角度を検出する。このようにして、回転方向および回転角度が検出される。図27の画像19acにおいて、ズレの種類は状態fであるので、ズレ推定部25cにより、実施の形態1と同様に処理されて、表示部11および音声出力部15から状態fに対応する案内が出力される。また、カメラ19aの撮影方向が反時計回りに回転ズレしている場合も、状態gとして処理され、表示部11および音声出力部15から状態gに対応する案内が出力される。 FIG. 27 shows an image 19ac obtained by simplifying the image taken by the camera 19a from above. In FIG. 27, the shooting direction of the camera 19a is rotated clockwise. The rotational deviation can be detected by, for example, a rotational deviation from the mutually defined positional relationship of the marker information. For example, in a normal state, positions on the captured image of the camera 19a corresponding to the left end of the light emitting unit 6A, the right end of the light emitting unit 6B, and the upper end of the light emitting unit 6C are stored. An angle formed by the base of the triangle 32 connecting these points and the base of the triangle 34 connecting the corresponding points of the light emitting units 6A to 6C detected from the captured image by template matching or the like is detected. In this way, the rotation direction and rotation angle are detected. In the image 19ac of FIG. 27, since the type of deviation is state f, the deviation estimation unit 25c performs processing in the same manner as in the first embodiment, and guidance corresponding to the state f is displayed from the display unit 11 and the audio output unit 15. Is output. Also, when the shooting direction of the camera 19a is deviated counterclockwise, it is processed as the state g, and guidance corresponding to the state g is output from the display unit 11 and the audio output unit 15.
 図28は、カメラ19aが加熱調理器1を上方から撮影した画像を簡略化した画像19acを示している。図28は、カメラ19aの設置位置がトッププレート5から充分に離れていない、すなわち、カメラ19aの高さ位置が低いので、画像19acにおいて、抽出された発光部6A~6Cは、それぞれが切れている。したがって、第1判定部25bは、抽出されたマーカ情報が、規定の状態でカメラ19aの画像19acの規定の範囲内に含まれていないと判定する。また、ズレ推定部25cは、状態hにおけるズレと推定し、カメラ19aの設置位置をより高い位置へと移動するように案内情報出力部29へ指示する。これにより、表示部11および音声出力部15から状態hに対応する案内が出力される。 FIG. 28 shows an image 19ac obtained by simplifying an image taken by the camera 19a from above. In FIG. 28, since the installation position of the camera 19a is not sufficiently separated from the top plate 5, that is, the height position of the camera 19a is low, each of the extracted light emitting units 6A to 6C in the image 19ac is cut off. Yes. Therefore, the first determination unit 25b determines that the extracted marker information is not included in the specified range of the image 19ac of the camera 19a in the specified state. Further, the deviation estimation unit 25c estimates the deviation in the state h, and instructs the guidance information output unit 29 to move the installation position of the camera 19a to a higher position. Thereby, guidance corresponding to the state h is output from the display unit 11 and the audio output unit 15.
 実施の形態2における加熱調理システムによれば、マーカ情報として、加熱コイル7A~7Cのそれぞれに対応する発光部6A~6Cを用いるので、それぞれの加熱コイル7A~7Cがより適切に撮影されるようにカメラ19aの設置位置を調整できる。したがって、カメラ19aの位置調整の精度を向上させることができる。 According to the heating cooking system in the second embodiment, the light emitting units 6A to 6C corresponding to the heating coils 7A to 7C are used as marker information, so that each heating coil 7A to 7C is photographed more appropriately. The installation position of the camera 19a can be adjusted. Therefore, the accuracy of the position adjustment of the camera 19a can be improved.
 また、本実施の形態2では、マーカ情報を規定位置、規定色、および、規定順の少なくとも1つで、点灯、または、点滅させている。これにより、マーカ抽出部25aは、容易にマーカ情報を抽出できる。 In the second embodiment, the marker information is lit or blinked in at least one of the specified position, the specified color, and the specified order. Thereby, the marker extraction part 25a can extract marker information easily.
 (実施の形態3)
 次に、実施の形態3に係る加熱調理システム41について図29-図38を参照して説明する。実施の形態1、2の加熱調理システム100は本体3の上方に設置されたレンジフード17に調理状況認識部19を配置していた。これに対して、実施の形態3に係る加熱調理システム41は、本体3の後方で上方に延びる壁37に調理状況認識部19を配置する。なお、実施の形態3における加熱調理システム41は、以下に記載した事項以外の構成は、実施の形態1または2の加熱調理システム100と共通である。
(Embodiment 3)
Next, a heat cooking system 41 according to Embodiment 3 will be described with reference to FIGS. 29 to 38. In the cooking systems 100 according to the first and second embodiments, the cooking status recognition unit 19 is arranged in the range hood 17 installed above the main body 3. On the other hand, the cooking system 41 according to the third embodiment arranges the cooking status recognition unit 19 on the wall 37 extending upward behind the main body 3. In addition, the cooking system 41 in Embodiment 3 is the same as the cooking system 100 of Embodiment 1 or 2 except for the matters described below.
 図29は、実施の形態3に係る加熱調理システム41の制御系を示すブロック図である。実施の形態3に係る加熱調理システム41の加熱調理器の本体43は、その内部に配置された制御部45に第2判定部35を有する。すなわち、実施の形態1の制御部25に第2判定部35を追加したのが実施の形態3の制御部45である。 FIG. 29 is a block diagram showing a control system of the cooking system 41 according to the third embodiment. The main body 43 of the cooking device of the cooking system 41 according to Embodiment 3 has a second determination unit 35 in the control unit 45 disposed therein. That is, the control unit 45 of the third embodiment is obtained by adding the second determination unit 35 to the control unit 25 of the first embodiment.
 第2判定部35は、マーカ抽出部25aにより抽出されたマーカ情報を基に、カメラ19aの高さ位置が、カメラ19aの画角に対応付けられた規定の高さ位置の範囲に含まれている否かを判定する。規定の高さ位置の範囲に含まれるとは、基準となる高さ位置が、ある所定の幅を持って設定されており、その基準の範囲に含まれることを指してもよい。または、基準となる高さ位置に対して、基準となる差異値が設定されており、カメラ19aの高さ位置と基準となる高さ位置との差異が、基準となる差異値以下または差異値未満であることを指してもよい。 The second determination unit 35 includes, based on the marker information extracted by the marker extraction unit 25a, the height position of the camera 19a included in the range of the specified height position associated with the angle of view of the camera 19a. Determine whether or not. To be included in the range of the specified height position may indicate that the reference height position is set with a certain predetermined width and is included in the reference range. Alternatively, a reference difference value is set for the reference height position, and the difference between the height position of the camera 19a and the reference height position is equal to or less than the reference difference value. You may point out that it is less than.
 例えば、図30に示すように、調理状況認識部19のカメラ19aが、二点鎖線で示す画角39を有する角度で壁37に設置されていれば、加熱調理器1のトッププレート5上を適切に撮影することができる。つまり、画角39のときのカメラ19aの傾きは正常であり、規定の傾きの範囲に含まれる。この場合、図31に示すように、撮影された画像19ad内に、発光部6A~6Cが含まれている。なお、発光部6A~6Cの替わりに、マーカ8A~8Cまたは表示部11をマーカ情報として用いてもよい。レンジフード17に設置された際の画像19acと比較すると、画像19adは前方向に延びた画像となる。 For example, as shown in FIG. 30, if the camera 19 a of the cooking status recognition unit 19 is installed on the wall 37 at an angle having an angle of view 39 indicated by a two-dot chain line, the top plate 5 of the heating cooker 1 is You can shoot properly. That is, the tilt of the camera 19a at the angle of view 39 is normal, and is included in the specified tilt range. In this case, as shown in FIG. 31, the light emitting units 6A to 6C are included in the photographed image 19ad. Instead of the light emitting units 6A to 6C, the markers 8A to 8C or the display unit 11 may be used as marker information. Compared to the image 19ac when installed on the range hood 17, the image 19ad is an image extending in the forward direction.
 図30を再び参照して、調理状況認識部19のカメラ19aが、例えば、一点鎖線で示す画角44を有する角度で壁37に設置されていると、トッププレート5上を適切に撮影することができない。つまり、画角44のときのカメラ19aの傾きは異常であり、規定の傾きの範囲に含まれない。この場合、例えば、図32に示すように、撮影された画像19adはトッププレート5の前方領域をより多く含んでいる。これにより、図32の画像19adは、発光部6Cの後部が切れた画像となっている。 Referring again to FIG. 30, when the camera 19 a of the cooking situation recognition unit 19 is installed on the wall 37 at an angle having an angle of view 44 indicated by a one-dot chain line, for example, the top plate 5 is appropriately photographed. I can't. That is, the tilt of the camera 19a at the angle of view 44 is abnormal and is not included in the specified tilt range. In this case, for example, as shown in FIG. 32, the photographed image 19ad includes more front regions of the top plate 5. Thereby, the image 19ad in FIG. 32 is an image in which the rear portion of the light emitting unit 6C is cut.
 そこで、ズレ推定部25cにより、前方向にズレが発生している状態eであることを推定され、案内情報出力部29により、後方向にカメラ19aの向きを修正するように案内される。また、ズレ推定部25cはトッププレート5に対するカメラの角度を推定することで、角度の調整を案内してもよい。また、表示部11の左側が切れているので、ズレ推定部25cにより、右方向にズレが発生している状態cであることも推定され、左方向にカメラ19aの向きを修正するように案内される。この2度の修正案内により、カメラ19aの向きが修正され、図33に示される画像を得ることができる。この後、制御部45は、カメラ19aの画角内で有効範囲19c内の画像を切り取る。または、制御部45は、カメラ19aのズーム調整をする。 Therefore, it is estimated by the deviation estimation unit 25c that there is a deviation e in the forward direction, and the guidance information output unit 29 is guided to correct the direction of the camera 19a in the backward direction. Further, the deviation estimation unit 25c may guide angle adjustment by estimating the angle of the camera with respect to the top plate 5. Further, since the left side of the display unit 11 is cut off, it is also estimated by the shift estimation unit 25c that the shift is occurring in the right direction, and guidance is provided to correct the direction of the camera 19a in the left direction. Is done. With the two correction guides, the orientation of the camera 19a is corrected, and the image shown in FIG. 33 can be obtained. Thereafter, the control unit 45 cuts out the image within the effective range 19c within the angle of view of the camera 19a. Alternatively, the control unit 45 adjusts the zoom of the camera 19a.
 次に、調理状況認識部19が壁37に設置される高さ位置と撮影画像との関係について図34~図38を用いて説明する。なお、図34から図38において、説明を簡易にするために、台形の撮影画像を矩形の撮影画像として示している。図34は、調理状況認識部の高さ位置を説明する図である。レンジフード17の中央部の点kに調理状況認識部19が設置された場合に、撮影された画像を簡易化した画像19aeが図35に示される。点kから撮影された画像19aeは、トッププレート5の直上から撮影しているので、撮影された画像中のマーカ8A~8Cに歪みは発生しない。マーカ8A~8Cは正円である。この状態の画像19aeは、正常な状態の画像として記憶部27に記憶されている。 Next, the relationship between the height position where the cooking status recognition unit 19 is installed on the wall 37 and the photographed image will be described with reference to FIGS. 34 to 38, trapezoidal captured images are shown as rectangular captured images for ease of explanation. FIG. 34 is a diagram illustrating the height position of the cooking status recognition unit. FIG. 35 shows an image 19ae obtained by simplifying the photographed image when the cooking situation recognition unit 19 is installed at the point k in the center of the range hood 17. Since the image 19ae taken from the point k is taken from directly above the top plate 5, no distortion occurs in the markers 8A to 8C in the taken image. The markers 8A to 8C are perfect circles. The image 19ae in this state is stored in the storage unit 27 as an image in a normal state.
 壁37において、例えば、トッププレート5から800mmの高さの位置にある点mから撮影された画像19afが図36の実線で示される。また、図36において、破線は比較として図35における歪みの無い状態のマーカ8A~8Cを示す。画像19afにおけるマーカ8A~8Cは、正円から楕円に歪んでいる。この歪みの程度により、調理状況認識部19が壁のどの高さに取り付けられているかを検出することができる。 In the wall 37, for example, an image 19af taken from a point m at a height of 800 mm from the top plate 5 is shown by a solid line in FIG. In FIG. 36, broken lines indicate the markers 8A to 8C in FIG. 35 without distortion as a comparison. The markers 8A to 8C in the image 19af are distorted from a perfect circle to an ellipse. Based on the degree of the distortion, it is possible to detect at which height of the wall the cooking state recognition unit 19 is attached.
 壁37において、例えば、トッププレート5から600mmの高さの位置にある点nから撮影された画像が図37の実線で示される。図37において、破線は比較として図35における歪みの無い状態のマーカ8A~8Cを示す。600mmにおける画像19afは、800mmにおける画像と比較して、各マーカ8A~8Cがより歪みが大きい状態で撮影されている。 In the wall 37, for example, an image taken from a point n at a height of 600 mm from the top plate 5 is indicated by a solid line in FIG. In FIG. 37, the broken lines show the markers 8A to 8C in FIG. 35 without distortion as a comparison. The image 19af at 600 mm is taken with each of the markers 8A to 8C being more distorted than the image at 800 mm.
 壁37において、例えば、トッププレート5から400mmの高さの位置にある点pから撮影された画像が図38の実線で示される。図38において、破線は比較として図35における歪みの無い状態のマーカ8A~8Cを示す。400mmにおける画像19afは、600、800mmにおける画像と比較して、各マーカ8A~8Cがより歪みが大きい状態で撮影されている。 In the wall 37, for example, an image taken from a point p at a height of 400 mm from the top plate 5 is indicated by a solid line in FIG. In FIG. 38, the broken lines indicate the markers 8A to 8C in the undistorted state in FIG. 35 for comparison. The image 19af at 400 mm is taken with the markers 8A to 8C being more distorted than the images at 600 and 800 mm.
 撮影した画像における各マーカ8A~8Cが、図38に示される各マーカ8A~8Cよりも歪んでいる場合、調理状況認識部19の高さ位置が低すぎるので、第2判定部35は検出不可として判定する。この場合、ズレ推定部25cは状態hとして推測し、表示部11および音声出力部15から状態hに対応した案内を出力する。これにより、ユーザは調理状況認識部19の高さを上げるように案内される。このように、ズレ推定部25cは、抽出されたマーカ情報の歪みを基に、カメラの位置情報としてカメラの高さを推定する。 When the markers 8A to 8C in the photographed image are distorted more than the markers 8A to 8C shown in FIG. 38, the cooking position recognition unit 19 is too low in height, so the second determination unit 35 cannot detect it. Judge as. In this case, the shift estimation unit 25c estimates the state h, and outputs a guidance corresponding to the state h from the display unit 11 and the audio output unit 15. As a result, the user is guided to increase the height of the cooking status recognition unit 19. As described above, the deviation estimation unit 25c estimates the height of the camera as the position information of the camera based on the distortion of the extracted marker information.
 記憶部27には、400、600、および、800mmの各高さにおける正常な状態である状態aの画像データが記憶されている。したがって、撮影された画像から抽出されたマーカ情報が真上から撮影された画像と比較して歪んでいたとしても、ズレの種類を推定することができる。また、各楕円の長辺と短辺を画像処理により検出し、検出した長辺と短辺との比率から楕円の歪みの程度を判断して調理状況認識部19の高さを推定してもよい。ズレ推定部25cは、検出された各高さに応じて撮影画像のズレの種類を推定する。 The storage unit 27 stores image data in a state a that is a normal state at each height of 400, 600, and 800 mm. Therefore, even if the marker information extracted from the photographed image is distorted as compared with the image photographed from directly above, the type of deviation can be estimated. Further, the long side and the short side of each ellipse are detected by image processing, and the height of the cooking condition recognition unit 19 is estimated by judging the degree of distortion of the ellipse from the ratio of the detected long side and short side. Good. The deviation estimation unit 25c estimates the type of deviation of the captured image according to each detected height.
 図39は、実施の形態3におけるカメラ位置の修正案内の流れを示すフローチャートである。ステップS1からステップS3までは、実施の形態1と共通なので、説明を省略する。ステップS3により、撮影画像からマーカ情報が抽出されると、ステップS11において、第2判定部35は、カメラの高さ位置が、規定の高さ位置の範囲に含まれるかを判定する。カメラの高さ位置が規定の高さ位置の範囲に含まれると、第2判定部35が判定した場合(ステップS11のYes)、実施の形態1におけるステップS4以降の処理が、同様に実施される。 FIG. 39 is a flowchart showing a flow of camera position correction guidance in the third embodiment. Steps S1 to S3 are the same as those in the first embodiment, and a description thereof will be omitted. When marker information is extracted from the captured image in step S3, in step S11, the second determination unit 35 determines whether the height position of the camera is included in the range of the specified height position. When the second determination unit 35 determines that the height position of the camera is included in the range of the specified height position (Yes in step S11), the processing after step S4 in the first embodiment is similarly performed. The
 カメラの高さ位置が規定の高さ位置の範囲内に含まれないと、第2判定部35が判定した場合(ステップS11のNo)、第2判定部35は案内情報出力部29に、調理状況認識部19の高さ位置を変える案内情報を出力するように指示する。案内情報出力部29は、状態hの場合と同様の案内を報知部4の表示部11および音声出力部15から案内する。その後、ステップS1から再び処理が開始される。 When the second determination unit 35 determines that the height position of the camera is not included in the range of the specified height position (No in step S11), the second determination unit 35 sends the cooking information to the guide information output unit 29. It instructs to output guidance information for changing the height position of the situation recognition unit 19. The guidance information output unit 29 guides the same guidance as in the state h from the display unit 11 and the voice output unit 15 of the notification unit 4. Thereafter, the process is started again from step S1.
 壁37に調理状況認識部19を取り付ける場合、レンジフード17に取り付ける場合と比べて、種々の高さ位置に取り付けることができる。したがって、ユーザが、取り付け位置(つまりカメラ19aの高さ位置)を誤る可能性も増え得る。しかし、実施の形態3に係る加熱調理システム41であれば、壁37に調理状況認識部19を取り付ける場合でも、その高さ位置が適切であるか否かをユーザに案内することができる。また、高さ位置が適切でない場合、それを修正する案内を報知するので、ユーザはその案内にしたがって調理状況認識部19の高さ位置を修正することができる。 When the cooking status recognition unit 19 is attached to the wall 37, it can be attached at various height positions as compared with the case where it is attached to the range hood 17. Therefore, the possibility that the user mistakes the attachment position (that is, the height position of the camera 19a) may increase. However, with the cooking system 41 according to the third embodiment, even when the cooking status recognition unit 19 is attached to the wall 37, it is possible to guide the user whether or not the height position is appropriate. Moreover, since the guidance which corrects it is alert | reported when a height position is not appropriate, the user can correct the height position of the cooking condition recognition part 19 according to the guidance.
 また、実施の形態1の第1判定部25bを備えることにより、カメラ19aの撮影方向を修正できる。また、第1判定部25bは、高さ位置に応じた基準の画像データを用いて規定の範囲を取得してもよい。つまり、高さ位置によって規定の範囲が変わってもよい。これにより、ステップS4の判定をより高精度に実行できる。 Also, by providing the first determination unit 25b of Embodiment 1, the shooting direction of the camera 19a can be corrected. The first determination unit 25b may acquire a specified range using reference image data corresponding to the height position. That is, the specified range may change depending on the height position. Thereby, determination of step S4 can be performed with higher precision.
 また、高さ位置に応じた基準の画像データを用いて案内情報が出力されてもよい。つまり、高さ位置によって案内情報が変わってもよい。案内情報出力部29は、より高精度に傾きを修正するよう、高精度な案内情報を出力できる。 Further, guide information may be output using reference image data corresponding to the height position. That is, the guidance information may change depending on the height position. The guide information output unit 29 can output highly accurate guide information so as to correct the inclination with higher accuracy.
 本実施の形態では、抽出されたマーカ情報を基に、カメラ19aの高さ位置が、規定の高さ位置の範囲に含まれている否かを判定する第2判定部35を備える。第2判定部35が、カメラ19aの高さ位置が規定の高さ位置の範囲に含まれていないと判定した場合に、報知部4は、カメラの異常な設置状態を報知する。 In the present embodiment, the second determination unit 35 is provided that determines whether the height position of the camera 19a is included in the range of the specified height position based on the extracted marker information. When the second determination unit 35 determines that the height position of the camera 19a is not included in the range of the specified height position, the notification unit 4 notifies the abnormal installation state of the camera.
 これにより、ユーザはカメラ19aの高さ位置が異常であることを認識でき、加熱調理器1は、ユーザにカメラ19aの高さ位置を是正するよう促すことができ、適切な撮影を実現できる。特に、カメラ19aを壁37に配置する場合は、カメラ19aの高さ位置を精度よく調整することが、撮影範囲を適切に設定するために必要であるため、本実施の形態が有用である。 Thereby, the user can recognize that the height position of the camera 19a is abnormal, and the heating cooker 1 can prompt the user to correct the height position of the camera 19a, thereby realizing appropriate photographing. In particular, when the camera 19a is disposed on the wall 37, it is necessary to accurately adjust the height position of the camera 19a in order to appropriately set the shooting range, and thus this embodiment is useful.
 また本実施の形態では、案内情報出力部29は、第2判定部35により、カメラ19aの高さ位置が規定の高さ位置の範囲に含まれていないと判定された場合に、カメラ19aの高さ位置が規定の高さ位置の範囲に含まれるように、カメラ19aの設置状態の変更を案内する案内情報を報知部4に出力する。これにより、加熱調理器1は、ユーザにカメラ19aの高さ位置を具体的に是正する方法を案内でき、適切な撮影を実現できる。 In the present embodiment, the guidance information output unit 29 determines that the camera 19a has the height position of the camera 19a when the second determination unit 35 determines that the height position of the camera 19a is not included in the specified height position range. Guidance information for guiding the change in the installation state of the camera 19a is output to the notification unit 4 so that the height position is included in the range of the specified height position. Thereby, the heating cooker 1 can guide the user how to specifically correct the height position of the camera 19a, and can realize appropriate photographing.
 本実施の形態では、ズレ推定部25cは、抽出されたマーカ情報の歪みを基に、カメラ19aの設置状態に関する設置情報として、カメラ19aの高さ位置を推定する。案内情報出力部29は、推定された高さ位置に対応する予め記録された位置調整データに応じて案内情報を出力する。これにより、マーカ情報が歪んでいても、適切に案内情報を出力できる。なお、ズレ推定部25cは、歪みを基に、高さ位置に加えて、または高さ位置に代えて、カメラ19aの傾きを推定してもよい。案内情報出力部29は、推定された傾きに対応する予め記録された位置調整データに応じて案内情報を出力する。 In the present embodiment, the deviation estimation unit 25c estimates the height position of the camera 19a as installation information related to the installation state of the camera 19a based on the extracted distortion of the marker information. The guide information output unit 29 outputs guide information in accordance with pre-recorded position adjustment data corresponding to the estimated height position. Thereby, even if marker information is distorted, guidance information can be appropriately output. The deviation estimation unit 25c may estimate the tilt of the camera 19a based on the distortion, in addition to the height position or instead of the height position. The guidance information output unit 29 outputs guidance information according to the pre-recorded position adjustment data corresponding to the estimated inclination.
 なお、本実施の形態では、第1判定部25bにより、カメラ19aの傾きのズレを判定し、第2判定部35によりカメラ19aの高さのズレを判定したが、一つの判定部によってこれらの判定が実行されてもよい。また、カメラ19aの傾きのズレの一部については、第2判定部35で判定されてもよい。 In the present embodiment, the first determination unit 25b determines the deviation of the tilt of the camera 19a, and the second determination unit 35 determines the deviation of the height of the camera 19a. A determination may be performed. In addition, a part of the tilt deviation of the camera 19a may be determined by the second determination unit 35.
 たとえば、第1判定部25bまたは第2判定部35は、マーカ抽出部25aにより抽出されたマーカ情報の傾きを基に、カメラ19aの光軸に対する回転角が、規定の回転角の範囲に含まれるか否かを判定してもよい。光軸は、カメラ19aの撮影方向と同じ方向に延びる。 For example, the first determination unit 25b or the second determination unit 35 includes the rotation angle with respect to the optical axis of the camera 19a within the specified rotation angle range based on the inclination of the marker information extracted by the marker extraction unit 25a. It may be determined whether or not. The optical axis extends in the same direction as the shooting direction of the camera 19a.
 この場合、第1判定部25bまたは第2判定部35は、ステップS3の後であってステップS11の前に、カメラの光軸に対する回転角が、規定の回転角の範囲に含まれるか否かを判定する。この判定ステップで「含まれる」と判定されれば、ステップS11に進む。この判定ステップで「含まれない」と判定されれば、案内情報出力部29によりカメラ19aの回転角の調整を案内する案内情報が出力される。ユーザは、報知部4を介して案内情報を認識することができ、カメラ19aの回転角を調整できる。加熱調理システム41は、カメラ19aの回転角が是正された後、再びステップS1に戻る。 In this case, the first determination unit 25b or the second determination unit 35 determines whether the rotation angle with respect to the optical axis of the camera is included in the specified rotation angle range after step S3 and before step S11. Determine. If it is determined that “included” in this determination step, the process proceeds to step S11. If it is determined that it is not included in this determination step, the guide information output unit 29 outputs guide information for guiding the adjustment of the rotation angle of the camera 19a. The user can recognize the guidance information via the notification unit 4 and can adjust the rotation angle of the camera 19a. After the rotation angle of the camera 19a is corrected, the cooking system 41 returns to step S1 again.
 (実施の形態4)
 次に、実施の形態4に係る加熱調理システム51について図40を参照して説明する。実施の形態1の加熱調理システム100は、調理状況認識部19の位置修正の案内を、本体3に配置された報知部4から出力していた。これに対して、実施の形態4に係る加熱調理システム51は、携帯端末47からも調理状況認識部19の位置修正の案内が可能な構成である。なお、実施の形態4における加熱調理システム51は、以下に記載した事項以外の構成は、実施の形態3の加熱調理システム41と共通である。
(Embodiment 4)
Next, a heat cooking system 51 according to Embodiment 4 will be described with reference to FIG. The heating and cooking system 100 according to the first embodiment outputs the position correction guidance of the cooking status recognition unit 19 from the notification unit 4 arranged in the main body 3. On the other hand, the cooking system 51 according to the fourth embodiment is configured to be able to guide the position correction of the cooking status recognition unit 19 from the portable terminal 47. In addition, the cooking system 51 in Embodiment 4 is the same as the cooking system 41 in Embodiment 3 except for the items described below.
 加熱調理システム51の本体43の通信部21は、外部機器として設置されたルータ装置49を介して調理状況認識部19の通信部23と無線接続されている。すなわち、調理状況認識部19と制御部45とは、ルータ装置49を中心とするローカルエリアネットワーク53に無線通信可能に接続されている。また、ルータ装置49は、インターネット55に接続されている。さらに、ルータ装置49は、ユーザの携帯端末47に無線通信可能に接続されている。 The communication unit 21 of the main body 43 of the cooking system 51 is wirelessly connected to the communication unit 23 of the cooking status recognition unit 19 via a router device 49 installed as an external device. That is, the cooking status recognition unit 19 and the control unit 45 are connected to a local area network 53 centering on the router device 49 so as to be capable of wireless communication. The router device 49 is connected to the Internet 55. Further, the router device 49 is connected to the user's portable terminal 47 so as to be able to perform wireless communication.
 携帯端末47は、例えば、液晶ディスプレイを有する表示部47aと、スピーカを有する音声出力部47bとを備える。これにより、携帯端末47は、報知部として機能することができるので、案内情報出力部29から出力される案内情報を通信部21およびルータ装置49を介して受信することができる。したがって、携帯端末47の表示部47aと音声出力部47bとから、報知部4から報知される案内情報と同じ情報をユーザに報知することができる。 The portable terminal 47 includes, for example, a display unit 47a having a liquid crystal display and an audio output unit 47b having a speaker. Thereby, since the portable terminal 47 can function as a notification unit, the guide information output from the guide information output unit 29 can be received via the communication unit 21 and the router device 49. Therefore, the same information as the guidance information notified from the notification unit 4 can be notified to the user from the display unit 47a and the voice output unit 47b of the portable terminal 47.
 携帯端末47から、調理状況認識部19の位置調整の音声案内が報知されるので、例えば、レンジフード17近くで作業する場合、本体3の表示部11からは見えにくい案内情報も携帯端末47により手元で見ることができるので位置調整の効率を向上することができる。また、案内情報出力部29から出力される案内情報を、インターネット55を介して、外部に送信することもできる。また、携帯端末47の替わりとして、家の中に配置される、他の電気製品の制御も可能な統合制御部に接続されてもよい。 Since the portable terminal 47 notifies the guidance of the position adjustment of the cooking status recognition unit 19, for example, when working near the range hood 17, guidance information that is difficult to see from the display unit 11 of the main body 3 is also displayed by the portable terminal 47. Since it can be seen at hand, the position adjustment efficiency can be improved. In addition, the guide information output from the guide information output unit 29 can be transmitted to the outside via the Internet 55. Further, instead of the portable terminal 47, it may be connected to an integrated control unit that is also arranged in the house and can also control other electrical products.
 なお、本実施の形態では、携帯端末47の報知部(たとえば表示部47aおよび音声出力部47b)と本体の報知部4とを併用しているが、携帯端末47の報知部のみを用いてもよい。 In the present embodiment, the notification unit (for example, the display unit 47a and the audio output unit 47b) of the mobile terminal 47 and the notification unit 4 of the main body are used together, but only the notification unit of the mobile terminal 47 may be used. Good.
 以上より、本実施の形態では、加熱調理システム51は、通信部21を備える。通信部21は、カメラ19aの異常な設置状態を、表示部47aおよび音声出力部47b(本開示の報知部の一例)を有する携帯端末47(本開示の外部機器の一例)に無線通信する。第1判定部25bが、抽出されたマーカ情報が、画像の規定の範囲内に含まれていないと判定した場合、通信部21は、カメラ19aの異常な設置状態の情報を携帯端末47へ送信する。表示部47aおよび音声出力部47bは、カメラ19aの異常な設置状態を報知する。これにより、ユーザの位置に関わらず、ユーザにカメラ19aの設置状態をより認識されやすくなる。 As described above, the cooking system 51 includes the communication unit 21 in the present embodiment. The communication unit 21 wirelessly communicates the abnormal installation state of the camera 19a to a portable terminal 47 (an example of an external device according to the present disclosure) having a display unit 47a and an audio output unit 47b (an example of a notification unit according to the present disclosure). When the first determination unit 25b determines that the extracted marker information is not included in the prescribed range of the image, the communication unit 21 transmits information on the abnormal installation state of the camera 19a to the portable terminal 47. To do. The display unit 47a and the audio output unit 47b notify an abnormal installation state of the camera 19a. This makes it easier for the user to recognize the installation state of the camera 19a regardless of the position of the user.
 なお、外部機器は、携帯端末47に加えて、または携帯端末47に代えて、家の中に配置される統合制御部であってもよい。統合制御部は、表示部および音声出力部の少なくとも1つを有する。これにより、複数の家電製品と共通の制御部を用いてユーザにカメラの設置状態を認識させることができる。 The external device may be an integrated control unit arranged in the house in addition to the mobile terminal 47 or in place of the mobile terminal 47. The integrated control unit has at least one of a display unit and an audio output unit. Thereby, a user can be made to recognize the installation state of a camera using a control part common with several household appliances.
 (実施の形態5)
 次に、実施の形態5に係る加熱調理システム61について図41、図42を参照して説明する。図41は、実施の形態5に係る加熱調理システム61の制御系を示すブロック図である。図42は、加熱調理システム61の概略構成を説明する図である。実施の形態1の加熱調理システム100の調理状況認識部19は、カメラ19aを有していたのに対して、実施の形態5に係る加熱調理システム61の調理状況認識部63は、さらに、トッププレート5上の温度を検出する温度センサ65と調理状況認識部63の向き、つまりカメラ19aの撮影方向を電動で調整可能な電動駆動部67とを備える。なお、実施の形態5における加熱調理システム61は、以下に記載した事項以外の構成は、実施の形態4の加熱調理システム51と共通である。
(Embodiment 5)
Next, a heat cooking system 61 according to Embodiment 5 will be described with reference to FIGS. 41 and 42. FIG. 41 is a block diagram illustrating a control system of the cooking system 61 according to the fifth embodiment. FIG. 42 is a diagram illustrating a schematic configuration of the heating cooking system 61. The cooking status recognition unit 19 of the heating and cooking system 100 according to the first embodiment has the camera 19a, whereas the cooking status recognition unit 63 of the heating and cooking system 61 according to the fifth embodiment further includes a top. A temperature sensor 65 that detects the temperature on the plate 5 and an electric drive unit 67 that can electrically adjust the orientation of the cooking condition recognition unit 63, that is, the photographing direction of the camera 19a, are provided. In addition, the cooking system 61 in Embodiment 5 is the same as the cooking system 51 in Embodiment 4 except for the items described below.
 温度センサ65がカメラ19aと同じ方向を向くように、カメラ19aと温度センサ65とが互いに固定されている。カメラ19aと温度センサ65とで検知部69を構成する。したがって、実施の形態1と同様にカメラ19aの位置および撮影方向が修正されれば、検知部69の位置および検知方向が修正されるので、温度センサ65の位置および検知方向も同時に修正される。温度センサ65は、例えば、赤外線センサである。温度センサ65により、容器Cr内の調理対象である被加熱物Tcの温度状況を上方から検出することができる。なお、温度センサ65の検知方向とは、温度センサ65から温度センサ65が特定の波長光を吸収できる範囲の中心へ向かう方向とする。特定の波長光とは、赤外線センサの場合は赤外領域の波長である。特定の波長光を吸収できる範囲は、点でも面でもよい。電動駆動部67は、例えば、モータを備え、モータの回転量に応じて、検知部69の向きを調整する。 The camera 19a and the temperature sensor 65 are fixed to each other so that the temperature sensor 65 faces the same direction as the camera 19a. The camera 19a and the temperature sensor 65 constitute a detection unit 69. Therefore, as in the first embodiment, if the position and the shooting direction of the camera 19a are corrected, the position and the detection direction of the detection unit 69 are corrected, so the position and the detection direction of the temperature sensor 65 are also corrected at the same time. The temperature sensor 65 is, for example, an infrared sensor. The temperature sensor 65 can detect the temperature state of the object to be heated Tc that is the cooking target in the container Cr from above. The detection direction of the temperature sensor 65 is a direction from the temperature sensor 65 toward the center of the range in which the temperature sensor 65 can absorb light of a specific wavelength. In the case of an infrared sensor, the specific wavelength light is a wavelength in the infrared region. The range that can absorb light of a specific wavelength may be a point or a surface. The electric drive unit 67 includes, for example, a motor, and adjusts the direction of the detection unit 69 according to the rotation amount of the motor.
 温度センサ65よりも解像度の高いカメラ19aの撮影画像を基に、検知部69の位置および検知方向が修正される。これにより、解像度の低い温度センサ65も精度よく位置および検知方向を修正することができる。 The position and detection direction of the detection unit 69 are corrected based on the captured image of the camera 19a having a higher resolution than the temperature sensor 65. Thereby, the temperature sensor 65 with low resolution can also correct the position and the detection direction with high accuracy.
 また、電動駆動部67は、ズレ推定部25cと通信部21、23を介して接続されているので、案内情報出力部29が出力する調整案内にしたがって、自動で検知部69の向きを調整する。したがって、ズレ推定部25cが推定するズレ方向およびズレ量に応じて、電動駆動部67がカメラ19aを可動するので、ユーザの調整負担を軽減することができる。 In addition, since the electric drive unit 67 is connected to the deviation estimation unit 25c via the communication units 21 and 23, the direction of the detection unit 69 is automatically adjusted according to the adjustment guidance output by the guidance information output unit 29. . Therefore, since the electric drive unit 67 moves the camera 19a according to the shift direction and the shift amount estimated by the shift estimation unit 25c, the adjustment burden on the user can be reduced.
 なお、実施の形態5において、調理状況認識部63は、温度センサ65と電動駆動部67との両方を備える構成であったが、いずれか一方を備える構成であってもよい。 In addition, in Embodiment 5, although the cooking condition recognition part 63 was the structure provided with both the temperature sensor 65 and the electric drive part 67, the structure provided with either one may be sufficient.
 以上より、本実施の形態の加熱調理システム61は、電動駆動部67を備える。電動駆動部67は、カメラの撮影方向を電動で調整可能である。第1判定部25bが、抽出されたマーカ情報が、画像の規定の範囲内に含まれると判断するように、電動駆動部67は、自動でカメラの撮影方向を調整する。なお、電動駆動部67は、第2判定部35が、カメラ19aの傾きが規定の傾きの範囲に含まれていないと判断しない場合、規定の傾きの範囲に含まれると判断するように、自動でカメラの撮影方向を調整してもよい。これにより、加熱調理システム61は、より確実に、適切な撮影を実現できる。 As described above, the cooking system 61 according to the present embodiment includes the electric drive unit 67. The electric drive unit 67 can adjust the shooting direction of the camera electrically. The electric drive unit 67 automatically adjusts the shooting direction of the camera so that the first determination unit 25b determines that the extracted marker information is included in the prescribed range of the image. If the second determination unit 35 does not determine that the tilt of the camera 19a is not included in the specified tilt range, the electric driving unit 67 automatically determines that the camera 19a is included in the specified tilt range. You may adjust the shooting direction of the camera. Thereby, the heating cooking system 61 can implement | achieve appropriate imaging | photography more reliably.
 また、加熱調理システム61は、調理状況認識部63を備える。調理状況認識部63は、カメラ19aと温度センサ65(本開示の温度検知部の一例)とを含む。温度センサ65は、トッププレート5から離れた位置に配置され、トッププレート5に向けられている。カメラ19aと温度センサ65とが同じ方向に向けて配置されている。 Moreover, the heating cooking system 61 includes a cooking status recognition unit 63. The cooking status recognition unit 63 includes a camera 19a and a temperature sensor 65 (an example of a temperature detection unit of the present disclosure). The temperature sensor 65 is disposed at a position away from the top plate 5 and is directed toward the top plate 5. The camera 19a and the temperature sensor 65 are arranged in the same direction.
 本実施の形態では、カメラ19aと温度センサ65とが調理状況認識部63に配置され、かつ同じ方向に向けて配置されている。したがって、カメラ19aの撮影方向を調整することにより、温度センサ65の検知方向も連動して調整される。これにより、カメラ19aによる高解像度の画像を用いて温度センサ65の検知方向を調整でき、温度センサ65の検出精度が向上する。 In the present embodiment, the camera 19a and the temperature sensor 65 are arranged in the cooking state recognition unit 63 and arranged in the same direction. Therefore, by adjusting the shooting direction of the camera 19a, the detection direction of the temperature sensor 65 is also adjusted in conjunction. Thereby, the detection direction of the temperature sensor 65 can be adjusted using the high-resolution image by the camera 19a, and the detection accuracy of the temperature sensor 65 improves.
 なお、本実施の形態では、温度検知部として温度センサ65を例に挙げたが、温度検知部は熱カメラであってもよい。 In the present embodiment, the temperature sensor 65 is taken as an example of the temperature detection unit, but the temperature detection unit may be a thermal camera.
 (実施の形態6)
 次に、実施の形態6に係る加熱調理システム71について図43-図47を参照して説明する。図43は、実施の形態6に係る加熱調理システム71の制御系を示すブロック図である。図44は、調理状況認識部の検知部の下面図である。実施の形態1の加熱調理システム1はマーカ情報としてトッププレート5上に表示されたマーカまたは表示部11を利用していた。これに対して、実施の形態6に係る加熱調理システム71は、調理状況認識部73の検知部69の検知方向に向けられた調整ガイド投影部75を有する。この調整ガイド投影部75からトッププレート5上に投影されたマーカ情報を利用して調理状況認識部73の位置調整を行う。なお、実施の形態6における加熱調理システム71は、以下に記載した事項以外の構成は、実施の形態5の加熱調理システム61と共通である。
(Embodiment 6)
Next, a heat cooking system 71 according to Embodiment 6 will be described with reference to FIGS. 43 to 47. FIG. 43 is a block diagram illustrating a control system of the cooking system 71 according to the sixth embodiment. FIG. 44 is a bottom view of the detection unit of the cooking status recognition unit. The cooking system 1 according to the first embodiment uses a marker or display unit 11 displayed on the top plate 5 as marker information. On the other hand, the heating cooking system 71 according to the sixth embodiment includes the adjustment guide projection unit 75 directed in the detection direction of the detection unit 69 of the cooking state recognition unit 73. Using the marker information projected on the top plate 5 from the adjustment guide projection unit 75, the position of the cooking condition recognition unit 73 is adjusted. In addition, the cooking system 71 in Embodiment 6 is the same as the cooking system 61 in Embodiment 5 except for the items described below.
 調理状況認識部73は、カメラ19aおよび温度センサ19bと同じ方向に向けられた調整ガイド投影部75を有する。図45は、加熱調理システムの概略構成を説明する図である。調整ガイド投影部75は、位置調整用のマーカをトッププレート5の上方から投影する。 The cooking status recognition unit 73 includes an adjustment guide projection unit 75 that is directed in the same direction as the camera 19a and the temperature sensor 19b. FIG. 45 is a diagram illustrating a schematic configuration of a cooking system. The adjustment guide projection unit 75 projects a position adjustment marker from above the top plate 5.
 図46は、調整ガイド投影部75から投影されるマーカの一例を示す図である。丸印77は、調整ガイド投影部75からトッププレート5へ投影される投影マーカである。投影マーカは、カメラ19aの撮影方向を示す。なお、トッププレート5上には、丸印77が位置するべき領域を示す矩形の目標マーカ79が印刷されている。すなわち、矩形の目標マーカ79は、丸印77の調整目標位置を示す。 FIG. 46 is a diagram illustrating an example of a marker projected from the adjustment guide projecting unit 75. A circle 77 is a projection marker projected from the adjustment guide projection unit 75 onto the top plate 5. The projection marker indicates the shooting direction of the camera 19a. On the top plate 5, a rectangular target marker 79 indicating a region where the circle 77 should be located is printed. That is, the rectangular target marker 79 indicates the adjustment target position of the circle 77.
 したがって、ユーザは、投影された丸印77が目標マーカ79の位置に位置するように、調理状況認識部73の位置および方向を調整することができる。目標マーカ79と投影マーカとの物理的な距離の差異を縮めることにより、カメラ19aの撮影方向を調整可能である。また、マーカ77がトッププレート5に投影されている状態をカメラ19aが撮影し、撮影された画像を画像処理により目標マーカ79とマーカ77との差を検出して、電動駆動部67により自動でカメラ19aの方向を調整してもよい。なお、目標マーカ79は、矩形のマーカに限らず、十字形状、または三角形状のマーカでもよい。 Therefore, the user can adjust the position and direction of the cooking status recognition unit 73 so that the projected circle 77 is located at the position of the target marker 79. By reducing the difference in physical distance between the target marker 79 and the projection marker, the shooting direction of the camera 19a can be adjusted. Further, the camera 19a captures the state in which the marker 77 is projected on the top plate 5, detects the difference between the target marker 79 and the marker 77 by image processing on the captured image, and is automatically performed by the electric drive unit 67. The direction of the camera 19a may be adjusted. The target marker 79 is not limited to a rectangular marker, and may be a cross-shaped or triangular marker.
 図47は、調整ガイド投影部75から投影されるマーカの一例を示す図である。この例では、調整ガイド投影部75は、カメラ19aの現状の撮影領域81をトッププレート5上に投影する。したがって、ユーザは、投影された撮影領域81が発光部6A~6Cまたはマーカ8A~8Cを含んで、適切な位置に位置するように、調理状況認識部73の位置および方向を調整することができる。また、撮影領域81がトッププレート5に投影されている状態をカメラ19aが撮影し、撮影された画像を画像処理により撮影領域81と理想領域83との差を検出して、電動駆動部67により自動でカメラ19aの方向を調整してもよい。 FIG. 47 is a diagram illustrating an example of a marker projected from the adjustment guide projection unit 75. In this example, the adjustment guide projection unit 75 projects the current shooting area 81 of the camera 19a onto the top plate 5. Therefore, the user can adjust the position and direction of the cooking status recognition unit 73 so that the projected photographing region 81 includes the light emitting units 6A to 6C or the markers 8A to 8C and is positioned at an appropriate position. . In addition, the camera 19a captures a state in which the imaging region 81 is projected on the top plate 5, detects a difference between the imaging region 81 and the ideal region 83 by image processing on the captured image, and the electric drive unit 67 You may adjust the direction of the camera 19a automatically.
 実施の形態6の加熱調理システム71によれば、調理状況認識部73の認識領域がトッププレート5上に直接的に表示されるので、ユーザは調理状況認識部73の位置ズレを感覚的に理解することができる。したがって、位置調整の時間を短縮することができる。 According to the heating and cooking system 71 of the sixth embodiment, since the recognition area of the cooking situation recognition unit 73 is directly displayed on the top plate 5, the user understands the positional deviation of the cooking situation recognition unit 73 sensuously. can do. Therefore, the position adjustment time can be shortened.
 以上より、本実施の形態の加熱調理システム71は、トッププレート5から離れた位置に配置され、トッププレート5に向けられた調整ガイド投影部75(本開示のガイド投影部の一例)を備える。トッププレート5は、規定の調整目標位置を示す目標マーカ(たとえば目標マーカ79、発光部6A~6Cまたはマーカ8A~8C)を有する。調整ガイド投影部75は、カメラ19aの撮影方向を示す投影マーカ(たとえば投影マーカ77または撮影領域81)を投影可能である。目標マーカと投影マーカとの物理的な距離の差異を縮めることにより、カメラ19aの撮影方向を調整可能である。これにより、ユーザはより視覚的にカメラ19aの設置状態を把握できる。 As described above, the heating and cooking system 71 of the present embodiment includes the adjustment guide projection unit 75 (an example of the guide projection unit of the present disclosure) that is disposed at a position away from the top plate 5 and directed toward the top plate 5. The top plate 5 has a target marker (for example, the target marker 79, the light emitting units 6A to 6C, or the markers 8A to 8C) indicating a predetermined adjustment target position. The adjustment guide projection unit 75 can project a projection marker (for example, the projection marker 77 or the imaging region 81) indicating the imaging direction of the camera 19a. By reducing the difference in physical distance between the target marker and the projection marker, the shooting direction of the camera 19a can be adjusted. Thereby, the user can grasp the installation state of the camera 19a more visually.
 本開示は、上記実施の形態のものに限らず、次のように変形実施することができる。 The present disclosure is not limited to the above embodiment, and can be modified as follows.
 (1)上記実施の形態において、表示部11は、通常の解像度を有する液晶ディスプレイを用いて構成されていたが、これに限られない。例えば、図48に示すように、表示部11の一部にドット液晶ディスプレイ11aを有してもよい。 (1) In the above embodiment, the display unit 11 is configured using a liquid crystal display having a normal resolution, but is not limited thereto. For example, as shown in FIG. 48, a dot liquid crystal display 11a may be provided in a part of the display unit 11.
 表示部11にドット液晶ディスプレイ11aを有する場合、例えば、撮影画像19agに図49に示すズレ状態が発生している場合、図50または図52に示すドット絵をドット液晶ディスプレイ11aから表示する。すなわち、撮影画像19agの領域に含まれる発光部6A~6Cまたはマーカ8A~8Cの領域をドットで発光させることにより、ユーザに撮影領域のズレ状態をより理解しやすく提示することができる。調理状況認識部73が適切な位置で適切な方向に配置された場合には、図51または図53に示すように、各加熱領域を示すドット領域のドットを全て発光させることで、ユーザは調理状況認識部73が適切に配置されていることを知ることができる。 When the display unit 11 includes the dot liquid crystal display 11a, for example, when the shift state shown in FIG. 49 occurs in the captured image 19ag, the dot picture shown in FIG. 50 or 52 is displayed from the dot liquid crystal display 11a. That is, by causing the light emitting units 6A to 6C or the markers 8A to 8C included in the region of the captured image 19ag to emit light with dots, it is possible to present the user with an easier understanding of the shift state of the captured region. When the cooking status recognition unit 73 is arranged in an appropriate direction at an appropriate position, as shown in FIG. 51 or FIG. 53, the user can cook by emitting all the dots in the dot area indicating each heating area. It can be known that the situation recognition unit 73 is appropriately arranged.
 また、現状の位置ズレに即して通知してもよい。例えば、図54に示すように、撮影画像19ahに右ズレが発生している場合、そのズレ量を相対的な量でドット液晶ディスプレイ11aに表示している。バー85は、ズレ量を示しており、調理状況認識部19を左方へ向けるにつれて、バー85が短くなる。調理状況認識部19が適切な方向へ向いた時には、バー85の表示が消滅する。 Also, notification may be made according to the current position shift. For example, as shown in FIG. 54, when a right shift occurs in the captured image 19ah, the shift amount is displayed on the dot liquid crystal display 11a as a relative amount. The bar 85 indicates the amount of deviation, and the bar 85 becomes shorter as the cooking state recognition unit 19 is turned to the left. When the cooking status recognition unit 19 faces in an appropriate direction, the display of the bar 85 disappears.
 また、例えば、図55に示す様に、撮影画像19akに回転ズレが発生している場合、ドット液晶ディスプレイ11aに、そのズレ量を相対的な量で表現している。三角形状の案内情報87は、ズレ量を示しており、調理状況認識部19が反時計回りに回転するにつれて、案内情報87の三角形の傾斜が緩くなる。調理状況認識部19が適切な角度に位置した時には、案内情報87が消滅する。 Further, for example, as shown in FIG. 55, when a rotational shift occurs in the photographed image 19ak, the shift amount is expressed as a relative amount on the dot liquid crystal display 11a. The triangular guide information 87 indicates the amount of deviation, and as the cooking status recognition unit 19 rotates counterclockwise, the triangle of the guide information 87 becomes slanted. When the cooking status recognition unit 19 is positioned at an appropriate angle, the guide information 87 disappears.
 また、表示部11は、図56に示すように、高解像度液晶ディスプレイ11bを有しても良い。この場合、カメラ19aの撮影領域を実態に即して表示してもよい。例えば、図57において、撮影画像19amは後ズレを発生しているが、図58に示すように、高解像度液晶ディスプレイ11bに、この状態dの状況を示す概略図89と、ズレ量を相対的に表したバー91と、ズレ方向を修正する方向を示す矢印93とが表示されている。 Further, the display unit 11 may include a high-resolution liquid crystal display 11b as shown in FIG. In this case, the shooting area of the camera 19a may be displayed according to the actual situation. For example, in FIG. 57, the photographed image 19am is misaligned, but as shown in FIG. 58, the high resolution liquid crystal display 11b has a relative amount of misalignment compared to the schematic diagram 89 showing the state d. Are displayed, and an arrow 93 indicating the direction in which the displacement direction is corrected is displayed.
 また、図59に示すように、撮影画像19anに時計回り回転ズレが発生している場合、高解像度液晶ディスプレイ11bに、この状態fの状況およびズレ量を表す三角形95と、反時計回りに回転するように修正案内する矢印97とが表示されている。 Further, as shown in FIG. 59, when a clockwise rotation shift occurs in the photographed image 19an, the high-resolution liquid crystal display 11b rotates in a counterclockwise direction with a triangle 95 indicating the state of the state f and the shift amount. An arrow 97 for guidance for correction is displayed.
 このように、ズレ量を反映したライブ画像を表示部11に表示することで、調理状況認識部19の修正をよりわかりやすく行うことができる。 Thus, by displaying the live image reflecting the amount of deviation on the display unit 11, the cooking status recognition unit 19 can be corrected more easily.
 (2)上記実施の形態において、調理状況認識部19をレンジフード17に配置する場合、レンジフード17のフード部分17aの中央部に配置していたが、これに限られない。この他にも、例えば、図60に示すようにフード部分17aの前部に配置してもよい。フード部分17aの前部に配置した場合、撮影画像19apは、図61に示すような、前方が長辺となる台形状になるが、予めこのような台形状の最適位置の画像を記憶部27に記憶させている。これにより、実施の形態1と同様に、位置ズレを案内することができる。 (2) In the above embodiment, when the cooking status recognition unit 19 is arranged in the range hood 17, it is arranged in the center of the hood portion 17 a of the range hood 17, but is not limited thereto. In addition to this, for example, as shown in FIG. 60, it may be arranged at the front portion of the hood portion 17a. When arranged in the front portion of the hood portion 17a, the captured image 19ap has a trapezoidal shape with a long front side as shown in FIG. 61. An image of such an optimal position of the trapezoidal shape is stored in advance in the storage unit 27. To remember. Thereby, similarly to Embodiment 1, position shift can be guided.
 また、調理状況認識部19を、図62に示すように、フード部分17aの後部に配置してもよい。フード部分17aの後部に配置した場合、撮影画像19aqは、図63に示すような、後方が長辺となる台形状になるが、予めこのような台形状の最適位置の画像を記憶部27に記憶させている。これにより、実施の形態1と同様に、位置ズレを案内することができる。なお、調理状況認識部19を、フード部分17aを有さないレンジフード17に配置してもよい。 Further, the cooking status recognition unit 19 may be arranged at the rear of the hood portion 17a as shown in FIG. When arranged at the rear part of the hood portion 17a, the photographed image 19aq has a trapezoidal shape with a long rear side as shown in FIG. I remember it. Thereby, similarly to Embodiment 1, position shift can be guided. In addition, you may arrange | position the cooking condition recognition part 19 in the range hood 17 which does not have the food part 17a.
 (3)上記実施の形態において、マーカを抽出して第1判定部によりマーカ情報が規定の状態で画像の規定の範囲内に含まれるかを実施していたが、一度のこの処理によりカメラ位置を修正した後は、以下の処理を実施してもよい。例えば、加熱調理器1の電源をONしたとき、および、加熱調理器1の電池交換をしたときに以下の処理を実施する。ズレ推定部25cにより推定されたカメラ19aの設置情報を記憶部27に記憶させる。設置情報とは、カメラ19aの水平位置、垂直位置、および撮影方向(傾きを含む)の少なくともいずれか一つに関する情報である。カメラ19aが前回撮影した画像を基に得られた設置情報と、次に撮影した画像を基に制御部25が予め記憶部27に記憶されている様々な位置における画像とのパターンマッチングにより得られた位置情報との差異が既定の範囲を超えた場合に、第1判定部による判定を実施してもよい。 (3) In the above embodiment, the marker is extracted and the first determination unit determines whether the marker information is included in the specified range of the image in a specified state. After correcting the above, the following processing may be performed. For example, the following processing is performed when the power of the cooking device 1 is turned on and when the battery of the cooking device 1 is replaced. The installation information of the camera 19a estimated by the deviation estimation unit 25c is stored in the storage unit 27. The installation information is information related to at least one of the horizontal position, vertical position, and shooting direction (including tilt) of the camera 19a. Obtained by pattern matching between the installation information obtained based on the image previously captured by the camera 19a and the images at various positions previously stored in the storage unit 27 by the control unit 25 based on the next captured image. The determination by the first determination unit may be performed when the difference from the position information exceeds a predetermined range.
 (4)上記実施の形態において、調理状況認識部19の位置確認は、調理が行われていないときに実施されていたが、これに限られない。例えば、調理中に、調理状況認識部19のカメラ19aが撮影した画像を基に、マーカ情報を抽出し、第1判定部25bによる判定を実施することで、カメラ19aの設置状態の変化の有無を確認する。設置状態の変化とは、カメラ19aの水平位置、垂直位置、および撮影方向(傾きを含む)の少なくともいずれか一つの変化である。設置状態の変化が検出された場合、案内情報出力部29は、報知部4へ案内情報を出力させる。案内情報は、報知部4からユーザに報知される。また、設置状態の変化が検出された場合、ズレ推定部25cはコイル制御部10に各加熱コイル7A~7Cの加熱を停止するように指示してもよい。これにより、コイル制御部10は、各加熱コイル7A~7Cからの加熱を停止する。 (4) In the above embodiment, the position confirmation of the cooking status recognition unit 19 is performed when cooking is not performed, but is not limited thereto. For example, during cooking, the marker information is extracted based on the image captured by the camera 19a of the cooking status recognition unit 19, and the determination by the first determination unit 25b is performed, so that there is a change in the installation state of the camera 19a. Confirm. The change in the installation state is a change in at least one of the horizontal position, vertical position, and shooting direction (including tilt) of the camera 19a. When a change in the installation state is detected, the guidance information output unit 29 causes the notification unit 4 to output guidance information. The guidance information is notified to the user from the notification unit 4. Further, when a change in the installation state is detected, the deviation estimation unit 25c may instruct the coil control unit 10 to stop heating the heating coils 7A to 7C. Thereby, the coil control unit 10 stops the heating from the heating coils 7A to 7C.
 (5)上記実施の形態において、マーカは、トッププレート5上に印刷されていたがこれに限られない。例えば、案内情報出力部29が、表示部11上に表示させた規定の記号または文様をマーカ情報として用いてもよい。 (5) In the above embodiment, the marker is printed on the top plate 5, but the present invention is not limited to this. For example, the guidance information output unit 29 may use a specified symbol or pattern displayed on the display unit 11 as marker information.
 (6)上記実施の形態において、加熱調理器1は、加熱コイル7A~7Cを用いて容器Crを誘導加熱する誘導加熱調理器であるが、これに限られない。例えば、加熱調理器1は、ガス調理器であってもよい。ガス調理器の場合、容器Crは、本体3のトッププレート5に備えられた容器載置部としての五徳に載置され、その下方から加熱部としてのガスバーナによって加熱される。 (6) In the above embodiment, the heating cooker 1 is an induction heating cooker that induction-heats the container Cr using the heating coils 7A to 7C, but is not limited thereto. For example, the cooking device 1 may be a gas cooking device. In the case of a gas cooker, the container Cr is placed on the five virtues as a container placement portion provided on the top plate 5 of the main body 3, and is heated from below by a gas burner as a heating portion.
 (7)上記実施の形態において、加熱調理器1は、マーカ抽出部25a、第1判定部25b、ズレ推定部25c、第2判定部35を備えるが、これらの少なくとも一つは、携帯端末などの外部機器に備えられていてもよい。その場合は、加熱調理システムは外部機器を含む。 (7) In the above embodiment, the heating cooker 1 includes the marker extraction unit 25a, the first determination unit 25b, the shift estimation unit 25c, and the second determination unit 35. At least one of these includes a mobile terminal or the like May be provided in the external device. In that case, the cooking system includes an external device.
 なお、上記様々な実施の形態および変形例のうちの任意の実施の形態を適宜組み合わせることにより、それぞれの有する効果を奏するようにすることができる。 It should be noted that, by appropriately combining any of the above-described various embodiments and modifications, it is possible to achieve the respective effects.
 本開示は、添付図面を参照しながら好ましい実施の形態に関連して充分に記載されているが、この技術の熟練した人々にとっては種々の変形および修正は明白である。そのような変形および修正は、添付した請求の範囲による本開示の範囲から外れない限りにおいて、その中に含まれると理解されるべきである。また、各実施の形態における要素の組合せおよび順序の変化は、本開示の範囲及び思想を逸脱することなく実現し得るものである。 Although the present disclosure has been fully described in connection with preferred embodiments with reference to the accompanying drawings, various variations and modifications will be apparent to those skilled in the art. Such changes and modifications are to be understood as being included therein unless they depart from the scope of this disclosure according to the appended claims. In addition, combinations of elements and changes in the order in each embodiment can be realized without departing from the scope and spirit of the present disclosure.
  1   加熱調理器
  3、43 本体
  4   報知部
  5   トッププレート
  5b  前辺
  6A、6B、6C 発光部
  7A、7B、7C 加熱コイル
  8A、8B、8C マーカ
  9A、9B、9C 操作入力部
 10   コイル制御部
 11   表示部
 11a  ドット液晶ディスプレイ
 11b  高解像度液晶ディスプレイ
 13   設定部
 13a  設定キー
 13b  設定表示部
 15   音声出力部
 17   レンジフード
 17a  フード部分
 19、63、73 調理状況認識部
 19a  カメラ
 19aa 画像
 19ab 前辺
 19ac 画像
 19ad 画像
 19ae 画像
 19af 画像
 19ag 画像
 19ah 画像
 19ak 画像
 19am 画像
 19an 画像
 19ap 画像
 19aq 画像
 19b  温度センサ
 19c  有効範囲
 21   通信部
 23   通信部
 25、45 制御部
 25a  マーカ抽出部
 25b  第1判定部
 25c  ズレ推定部
 27   記憶部
 29   案内情報出力部
 31、33、35、38 丸破線
 32   三角形
 34   三角形
 35   第2判定部
 37   壁
 38   丸破線
 39   画角
 41、51、61、71、100 加熱調理システム
 44   画角
 47   携帯端末
 47a  表示部
 47b  音声出力部
 49   ルータ
 53   ローカルエリアネットワーク
 55   インターネット
 65   温度センサ
 67   電動駆動部
 69   検知部
 75   調整ガイド投影部
 77   丸印
 79   マーカ
 81   撮影領域
 83   理想領域
 85   バー
 87   案内情報
 89   概略図
 91   バー
 93   矢印
 95   三角形
 97   矢印
 Cr   容器
 Tc   被加熱物
DESCRIPTION OF SYMBOLS 1 Heating cooker 3, 43 Main body 4 Informing part 5 Top plate 5b Front side 6A, 6B, 6C Light emission part 7A, 7B, 7C Heating coil 8A, 8B, 8C Marker 9A, 9B, 9C Operation input part 10 Coil control part 11 Display unit 11a Dot liquid crystal display 11b High resolution liquid crystal display 13 Setting unit 13a Setting key 13b Setting display unit 15 Audio output unit 17 Range hood 17a Food portion 19, 63, 73 Cooking status recognition unit 19a Camera 19aa Image 19ab Front side 19ac Image 19ad Image 19ae Image 19af Image 19ag Image 19ah Image 19ak Image 19am Image 19an Image 19ap Image 19aq Image 19b Temperature Sensor 19c Effective Range 21 Communication Unit 23 Communication Unit 25, 45 Control Unit 25 a Marker extraction unit 25b First determination unit 25c Deviation estimation unit 27 Storage unit 29 Guidance information output unit 31, 33, 35, 38 Round broken line 32 Triangle 34 Triangle 35 Second determination unit 37 Wall 38 Round broken line 39 Angle of view 41, 51 , 61, 71, 100 Cooking system 44 Angle of view 47 Mobile terminal 47a Display unit 47b Audio output unit 49 Router 53 Local area network 55 Internet 65 Temperature sensor 67 Electric drive unit 69 Detection unit 75 Adjustment guide projection unit 77 Circle 79 Marker 81 Shooting area 83 Ideal area 85 Bar 87 Guide information 89 Schematic 91 Bar 93 Arrow 95 Triangle 97 Arrow Cr Container Tc Object to be heated

Claims (20)

  1.  被加熱物を収容する容器が載置され、マーカ情報を有するトッププレートと、
     前記容器を下方から加熱する加熱部と、
     前記加熱部から前記容器への加熱量を制御する加熱制御部と、
     前記トッププレートから離れた位置に配置され、前記トッププレートに向けられたカメラと、
     前記カメラにより撮影された画像に含まれる前記マーカ情報を抽出するマーカ情報抽出部と、
     抽出されたマーカ情報が、前記画像の規定の範囲内に含まれている否かを判定する第1判定部と、
     前記第1判定部による判定結果に基づいて、前記カメラの設置状態を報知する報知部と、
    を備えた加熱調理システム。
    A top plate on which a container for containing an object to be heated is placed and having marker information;
    A heating unit for heating the container from below;
    A heating control unit for controlling a heating amount from the heating unit to the container;
    A camera positioned away from the top plate and directed to the top plate;
    A marker information extraction unit for extracting the marker information included in an image photographed by the camera;
    A first determination unit that determines whether or not the extracted marker information is included in a prescribed range of the image;
    Based on the determination result by the first determination unit, a notification unit that notifies the installation state of the camera;
    Cooking system equipped with.
  2.  前記第1判定部が、前記抽出されたマーカ情報が、前記画像の前記規定の範囲内に含まれていないと判定した場合、前記報知部は、前記カメラの異常な設置状態を報知する、
    請求項1に記載の加熱調理システム。
    When the first determination unit determines that the extracted marker information is not included in the specified range of the image, the notification unit notifies an abnormal installation state of the camera.
    The cooking system according to claim 1.
  3.  前記カメラの前記異常な設置状態を、前記報知部を有する外部機器に無線通信する通信部を備え、
     前記第1判定部が、前記抽出されたマーカ情報が、前記画像の前記規定の範囲内に含まれていないと判定した場合、前記通信部は、前記カメラの前記異常な設置状態の情報を前記外部機器へ送信し、
     前記外部機器の前記報知部は、前記カメラの前記異常な設置状態を報知する、
     請求項2に記載の加熱調理システム。
    A communication unit that wirelessly communicates the abnormal installation state of the camera to an external device having the notification unit;
    When the first determination unit determines that the extracted marker information is not included in the specified range of the image, the communication unit displays the information on the abnormal installation state of the camera. Send it to an external device,
    The notification unit of the external device notifies the abnormal installation state of the camera.
    The cooking system according to claim 2.
  4.  前記抽出されたマーカ情報を基に、前記カメラの高さ位置が、規定の高さ位置の範囲に含まれている否かを判定する第2判定部を備え、
     前記第2判定部が、前記カメラの高さ位置が前記規定の高さ位置の範囲に含まれていないと判定した場合に、前記報知部は、前記カメラの前記異常な設置状態を報知する、
     請求項2または3に記載の加熱調理システム。
    A second determination unit that determines whether or not the height position of the camera is included in a range of a predetermined height position based on the extracted marker information;
    When the second determination unit determines that the height position of the camera is not included in the range of the specified height position, the notification unit notifies the abnormal installation state of the camera.
    The cooking system according to claim 2 or 3.
  5.  前記カメラの前記設置状態に対応して、前記カメラの位置調整用の案内情報を出力する案内情報出力部を備え、
     前記案内情報出力部は、前記第1判定部により、前記抽出されたマーカ情報が、前記画像の前記規定の範囲内に含まれていないと判断された場合、前記抽出されたマーカ情報が前記画像の前記規定の範囲内に含まれるように、前記カメラの前記設置状態の変更を案内する前記案内情報を前記報知部に出力する、
     請求項2から4のいずれか1つに記載の加熱調理システム。
    Corresponding to the installation state of the camera, comprising a guide information output unit for outputting guide information for position adjustment of the camera,
    When the first determination unit determines that the extracted marker information is not included in the specified range of the image, the guidance information output unit stores the extracted marker information in the image The guidance information for guiding the change of the installation state of the camera is output to the notification unit so as to be included in the prescribed range of
    The cooking system according to any one of claims 2 to 4.
  6.  前記カメラの前記設置状態に対応して、前記カメラの位置調整用の案内情報を出力する案内情報出力部を備え、
     前記案内情報出力部は、前記第2判定部により、前記カメラの前記高さ位置が前記規定の高さ位置の範囲に含まれていないと判定された場合に、前記前記カメラの高さ位置が前記規定の高さ位置の範囲に含まれるように、前記カメラの前記設置状態の変更を案内する前記案内情報を前記報知部に出力する、
     請求項4に記載の加熱調理システム。
    Corresponding to the installation state of the camera, comprising a guide information output unit for outputting guide information for position adjustment of the camera,
    When the second determination unit determines that the height position of the camera is not included in the range of the specified height position, the guidance information output unit determines the height position of the camera. Outputting the guidance information for guiding the change of the installation state of the camera to the notification unit so as to be included in the range of the specified height position;
    The cooking system according to claim 4.
  7.  前記抽出されたマーカ情報の歪みを基に、前記カメラの前記設置状態に関する設置情報として、前記カメラの前記高さ位置を推定するカメラ位置推定部を有し、
     前記案内情報出力部は、推定された前記高さ位置に対応する予め記録された位置調整データに応じて前記案内情報を出力する、
     請求項6に記載の加熱調理システム。
    Based on the distortion of the extracted marker information, as installation information regarding the installation state of the camera, a camera position estimation unit that estimates the height position of the camera,
    The guidance information output unit outputs the guidance information according to pre-recorded position adjustment data corresponding to the estimated height position;
    The cooking system according to claim 6.
  8.  推定された前記設置情報を記録する記憶部を備え、
     前記カメラが前回撮影した前記画像を基に得られた前記設置情報と、その後に撮影した画像を基に得られた設置情報との差異が既定の範囲を超えた場合に、前記第1判定部による判定が実施される、
     請求項7に記載の加熱調理システム。
    A storage unit for recording the estimated installation information;
    When the difference between the installation information obtained based on the image taken by the camera last time and the installation information obtained based on the image taken thereafter exceeds a predetermined range, the first determination unit Judgment by
    The cooking system according to claim 7.
  9.  前記カメラは、前記被加熱物の加熱調理中にも撮影を行い、
     前記第1判定部は、前記被加熱物の加熱調理中にも判定を行うことで、前記カメラの前記設置状態の変化の有無が検出され、
     前記設置状態の前記変化が検出された場合、前記案内情報出力部は前記案内情報を出力する、または、前記加熱制御部は前記加熱部からの加熱を停止する、
     請求項5から8のいずれか1つに記載の加熱調理システム。
    The camera takes a picture during cooking of the heated object,
    The first determination unit detects whether or not the installation state of the camera has changed by performing determination during cooking of the object to be heated,
    When the change in the installation state is detected, the guidance information output unit outputs the guidance information, or the heating control unit stops heating from the heating unit,
    The cooking system according to any one of claims 5 to 8.
  10.  前記マーカ情報を規定位置、規定色、および、規定順の少なくとも1つで、点灯、または、点滅させる、
     請求項5から9のいずれか1つに記載の加熱調理システム。
    Lighting or blinking the marker information in at least one of a specified position, a specified color, and a specified order;
    The cooking system according to any one of claims 5 to 9.
  11.  前記案内情報出力部は、前記マーカ情報として規定の記号または文様を表示する、
     請求項5から10のいずれか1つに記載の加熱調理システム。
    The guidance information output unit displays a specified symbol or pattern as the marker information.
    The cooking system according to any one of claims 5 to 10.
  12.  前記外部機器は、表示部および音声出力部の少なくとも1つを有する、携帯端末または家の中に配置される統合制御部である、
     請求項3に記載の加熱調理システム。
    The external device is an integrated control unit disposed in a portable terminal or house having at least one of a display unit and an audio output unit.
    The cooking system according to claim 3.
  13.  前記カメラの撮影方向を電動で調整可能な電動駆動部を備え、
     前記第1判定部が、前記抽出されたマーカ情報が、前記画像の前記規定の範囲内に含まれると判断するように、前記電動駆動部は、自動で前記カメラの撮影方向を調整する、
     請求項1から12のいずれか1つに記載の加熱調理システム。
    An electric drive unit that can adjust the shooting direction of the camera electrically,
    The electric drive unit automatically adjusts the shooting direction of the camera so that the first determination unit determines that the extracted marker information is included in the specified range of the image.
    The cooking system according to any one of claims 1 to 12.
  14.  前記カメラと、前記トッププレートから離れた位置に配置され、前記トッププレートに向けられた温度検知部を含む調理状況認識部を備え、
     前記カメラと前記温度検知部とが同じ方向に向けて配置されている、
     請求項1から13のいずれか1つに記載の加熱調理システム。
    The camera and a cooking status recognition unit including a temperature detection unit arranged at a position away from the top plate and directed to the top plate,
    The camera and the temperature detector are arranged in the same direction,
    The cooking system according to any one of claims 1 to 13.
  15.  前記トッププレートから離れた位置に配置され、前記トッププレートに向けられたガイド投影部を備え、
     前記トッププレートは、規定の調整目標位置を示す目標マーカを有し、
     前記ガイド投影部は、前記カメラの撮影方向を示す投影マーカを投影可能であり、
     前記目標マーカと前記投影マーカとの物理的な距離の差異を縮めることにより、前記カメラの前記撮影方向を調整可能である、
     請求項1から12のいずれか一つに記載の加熱調理システム。
    A guide projection disposed at a position away from the top plate and directed to the top plate;
    The top plate has a target marker indicating a predetermined adjustment target position,
    The guide projection unit can project a projection marker indicating a shooting direction of the camera,
    By reducing the difference in physical distance between the target marker and the projection marker, the shooting direction of the camera can be adjusted.
    The cooking system according to any one of claims 1 to 12.
  16.  前記トッププレートから離れた位置に配置され、前記トッププレートに向けられたガイド投影部を備え、
     前記トッププレートは、規定の調整目標位置を示す目標マーカを有し、
     前記ガイド投影部は、前記カメラの前記撮影方向を示す投影マーカを投影可能であり、
     前記目標マーカと前記投影マーカとの物理的な距離の差異を縮めることにより、前記カメラの前記撮影方向を調整可能である、
     請求項13に記載の加熱調理システム。
    A guide projection disposed at a position away from the top plate and directed toward the top plate;
    The top plate has a target marker indicating a predetermined adjustment target position,
    The guide projection unit can project a projection marker indicating the shooting direction of the camera,
    By reducing the difference in physical distance between the target marker and the projection marker, the shooting direction of the camera can be adjusted.
    The cooking system according to claim 13.
  17.  前記加熱部は、前記容器を加熱するために誘導磁界を発生させる加熱コイルを有し、
     前記加熱制御部は、前記加熱コイルに高周波電流を供給して前記容器の加熱を行う、
     請求項1から16のいずれか1つに記載の加熱調理システム。
    The heating unit includes a heating coil that generates an induction magnetic field to heat the container,
    The heating control unit heats the container by supplying a high-frequency current to the heating coil.
    The cooking system according to any one of claims 1 to 16.
  18.  前記トッププレートが有する前記マーカ情報は、前記カメラにより撮影された画像において前記カメラの認識可能画素数の1/100以上になる大きさである、
     請求項1から17のいずれか1つに記載の加熱調理システム。
    The marker information of the top plate has a size that is 1/100 or more of the number of recognizable pixels of the camera in an image photographed by the camera.
    The cooking system according to any one of claims 1 to 17.
  19.  前記カメラから前記トッププレートまでの距離は600mm以上、2000mm以下である、
     請求項1から18のいずれか1つに記載の加熱調理システム。
    The distance from the camera to the top plate is 600 mm or more and 2000 mm or less.
    The cooking system according to any one of claims 1 to 18.
  20.  被加熱物を収容する容器が載置され、マーカ情報を有するトッププレートと、
     前記容器を下方から加熱する加熱部と、
    を備えた加熱調理器を撮影するカメラの設置状態を報知する方法であって、
     前記カメラにより撮影された画像を入力し、
     前記画像に含まれる前記マーカ情報を抽出し、
     前記抽出されたマーカ情報が、前記画像の規定の範囲内に含まれているか否かを判定し、
     その判定結果に基づいて、前記カメラの設置状態を報知する報知信号を出力する、
     加熱調理器を撮影するカメラの設置状態を報知する方法。
    A top plate on which a container for containing an object to be heated is placed and having marker information;
    A heating unit for heating the container from below;
    A method of informing the installation state of a camera for photographing a heating cooker equipped with
    Input an image taken by the camera,
    Extracting the marker information contained in the image;
    Determining whether or not the extracted marker information is included in a prescribed range of the image;
    Based on the determination result, outputting a notification signal for notifying the installation state of the camera,
    A method for notifying the installation state of a camera for photographing a cooking device.
PCT/JP2019/014064 2018-04-19 2019-03-29 Heating cooking system, and method for notifying installation state of camera for capturing image of heating cooker. WO2019202951A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201980003899.3A CN111034355A (en) 2018-04-19 2019-03-29 Heating cooking system and method for informing installation state of camera for photographing heating cooking device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-080494 2018-04-19
JP2018080494A JP7142320B2 (en) 2018-04-19 2018-04-19 heating cooker

Publications (1)

Publication Number Publication Date
WO2019202951A1 true WO2019202951A1 (en) 2019-10-24

Family

ID=68239176

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/014064 WO2019202951A1 (en) 2018-04-19 2019-03-29 Heating cooking system, and method for notifying installation state of camera for capturing image of heating cooker.

Country Status (3)

Country Link
JP (1) JP7142320B2 (en)
CN (1) CN111034355A (en)
WO (1) WO2019202951A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102605804B1 (en) * 2022-01-26 2023-11-24 창원대학교 산학협력단 Method for controlling power based on image recognition and electric range supporting the same
WO2024043436A1 (en) * 2022-08-24 2024-02-29 삼성전자주식회사 Cooking appliance and cooking appliance control method
WO2024090773A1 (en) * 2022-10-27 2024-05-02 엘지전자 주식회사 Cooking appliance and method for operating same
KR20240116135A (en) * 2023-01-20 2024-07-29 엘지전자 주식회사 Device controlling cooking process using a visual cooking guidance and method of identifying thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004031089A (en) * 2002-06-25 2004-01-29 Mitsubishi Electric Corp Ih cooking device
JP2005021563A (en) * 2003-07-01 2005-01-27 Namco Ltd Game device, program and information storage medium
JP2009152236A (en) * 2007-12-18 2009-07-09 Olympus Corp Assembling device and position calibrating method
JP2017027424A (en) * 2015-07-24 2017-02-02 セイコーエプソン株式会社 Interactive projector and method of detecting installation state thereof

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11271860A (en) * 1998-03-20 1999-10-08 Casio Comput Co Ltd Camera
JP2000274692A (en) 1999-03-26 2000-10-03 Nippon Avionics Co Ltd System kitchen with infrared sensor
JP2003046838A (en) 2001-08-03 2003-02-14 Olympus Optical Co Ltd Imaging apparatus, and camera-adjusting mechanism
JP4935606B2 (en) 2007-09-28 2012-05-23 オムロン株式会社 Imaging system
JP5325251B2 (en) 2011-03-28 2013-10-23 株式会社日立製作所 Camera installation support method, image recognition method
JP5603302B2 (en) 2011-07-21 2014-10-08 株式会社日立製作所 Vehicle monitoring device
JP6019646B2 (en) 2012-03-21 2016-11-02 株式会社リコー Misalignment detection apparatus, vehicle, and misalignment detection method
JP2015106462A (en) 2013-11-29 2015-06-08 日立アプライアンス株式会社 Heating cooker
WO2017033406A1 (en) 2015-08-27 2017-03-02 パナソニックIpマネジメント株式会社 Heat-cooking device
JP6735513B2 (en) * 2016-06-15 2020-08-05 パナソニックIpマネジメント株式会社 Cooking support method and cooking support system
EP3483507B1 (en) * 2016-07-11 2022-04-27 Panasonic Intellectual Property Management Co., Ltd. Heating cooker with heating chamber

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004031089A (en) * 2002-06-25 2004-01-29 Mitsubishi Electric Corp Ih cooking device
JP2005021563A (en) * 2003-07-01 2005-01-27 Namco Ltd Game device, program and information storage medium
JP2009152236A (en) * 2007-12-18 2009-07-09 Olympus Corp Assembling device and position calibrating method
JP2017027424A (en) * 2015-07-24 2017-02-02 セイコーエプソン株式会社 Interactive projector and method of detecting installation state thereof

Also Published As

Publication number Publication date
JP7142320B2 (en) 2022-09-27
JP2019192355A (en) 2019-10-31
CN111034355A (en) 2020-04-17

Similar Documents

Publication Publication Date Title
WO2019202951A1 (en) Heating cooking system, and method for notifying installation state of camera for capturing image of heating cooker.
WO2019203075A1 (en) Heating cooking system, method for notifying about installation state of temperature detection unit used in heating cooker, and method for adjusting installation state of temperature detection unit used in heating cooker
EP2950614A1 (en) Cooking apparatus
US20150131257A1 (en) Strobe device and imaging device equipped with srobe device
JP6145427B2 (en) Heating control device, cooking system, and program
JP2016020749A (en) Heating control device, heating cooking system, and program
JP2009231235A (en) Induction heating cooking device
JP7149466B2 (en) heating cooker
JP2009140892A (en) Induction cooking device
EP2538662B1 (en) Apparatus, and associated method, for facilitating automatic-exposure at camera device
JP2011090236A (en) Automatic angle setting display machine
CN110832741A (en) Non-contact power supply system
EP4105559B1 (en) Stereovision monitoring system for cooking appliance
JP2011222180A (en) Induction heating cooker
JP4659586B2 (en) Interchangeable lens camera, lens unit, and camera body of interchangeable lens camera
JP2021012841A (en) Heating cooker, heating cooking system, terminal device, and notification method
JP2018148565A (en) Display device
JP7154092B2 (en) Cooking support system
WO2019203259A1 (en) Heating cooker
JP2011243401A (en) Induction heating cooker
JP2010091997A (en) Electronic equipment
JP2020004621A (en) Heating cooker
JP2004297401A (en) Automatic adjuster for projector
JP6977809B2 (en) camera
JP5233570B2 (en) Imaging device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19787696

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19787696

Country of ref document: EP

Kind code of ref document: A1