EP4187158A1 - Lebensmittelzubereitungsanordnung mit einer kameraanordnung - Google Patents

Lebensmittelzubereitungsanordnung mit einer kameraanordnung Download PDF

Info

Publication number
EP4187158A1
EP4187158A1 EP22151776.6A EP22151776A EP4187158A1 EP 4187158 A1 EP4187158 A1 EP 4187158A1 EP 22151776 A EP22151776 A EP 22151776A EP 4187158 A1 EP4187158 A1 EP 4187158A1
Authority
EP
European Patent Office
Prior art keywords
radiation
assembly
food preparation
status
preparation chamber
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP22151776.6A
Other languages
English (en)
French (fr)
Inventor
Weimin Xiao
Jingwei Tan
Wen SUN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Versuni Holding BV
Original Assignee
Versuni Holding BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Versuni Holding BV filed Critical Versuni Holding BV
Priority to EP22801493.2A priority Critical patent/EP4437276A1/de
Priority to CN202280077650.9A priority patent/CN118369542A/zh
Priority to PCT/EP2022/079081 priority patent/WO2023094078A1/en
Publication of EP4187158A1 publication Critical patent/EP4187158A1/de
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24—HEATING; RANGES; VENTILATING
    • F24C—DOMESTIC STOVES OR RANGES ; DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
    • F24C7/00—Stoves or ranges heated by electric energy
    • F24C7/08—Arrangement or mounting of control or safety devices
    • F24C7/082—Arrangement or mounting of control or safety devices on ranges, e.g. control panels, illumination
    • F24C7/085—Arrangement or mounting of control or safety devices on ranges, e.g. control panels, illumination on baking ovens

Definitions

  • This invention relates to a food preparation assembly having a food preparation chamber and a camera assembly for obtaining one or more images inside the food preparation chamber.
  • the invention further relates to a method of controlling a camera assembly suitable for obtaining one or more images inside a food preparation chamber of a food preparation assembly, and a computer program for implementing the method.
  • the invention yet further relates to a method of determining a relationship for adjusting an image characteristic of one or more images inside a food preparation chamber of a food preparation assembly.
  • Including a camera in the food preparation assembly can play an important role in smart assisted food preparation, e.g. cooking.
  • a food type can be recognized by food image recognition and a cooking setting can be determined based on food image analysis results.
  • Other applications of cameras in food preparation assemblies include cooking process control, browning control, remote monitoring, burning prevention, and content for social media sharing.
  • a food preparation assembly comprising: a food preparation chamber; a camera assembly for obtaining one or more images inside the food preparation chamber, the camera assembly being controllable to adjust an image characteristic of the one or more images; a radiation assembly controllable to adopt a radiation status in which the radiation assembly emits radiation comprising visible light inside the food preparation chamber; and one or more processors configured to: identify the radiation status; and control the camera assembly to adjust the image characteristic using a predetermined relationship for adjusting the image characteristic according to the identified radiation status.
  • Using such a predetermined relationship to adjust the image characteristic, such as exposure and/or white balance, according to the identified radiation status of the radiation assembly can assist to provide faster and/or more repeatable image characteristic adjustment relative to, for instance, adjustment based only on an optical condition detected inside the food preparation chamber when obtaining the image(s).
  • the camera assembly may be configured to obtain a sequence of images of the inside of the food preparation chamber, e.g. a sequence of images constituting a video of the inside of the food preparation chamber.
  • the camera assembly may be configured to obtain a still image of the inside of the food preparation chamber.
  • the image(s) can, for example, be brought into closer conformity with a "real" view of the food ingredients perceptible with the naked eye, etc.
  • the radiation assembly is controllable to select the radiation status from a plurality of radiation statuses, and the one or more processors is or are configured to identify the selected radiation status, with the predetermined relationship permitting adjusting of the image characteristic according to the identified selected radiation status.
  • the image characteristic can accordingly be adjusted according to which of the plurality of radiation statuses is selected.
  • the plurality of radiation statuses can comprise: a first radiation status; and a second radiation status, with the first radiation status causing a first optical condition in the food preparation chamber, and the second radiation status causing a second optical condition in the food preparation chamber which is different from the first optical condition.
  • the predetermined relationship may be determined such that the image characteristic is adjusted to compensate for the difference between the first optical condition and the second optical condition.
  • the image(s) obtained when the first radiation status is adopted can be comparable to the image(s) obtained when the second radiation status is adopted.
  • adjustment of the image characteristic includes adjustment of the exposure of the image(s) to compensate for the difference in intensity.
  • adjustment of the image characteristic includes adjustment of the colour, e.g. white, balance of the image(s) to compensate for the difference in spectral composition.
  • the plurality of radiation statuses can include further radiation statuses in addition to the above-described first and second radiation statuses, such as a third radiation status, a fourth radiation status, a fifth radiation status, and so on.
  • the predetermined relationship may be determined such that the image characteristic is adjusted to compensate for differences between the respective optical conditions caused by selection of each of the radiation statuses.
  • the radiation assembly comprises at least one lamp for illuminating the inside of the food preparation chamber.
  • the radiation status comprises an illumination status of the, e.g. each of the, at least one lamp.
  • the illumination status can, for instance, be an on/off status of the, e.g. each of the, at least one lamp.
  • the illumination status can be an intensity of the illumination provided by the, e.g. each of the, at least one lamp and/or the illumination status can be a measure of the spectral composition of the illumination provided by the, e.g. each of the, at least one lamp.
  • the radiation assembly comprises at least one heating element arranged to radiate inside the food preparation chamber.
  • the radiation status comprises a heating status of the, e.g. each of the, at least one heating element.
  • the heating status can, for instance, be an on/off status of the, e.g. each of the, at least one heating element.
  • the radiation status comprises the illumination status of the at least one lamp and the heating status of the at least one heating element
  • the illumination status can be an on/off status of the at least one lamp, with the heating status being an on/off status of the at least one heating element.
  • the heating status can be a degree of heating provided by the, e.g. each of the, at least one heating element and/or the heating status can be a measure of the spectral composition of the radiation provided by the, e.g. each of the, at least one heating element.
  • the food preparation assembly may comprise a control unit having a control configuration arranged to control the radiation assembly to adopt the radiation status.
  • the one or more processors is or are configured to identify the radiation status based on said control configuration.
  • the radiation status can be obtained, in other words directly obtained, from the control unit controlling the radiation assembly. This may advantageously obviate sensing of an optical condition inside the food preparation chamber in order to adjust the image characteristic.
  • the one or more processors may be configured to control the camera assembly to adjust the image characteristic (using the predetermined relationship) to coincide with the change of the radiation status. This may enable particularly responsive adjustment of the image characteristic which may be especially useful, for example, when the camera assembly is configured to obtain a sequence of images, e.g. video, during the change of the radiation status.
  • the radiation status e.g. each of the radiation statuses when there the radiation status is selectable from a plurality of radiation statuses, is associated with a power consumption of the radiation assembly, and the one or more processors is or are configured to identify the radiation status based on the (respective) power consumption of the radiation assembly.
  • the food preparation assembly may comprise a sensor for sensing radiation of the radiation assembly.
  • the one or more processors is or are configured to identify the radiation status based on the sensed radiation.
  • the radiation status can be identified according to the radiation detected via the sensor.
  • the camera assembly comprises an image capture module
  • the one or more processors may be configured to control at least one image capture setting of the image capture module according to the identified radiation status to adjust the image characteristic.
  • the identified radiation status may thus be used to adjust the acquisition of the image(s).
  • the at least one image capture setting may, for instance, comprise an aperture size, a shutter speed and/or a sensitivity setting.
  • the food preparation assembly may comprise an image processing module, and the one or more processors may be configured to control at least one image processing setting of the image processing module according to the identified radiation status to adjust the image characteristic.
  • the image processing module can, for example, be included in the camera assembly, a user device, such as a smart phone or tablet computer, and/or a cloud-based server.
  • the identified radiation status is used to adjust the processing of the image(s) by the image processing module.
  • the at least one processing setting may, for instance, comprise a colour balance setting.
  • a colour balance setting can, for example, be a white balance setting.
  • the food preparation assembly comprises or is a domestic food preparation assembly.
  • the food preparation assembly comprises a domestic kitchen appliance.
  • Examples of such a domestic kitchen appliance include an air fryer, oven, steamer, pressure cooker and rice cooker.
  • the camera assembly is integral, in other words built-in, to such a domestic kitchen appliance.
  • the camera assembly is a removable or detachable component of the food preparation assembly, e.g. domestic food preparation assembly.
  • a window into the food preparation chamber may be provided, and the camera assembly may be arranged such as to obtain the image(s) inside the food preparation chamber via the window in order to assemble the food preparation assembly, e.g. the domestic food preparation assembly.
  • the camera assembly and optionally at least one of the one or more processors, may be included in user device separate from a kitchen appliance comprising the food preparation chamber and the radiation assembly, such as a smart phone or tablet computer.
  • the processor(s) may alternatively or additionally be included in a cloud-based server.
  • the food preparation assembly e.g. domestic food preparation assembly, may be assembled by arranging the camera assembly such as to obtain the image(s) inside the food preparation chamber via the window.
  • the food preparation chamber and the radiation assembly are included in a kitchen appliance, e.g. domestic kitchen appliance, and the processor(s) included in the user device and/or the cloud-based server is or are in communication, e.g. wireless communication, with the kitchen appliance, e.g. with the above-described control unit, in order to enable the processor(s) to identify the radiation status and control the camera assembly to adjust the image characteristic of the one or more images using the predetermined relationship.
  • a kitchen appliance e.g. domestic kitchen appliance
  • the processor(s) included in the user device and/or the cloud-based server is or are in communication, e.g. wireless communication, with the kitchen appliance, e.g. with the above-described control unit, in order to enable the processor(s) to identify the radiation status and control the camera assembly to adjust the image characteristic of the one or more images using the predetermined relationship.
  • a method of controlling a camera assembly suitable for obtaining one or more images inside a food preparation chamber of a food preparation assembly the food preparation assembly further comprising a radiation assembly controllable to adopt a radiation status in which the radiation assembly emits radiation comprising visible light inside the food preparation chamber, the method comprising: identifying the radiation status; and controlling the camera assembly to adjust an image characteristic of the one or more images using a predetermined relationship for adjusting the image characteristic according to the identified radiation status.
  • the method may further comprise operating the camera assembly to obtain one or more images inside the food preparation chamber.
  • the image characteristic may be adjusted according to the identified radiation status in the obtained one or more images.
  • the radiation assembly is controllable to select the radiation status from a plurality of radiation statuses, and the identifying comprises identifying the selected radiation status, with the predetermined relationship permitting adjusting of the image characteristic according to the identified selected radiation status.
  • the image characteristic can accordingly be adjusted according to which of the plurality of radiation statuses is selected.
  • the plurality of radiation statuses can comprise: a first radiation status; and a second radiation status, with the first radiation status causing a first optical condition in the food preparation chamber, and the second radiation status causing a second optical condition in the food preparation chamber which is different from the first optical condition.
  • the predetermined relationship may be determined such that the image characteristic is adjusted to compensate for the difference between the first optical condition and the second optical condition.
  • the radiation assembly comprises at least one lamp for illuminating the inside of the food preparation chamber.
  • the identifying comprises identifying an illumination status of the, e.g. each of the, at least one lamp.
  • the radiation assembly comprises at least one heating element arranged to radiate inside the food preparation chamber.
  • the identifying comprises identifying a heating status of the, e.g. each of the, at least one heating element.
  • the identifying may comprise identifying the illumination status of the at least one lamp and identifying the heating status of the at least one heating element.
  • the illumination status can, for example, be an on/off status of the at least one lamp, with the heating status being an on/off status of the at least one heating element.
  • the food preparation assembly may comprise a control unit having a control configuration arranged to control the radiation assembly to adopt the radiation status.
  • the identifying may comprise identifying the radiation status based on the control configuration.
  • the method comprises determining a power consumption of the radiation assembly, with the identifying comprising identifying the radiation status based on the determined power consumption.
  • the food preparation assembly may comprise a sensor for sensing radiation of the radiation assembly.
  • the identifying may comprise identifying the radiation status based on the sensed radiation.
  • the camera assembly comprises an image capture module
  • the controlling comprises controlling at least one image capture setting of the image capture module according to the identified radiation status to adjust the image characteristic.
  • the at least one image capture setting may, for instance, comprise an aperture size, a shutter speed and/or a sensitivity setting.
  • the food preparation assembly may comprise an image processing module, and the controlling comprises controlling at least one image processing setting of the image processing module according to the identified radiation status to adjust the image characteristic.
  • the at least one processing setting may, for instance, comprise a colour balance setting.
  • a colour balance setting can, for example, be a white balance setting.
  • a computer program comprising computer program code which is configured, when said computer program is run on one or more processors included in a food preparation assembly further comprising a food preparation chamber, a camera assembly for obtaining one or more images inside the food preparation chamber, and a radiation assembly controllable to adopt a radiation status in which the radiation assembly emits radiation comprising visible light inside the food preparation chamber, to cause said one or more processors to implement the method according to any of the embodiments described herein.
  • One or more non-transitory computer readable media may be provided, which non-transitory computer readable media have a computer program stored thereon, with the computer program comprises computer program code which is configured, when the computer program is run on the one or more processors, to cause the one or more processors to implement the method according to any of the embodiments described herein.
  • the one or more processors can be included in a kitchen appliance included in the food preparation assembly, in a user device, for example a smart phone or tablet computer, separate from such a kitchen appliance, and/or in a cloud-based server.
  • a method of determining a relationship for adjusting an image characteristic of one or more images inside a food preparation chamber of a food preparation assembly comprising a radiation assembly, the one or more images being obtained using a camera assembly, the method comprising: identifying at least one radiation status of the radiation assembly in which radiation comprising visible light is emitted inside the food preparation chamber; measuring, for each of the at least one radiation status, an optical condition; and determining, using said optical condition measured for each of the identified at least one radiation status, said relationship for adjusting the image characteristic according to the identified at least one radiation status.
  • This method may be used to establish/determine the above-described predetermined relationship for adjusting the image characteristic according to the identified radiation status.
  • embodiments described herein in relation to the food preparation assembly and the method of controlling the camera assembly may be applicable to the method of determining the relationship, and embodiments described herein in relation to the method of determining the relationship may be applicable to the food preparation assembly and the method of controlling the camera assembly.
  • a food preparation assembly which can also be referred to as a food preparation system, comprising a food preparation chamber, and a camera assembly for obtaining one or more images inside the food preparation chamber.
  • the camera assembly is controllable to adjust an image characteristic of the one or more images.
  • the food preparation assembly comprises a radiation assembly controllable to adopt a radiation status in which the radiation assembly emits radiation comprising visible light inside the food preparation chamber.
  • One or more processors is or are configured to: identify the radiation status; and control the camera assembly to adjust the image characteristic using a predetermined relationship for adjusting the image characteristic according to the identified radiation status.
  • a method of controlling a camera assembly suitable for obtaining one or more images inside a food preparation chamber of a food preparation assembly a computer program for implementing the method, and a method of determining a relationship for adjusting an image characteristic of one or more images inside a food preparation chamber of a food preparation assembly.
  • the one or more images inside the food preparation chamber is desirable for a number of reasons.
  • the one or more images can be used for recognizing food present in the food preparation chamber, cooking process monitoring, and/or cooking process control based on analysis of the image(s).
  • Consistent image quality is particularly important for such uses.
  • ensuring sufficiently consistent quality of the image(s) can be challenging, particularly due to changing optical conditions within the food preparation chamber resulting from adjustments in operation of the radiation assembly also included in the food preparation assembly, which radiation assembly emits radiation comprising visible light inside the food preparation chamber.
  • heating element(s) included in the food preparation assembly may shift between on and off statuses during cooking.
  • the illumination intensity and colour temperature in the food preparation chamber may therefore vary significantly due to the heating element(s) shifting between such statuses.
  • both the colour and brightness of the image(s) may be correspondingly significantly affected.
  • the capability of the image(s) to represent the appearance of the food may be adversely affected. This may present difficulty in, in particular, food recognition, cooking process control, browning control, doneness status determination, remote monitoring, and/or burning prevention, etc. using the image(s).
  • the camera assembly can, for instance, itself detect an optical condition within the food preparation chamber and adjust an image characteristic of the image(s) based on such a detected optical condition, there may be a lag to such adjustment and/or the adjustment may not be sufficiently repeatable to ensure sufficiently consistent quality of the image(s).
  • the present disclosure is based on the insight that identifying the radiation status of the radiation assembly, and using the predetermined relationship to adjust the image characteristic, such as exposure and/or white balance, according to the identified radiation status can assist to provide faster and/or more repeatable image characteristic adjustment relative to, for instance, adjustment based only on an optical condition detected inside the food preparation chamber when obtaining the image(s).
  • the thus obtained image(s) can therefore be usefully employed in, for example, food recognition, cooking process control, browning control, doneness status determination, remote monitoring, and/or burning prevention based on analysis of the image(s).
  • the present disclosure provides a method of compensating for change(s) in illuminance and/or colour temperature caused by the radiation assembly, e.g. heating elements and/or illumination system/lamps, shifting between statuses.
  • Such a method may, for example, adjust exposure and/or white balance during cooking for a camera assembly-integrated kitchen appliance, e.g. cooking device.
  • FIG. 1 schematically depicts a food preparation assembly 100 according to an example.
  • the food preparation assembly 100 comprises a food preparation chamber 102 in which food ingredients 103 are receivable.
  • the food preparation assembly 100 comprises a camera assembly 104 for obtaining one or more images inside the food preparation chamber 102.
  • the camera assembly 104 may be configured to obtain a sequence of images, e.g. a sequence of images constituting a video.
  • the camera assembly 104 may be configured to obtain a still image of the inside of the food preparation chamber 102.
  • the camera assembly 104 may be arranged such as to enable obtaining of the one or more images of the food ingredients 103 received in the food preparation chamber 102.
  • the camera assembly 104 is arranged at or proximal to the ceiling of the food preparation chamber 102 in order to obtain image(s) of the food ingredients from above.
  • the camera assembly 104, or at least the optical sensing element thereof is arranged, for instance, at a side of the food preparation chamber 102 between the base and the ceiling of the food preparation chamber 102.
  • the food preparation assembly 100 comprises a radiation assembly 106A, 106B, 108A, 108B configured to emit radiation comprising visible light inside the food preparation chamber 102.
  • the radiation assembly 106A, 106B, 108A, 108B is controllable, e.g. by a user of the food preparation assembly 100, to adopt a radiation status in which the radiation assembly 106A, 106B, 108A, 108B emits radiation comprising visible light inside the food preparation chamber 102.
  • the radiation assembly 106A, 106B, 108A, 108B comprises at least one lamp 106A, 106B for illuminating the inside of the food preparation chamber 102.
  • the radiation status can comprise an illumination status of the, e.g. each of the, at least one lamp 106A, 106B.
  • the lamp(s) 106A, 106B can, for example, be controlled by the user, e.g. by operating a suitable user interface included in the food preparation assembly 100 for enabling the user to control the lamp(s) 106A, 106B. This may, for example, assist the user to visually monitor the process taking place in the food preparation chamber 102. The light from the lamp(s) 106A, 106B may thus alter an optical condition within the food preparation chamber 102.
  • the lamp(s) 106A, 106B may, for example, be or comprise light emitting diode(s), although any suitable lamp type, such as filament lamps, can be contemplated.
  • the lamps 106A, 106B are arranged at or proximal to the ceiling of the food preparation chamber 102, although other position(s) for such lamp(s) 106A, 106B can be contemplated provided the lamp(s) 106A, 106B can illuminate at least part of the inside of the food preparation chamber 102.
  • the illumination status can, for instance, comprise an on/off status of the, e.g. each of the, at least one lamp 106A, 106B.
  • the illumination status can comprise an intensity of the illumination provided by the, e.g. each of the, at least one lamp 106A, 106B.
  • the illumination status can comprise a measure of the spectral composition of the illumination provided by the, e.g. each of the, at least one lamp 106A, 106B.
  • the at least one lamp 106A, 106B comprises a plurality of lamps 106A, 106B, such as two (as shown in FIG. 1 ), three, four, five, six or more lamps 106A, 106B, one or more of these lamps 106A, 106B may be operable independently of the other(s).
  • the illumination status may comprise a combination of the individual illumination statuses of each of the independently operable lamp(s) 106A, 106B.
  • the radiation assembly 106A, 106B, 108A, 108B comprises at least one heating element 108A, 108B arranged to radiate inside the food preparation chamber 102.
  • the radiation status can comprise a heating status of the, e.g. each of the, at least one heating element 108A, 108B.
  • the at least one heating element 108A, 108B may be used to warm or cook the food ingredients 103 received in the food preparation chamber 102.
  • the radiation emitted by the heating element(s) 108A, 108B may include visible light. Such visible light may alter an optical condition within the food preparation chamber 102.
  • the heating element(s) 108A, 108B may, for example, be or comprise resistive heating element(s), although any suitable heating element type can be contemplated.
  • the heating elements 108A, 108B are arranged at or proximal to the ceiling of the food preparation chamber 102, although other position(s) for such heating element(s) 108A, 108B can be contemplated provided the heating element(s) 108A, 108B can emit heat radiation into at least part of the inside of the food preparation chamber 102.
  • the heating status can, for instance, be an on/off status of the, e.g. each of the, at least one heating element 108A, 108B.
  • the heating status can be a degree of heating provided by the, e.g. each of the, at least one heating element 108A, 108B and/or the heating status can be a measure of the spectral composition of the radiation provided by the, e.g. each of the, at least one heating element 108A, 108B.
  • the at least one heating element 108A, 108B comprises a plurality of heating elements 108A, 108B, such as two (as shown in FIG. 1 ), three, four, five, six or more heating elements 108A, 108B, one or more of these heating elements 108A, 108B may be operable independently of the other(s).
  • the heating status may comprise a combination of the individual heating statuses of each of the independently operable heating element(s) 108A, 108B.
  • the radiation status comprises the illumination status of the at least one lamp 106A, 106B and the heating status of the at least one heating element 108A, 108B
  • the illumination status can, for example, be an on/off status of the at least one lamp 106A, 106B, with the heating status being an on/off status of the at least one heating element 108A, 108B.
  • the food preparation assembly 100 comprises a control unit 110 having a control configuration arranged to control the radiation assembly 106A, 106B, 108A, 108B to adopt the radiation status.
  • the radiation status can be obtained, in other words directly obtained, from the control unit 110 controlling the radiation assembly. This may advantageously obviate sensing of an optical condition inside the food preparation chamber 102 for the purpose of adjusting the image characteristic.
  • the food preparation assembly 100 comprises a user interface (not visible in FIG. 1 ) configured to permit user selection of the radiation status.
  • the control configuration can, for example, correspond to or be generated from the user selection.
  • control unit 110 is configured to receive a recipe input, e.g. a recipe instruction input, and generate the control configuration based on the received recipe input.
  • control configuration can be automatically generated by the control unit 110 from the recipe input.
  • control configuration comprises a control sequence which controls the radiation status of the radiation assembly 106A, 106B, 108A, 108B overtime.
  • the recipe input can be inputted in any suitable manner.
  • the recipe input can be received by the control unit 110 from a recipe database in response to a user selection from the recipe database.
  • an optical condition e.g. an intensity and/or spectral composition of visible light
  • an optical condition e.g. an intensity and/or spectral composition of visible light
  • the food preparation assembly 100 comprises one or more processors 112 configured to identify the radiation status, and control the camera assembly 104 to adjust the image characteristic using a predetermined relationship for adjusting the image characteristic according to the identified radiation status.
  • Using such a predetermined relationship to adjust the image characteristic, such as exposure and/or white balance, according to the identified radiation status of the radiation assembly 106A, 106B, 108A, 108B can assist to provide faster and/or more repeatable image characteristic adjustment relative to, for instance, adjustment based only on an optical condition detected inside the food preparation chamber 102 when obtaining the image(s).
  • the radiation assembly 106A, 106B, 108A, 108B is controllable to select the radiation status from a plurality of radiation statuses, and the one or more processors 112 is or are configured to identify the selected radiation status, with the predetermined relationship permitting adjusting of the image characteristic according to the identified selected radiation status.
  • the image characteristic can accordingly be adjusted according to which of the plurality of radiation statuses is selected.
  • the plurality of radiation statuses can comprise: a first radiation status; and a second radiation status, with the first radiation status causing a first optical condition in the food preparation chamber 102, and the second radiation status causing a second optical condition in the food preparation chamber 102 which is different from the first optical condition.
  • the predetermined relationship may be determined such that the image characteristic is adjusted to compensate for the difference between the first optical condition and the second optical condition.
  • the image(s) obtained when the first radiation status is adopted can be comparable to the image(s) obtained when the second radiation status is adopted.
  • adjustment of the image characteristic includes adjustment of the exposure of the image(s) to compensate for the difference in intensity.
  • adjustment of the image characteristic includes adjustment of the colour, e.g. white, balance of the image(s) to compensate for the difference in spectral composition.
  • the food preparation assembly 100 for example the above-described control unit 110 included in the food preparation assembly 100, is configured to control the heating element(s) 108A, 108B according to a cooking program in which the heating element(s) 108A, 108B is or are controlled such that the food preparation chamber 102 is at a first temperature for a first predetermined duration, and then, e.g. when a doneness level of the food ingredients 103 is approaching, is at as second temperature lower than the first temperature.
  • the radiation status of the radiation assembly 106A, 106B, 108A, 108B, and in particular the heating status of the heating element(s) 108A, 108B changes from a first radiation status to a second radiation status in order to implement the temperature reduction from the first temperature to the second temperature.
  • the first radiation status may, for instance, correspond to both of the heating elements 108A, 108B being on, with the second radiation status corresponding to one of the heating elements 108A, 108B being on and the other of the heating elements 108B, 108A being off.
  • the alteration in the optical condition, e.g. intensity and/or spectral composition of visible light, inside the food preparation chamber 102 resulting from the radiation status changing from the first radiation status to the second radiation status may nonetheless be compensated for by the one or more processors 112 controlling the camera assembly 104 to adjust the image characteristic.
  • the predetermined relationship used by the processor(s) 112 may be determined such that the image characteristic is adjusted to compensate for the difference between the first optical condition and the second optical condition.
  • This compensating may, in turn, improve the image-based control which can be exerted over the cooking process, e.g. selection/estimation of the time required at the second predetermined temperature. This is because the image(s) obtained when the radiation assembly 106A, 106B, 108A, 108B adopts the first radiation status may be more reliably compared with the image(s) obtained when the radiation assembly 106A, 106B, 108A, 108B adopts the second radiation status.
  • the one or more processors 112 may be configured to control the camera assembly 104 to adjust the image characteristic to coincide with the change of the radiation status. This may enable particularly responsive adjustment of the image characteristic which may be especially useful, for example, when the camera assembly 104 is configured to obtain a sequence of images, e.g. constituting a video, during the change of the radiation status.
  • the processor(s) 112 Whilst the processor(s) 112 is or are shown in FIG. 1 receiving data, e.g. the control configuration, from the control unit 110, this is not intended to be limiting. In other embodiments, which may be an alternative or in addition to the control configuration being used by the processor(s) 112 to identify the radiation status, the food preparation assembly 100 may include a sensor (not visible) for sensing radiation of the radiation assembly 106A, 106B, 108A, 108B. In such embodiments, the one or more processors 112 is or are configured to identify the radiation status based on the radiation sensed by the sensor.
  • the one or more processors 112 may be configured to identify the radiation status based on a power consumption of the radiation assembly 106A, 106B, 108A, 108B.
  • the camera assembly 104 comprises an image capture module 114, and the one or more processors 112 is or are configured to control at least one image capture setting of the image capture module 114 according to the identified radiation status to adjust the image characteristic.
  • the identified radiation status may thus be used to adjust the acquisition of the image(s).
  • the at least one image capture setting can, for example, comprise or be an aperture size, a shutter speed and/or a sensitivity setting.
  • the camera assembly 104 may, in at least some embodiments, further comprise an image processing module 116.
  • the image processing module 116 may process the image(s) acquired by the image capture module 114, thereby to obtain the image(s).
  • the image processing module 116 may alternatively or additionally be included in a user device, such as a smart phone or tablet computer, separate from a kitchen appliance in which the food preparation chamber 102 is included, and/or in a cloud-based server.
  • the one or more processors 112 may be configured to control at least one image processing setting of the image processing module 116 according to the identified radiation status to adjust the image characteristic.
  • the identified radiation status can be used to adjust the processing of the image(s) by the image processing module 116 included in the camera assembly 104.
  • the at least one processing setting may, for instance, comprise a colour balance setting.
  • a colour balance setting can, for example, be a white balance setting.
  • the aperture size may be reduced and/or the shutter speed increased and/or the sensitivity decreased to compensate for this higher intensity of visible light.
  • the colour balance e.g. white balance
  • the colour balance may be adjusted to compensate for a different spectral composition of visible light resulting from adoption of the second radiation status after adoption of the first radiation status.
  • the one or more processors 112, the image processing module 116 and/or the control unit 110 can be implemented in numerous ways, with software and/or hardware, to perform the various functions required.
  • the processor(s) 112, the image processing module 116 and/or the control unit 110 may, for example, employ one or more microprocessors programmed using software (e.g., microcode) to perform the required functions.
  • microprocessors programmed using software (e.g., microcode) to perform the required functions.
  • processor components that may be employed in various embodiments of the present disclosure include, but are not limited to, conventional microprocessors, application specific integrated circuits (ASICs), and field-programmable gate arrays (FPGAs).
  • the one or more processors 112, the image processing module 116 and/or the control unit 110 may be associated with one or more storage media such as volatile and non-volatile computer memory such as RAM, PROM, EPROM, and EEPROM.
  • the storage media may be encoded with one or more programs that, when executed on one or more processors and/or controllers, perform the required functions.
  • Various storage media may be fixed within a processor or controller or may be transportable, such that the one or more programs stored thereon can be loaded into the one or more processors 112, the image processing module 116 and/or the control unit 110.
  • the image processing can be implemented on the image processing module 116 included in the camera module 104, this is not intended to be limiting, and in other examples the image processing module 116 may be alternatively or additionally included in a cloud-based server and/or in a separate user device, such as a smart phone or tablet computer.
  • the food preparation assembly 100 is a domestic food preparation assembly 100, e.g. a domestic food preparation assembly comprising a domestic kitchen appliance.
  • Examples of such a domestic kitchen appliance include an air fryer, oven, steamer, pressure cooker or rice cooker.
  • the camera assembly 104 is integral to such a domestic kitchen appliance.
  • the camera assembly 104 is a removable or detachable component of the food preparation assembly 100, e.g. domestic food preparation assembly.
  • a window (not visible) into the food preparation chamber 102 may be provided, and the camera assembly 104 may be arranged such as to obtain the image(s) inside the food preparation chamber 102 via the window in order to assemble the food preparation assembly 100, e.g. the domestic food preparation assembly 100.
  • the camera assembly 104 and optionally at least one of the one or more processors 112, may be included in a separate user device, such as a smart phone or tablet computer.
  • the processor(s) 112 may alternatively or additionally be included in a cloud-based server.
  • the food preparation assembly 100 e.g. domestic food preparation assembly 100, may be assembled by arranging the camera assembly 104 such as to obtain the image(s) inside the food preparation chamber 102 via the window.
  • the food preparation chamber 102 and the radiation assembly 106A, 106B, 108A, 108B are included in a kitchen appliance, e.g. domestic kitchen appliance, and the processor(s) 112 included in the user device and/or the cloud-based server is or are in communication, e.g. wireless communication, with the kitchen appliance, e.g. with the above-described control unit 110, in order to enable the processor(s) 112 to identify the radiation status and control the camera assembly 104 to adjust the image characteristic of the one or more images.
  • a kitchen appliance e.g. domestic kitchen appliance
  • the processor(s) 112 included in the user device and/or the cloud-based server is or are in communication, e.g. wireless communication, with the kitchen appliance, e.g. with the above-described control unit 110, in order to enable the processor(s) 112 to identify the radiation status and control the camera assembly 104 to adjust the image characteristic of the one or more images.
  • the food preparation assembly 100 is a kitchen appliance, e.g. cooking appliance, in which the camera assembly 104, the radiation assembly 106A, 106B, 108A, 108B, e.g. comprising heating element(s) 108A, 108B and/or illumination system/lamps 106A, 106B, processor(s) 112 and control unit 110 are integral components, as shown in FIG. 1 .
  • the kitchen appliance can also include a data processing unit (e.g. comprising the above-described image processing module 116, and a data analysis module), and a storage unit for storing data.
  • FIG. 3 provides a flowchart of a method 200 of operating a camera assembly according to an example.
  • the camera assembly may be suitable for obtaining one or more images inside a food preparation chamber of a food preparation assembly further comprising a radiation assembly controllable to adopt a radiation status in which the radiation assembly emits radiation comprising visible light inside the food preparation chamber.
  • the food preparation assembly may, for example, be the food preparation assembly 100 according to any of the embodiments described above.
  • the method 200 comprises identifying 202 the radiation status, and controlling 204 the camera assembly to adjust an image characteristic of the one or more images using a predetermined relationship for adjusting the image characteristic according to the identified radiation status.
  • the method 200 may further comprise operating 206 the camera assembly to obtain one or more images inside the food preparation chamber.
  • the image characteristic may be adjusted according to the identified radiation status in the obtained one or more images, as previously described.
  • the camera assembly may be operated to acquire the image(s) and the image processing setting(s) may be subsequently adjusted such that at least part of 204 can take place after 206.
  • the radiation assembly is controllable to select the radiation status from a plurality of radiation statuses, and the identifying 202 comprises identifying the selected radiation status, with the predetermined relationship permitting adjusting of the image characteristic according to the identified selected radiation status.
  • the image characteristic can accordingly be adjusted according to which of the plurality of radiation statuses is selected.
  • the plurality of radiation statuses can comprise: a first radiation status; and a second radiation status, with the first radiation status causing a first optical condition in the food preparation chamber, and the second radiation status causing a second optical condition in the food preparation chamber which is different from the first optical condition.
  • the predetermined relationship may be determined such that the image characteristic is adjusted to compensate for the difference between the first optical condition and the second optical condition, as previously described.
  • FIG. 4 graphically represents adjustment of shutter speed and white balance according to statuses of a radiation assembly as cooking progresses.
  • the two lamps 106A, 106B are continuously illuminating the inside of the food preparation chamber 102 during the entire cooking process, but the heating element 108A and the heating element 108B simultaneously shift between on and off radiation statuses in order to control the temperature within the food preparation chamber 102 during the cooking process.
  • the illumination intensity in the food preparation chamber 102 may be higher and the colour temperature may be lower than when the second radiation status ("Status 2") is adopted by both of the heating elements 108A, 108B being off. Accordingly, the shutter speed may be increased, in this case such that the exposure time decreases from 1/100 s to 1/150 s, and the white balance may be adjusted from 5500 K to 7500 K in response to the radiation status changing from the second radiation status ("Status 2") to the first radiation status ("Status 1"). The adjustment in these settings may assist to compensate for the change in the illumination intensity and colour temperature caused by the change in radiation status.
  • first and second radiation statuses are shown in Table 1.
  • the optical condition, in this case illumination intensity and color temperature, in the food preparation chamber 102 resulting from each of the radiation statuses is measured for each of the first and second radiation statuses before the cooking process.
  • Suitable image capture setting(s) and/or image processing setting(s) are then determined, as also shown in the Table 1.
  • Table 1 First radiation status Second radiation status Radiation assembly 106A, 106B, 108A, 108B Lamp 106A On On Lamp 106B On On Heating element 108A On Off Heating element 108B On Off Optical condition inside the food preparation chamber 102 Illumination intensity 600 Lux 400 Lux Colour temperature 3500 K 5500 K Image capture settings and image processing settings of the camera assembly 104 Aperture F 2.8 F 2.8 Exposure time (s) 1/150 1/100 ISO 100 100 White balance 7500 K 5500 K
  • the radiation status can be identified from the power consumption of the radiation assembly 106A, 106B, 108A, 108B and/or obtained from the control unit 110, then the image capture setting(s) and/or the image processing setting(s) is or are selected according to Table 1.
  • a computer program comprising computer program code may be configured, when said computer program is run on one or more processors 112 included in a food preparation assembly 100 further comprising a food preparation chamber 102, a camera assembly 104 for obtaining one or more images inside the food preparation chamber, and a radiation assembly 106A, 106B, 108A, 108B controllable to adopt a radiation status in which the radiation assembly emits radiation comprising visible light inside the food preparation chamber 102, to cause said one or more processors 112 to implement the method 200 according to any of the embodiments described herein.
  • the one or more processors 112 can be included in a kitchen appliance, e.g. a kitchen appliance comprising the food preparation chamber 102 and the radiation assembly 106A, 106B, 108A, 108B, which kitchen appliance is included in the food preparation assembly.
  • a kitchen appliance e.g. a kitchen appliance comprising the food preparation chamber 102 and the radiation assembly 106A, 106B, 108A, 108B, which kitchen appliance is included in the food preparation assembly.
  • the one or more processors 112 can be included in a user device, for example a smart phone or tablet computer, separate from such a kitchen appliance, and/or in a cloud-based server.
  • FIG. 5 provides a flowchart of a method 300 of determining a relationship for adjusting an image characteristic of one or more images inside a food preparation chamber of a food preparation assembly comprising a radiation assembly; the one or more images being obtained using a camera assembly.
  • the food preparation assembly may, for example, be the food preparation assembly 100 according to any of the embodiments described above.
  • the method 300 comprises identifying 302 at least one radiation status of the radiation assembly in which radiation comprising visible light is emitted inside the food preparation chamber, and measuring 304, for each of the at least one radiation status, an optical condition.
  • the optical condition can, for instance, be measured inside the food preparation chamber 102, e.g. using one or more suitable optical sensors.
  • the method 300 further comprises determining 306, using the optical condition measured for each of the identified at least one radiation status, said relationship for adjusting the image characteristic according to the identified at least one radiation status.
  • This method 300 may be used to determine the above-described predetermined relationship for adjusting the image characteristic according to the identified radiation status.
  • FIG. 6 provides a flowchart for illustrating how the method 300 shown in FIG. 5 can be applied to an exemplary method 200 of operating a camera assembly.
  • FIG. 6 may, for example, be regarded as illustrating a workflow of the development of embodiments of the present disclosure.
  • the method 300 may be regarded as being included in a product development phase, and the method 200 can be regarded as being included in a cooking phase, e.g. during use, of the food preparation assembly 100.
  • At least one radiation status of the radiation assembly in which radiation comprising visible light is emitted inside the food preparation chamber is identified in 302.
  • This identifying 302 may comprise identifying all potential combinations of components capable of forming part of the radiation assembly, in other words the heating element(s) and/or the illumination system/lamp(s), and the possible radiation statuses of the radiation assembly which can be selected by controlling these components.
  • the optical condition is measured for each of the possible radiation statuses identified in step 302.
  • the optical condition can, for instance, be measured inside the food preparation chamber 102, e.g. using one or more suitable optical sensors, as previously described.
  • the determining 306, using the optical condition measured for each of the identified at least one radiation status, the relationship for adjusting the image characteristic according to the identified at least one radiation status is then implemented.
  • the identifying 202 the radiation status comprises obtaining 202A the individual radiation statuses of all components capable of forming part of the radiation assembly, in other words the heating element(s) and/or the illumination system/lamp(s). This can be achieved by obtaining the individual statuses from the above-described control unit and/or via sensing the radiation provided by the component(s).
  • the radiation status in other words the overall or "combination" status, of the radiation assembly can then be identified in 202B.
  • the camera assembly is then controlled in 204 to adjust an image characteristic of the one or more images using the above-described predetermined relationship determined in 306.
  • the present disclosure proposes to control a camera assembly to adjust an image characteristic, e.g. exposure and/or white balance, for image acquisition and processing to obtain image(s)/video that can reliably reflect food appearance.
  • an image characteristic e.g. exposure and/or white balance

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
EP22151776.6A 2021-11-26 2022-01-17 Lebensmittelzubereitungsanordnung mit einer kameraanordnung Withdrawn EP4187158A1 (de)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP22801493.2A EP4437276A1 (de) 2021-11-26 2022-10-19 Lebensmittelzubereitungsanordnung mit einer kameraanordnung
CN202280077650.9A CN118369542A (zh) 2021-11-26 2022-10-19 包括相机组件的食品制备组件
PCT/EP2022/079081 WO2023094078A1 (en) 2021-11-26 2022-10-19 Food preparation assembly comprising a camera assembly

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2021133690 2021-11-26

Publications (1)

Publication Number Publication Date
EP4187158A1 true EP4187158A1 (de) 2023-05-31

Family

ID=79686917

Family Applications (1)

Application Number Title Priority Date Filing Date
EP22151776.6A Withdrawn EP4187158A1 (de) 2021-11-26 2022-01-17 Lebensmittelzubereitungsanordnung mit einer kameraanordnung

Country Status (1)

Country Link
EP (1) EP4187158A1 (de)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016179424A1 (en) * 2015-05-05 2016-11-10 June Life, Inc. Connected food preparation system and method of use
US20180324908A1 (en) * 2015-09-10 2018-11-08 Brava Home, Inc. In-oven camera and computer vision systems and methods

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016179424A1 (en) * 2015-05-05 2016-11-10 June Life, Inc. Connected food preparation system and method of use
US20180324908A1 (en) * 2015-09-10 2018-11-08 Brava Home, Inc. In-oven camera and computer vision systems and methods

Similar Documents

Publication Publication Date Title
US20220154942A1 (en) Dynamic heat adjustment of a spectral power distribution configurable cooking instrument
US11388788B2 (en) In-oven camera and computer vision systems and methods
KR20190057020A (ko) 요리 시스템용 사용자 인터페이스
US20170238751A1 (en) Wirelessly controlled cooking system
AU2013327379B2 (en) A device and a method for characterising a chromatic property of foodstuff
AU2014328467B2 (en) A method and an apparatus for identifying a content property of foodstuff
US9538602B2 (en) Lighting control device and lighting control method
US10674568B2 (en) Heating cooker
US20180279425A1 (en) Heating cooker, method for controlling heating cooker, and heating cooking system
EP3198372B1 (de) Beleuchtungssteuerung
CN108282949A (zh) 用于油烟机的照明控制方法、照明控制装置及油烟机系统
JPWO2017170319A1 (ja) 加熱調理器
US11310896B2 (en) Controller for configuring a lighting system
CN114305138A (zh) 一种智能烤箱及其控制方法
US20240093875A1 (en) Method for operating a cooking appliance, and cooking appliance
EP4187158A1 (de) Lebensmittelzubereitungsanordnung mit einer kameraanordnung
GB2587788A (en) AI controlled toasting appliance
WO2023094078A1 (en) Food preparation assembly comprising a camera assembly
JP7470903B2 (ja) 加熱調理器
WO2019208284A1 (ja) 加熱調理器
EP3438546B1 (de) Heiz- und kochvorrichtung
IL303218A (en) A system and method for controlling cooking quality
US11838994B2 (en) Determination device and heating cooking apparatus
CN112188694A (zh) 一种灯光色温校正方法、系统、装置和存储介质
JP2016162124A (ja) 調理法決定方法及び調理法決定装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20231201