EP3948119B1 - Appareil ménager avec caméra disposée dans une porte - Google Patents

Appareil ménager avec caméra disposée dans une porte Download PDF

Info

Publication number
EP3948119B1
EP3948119B1 EP20716420.3A EP20716420A EP3948119B1 EP 3948119 B1 EP3948119 B1 EP 3948119B1 EP 20716420 A EP20716420 A EP 20716420A EP 3948119 B1 EP3948119 B1 EP 3948119B1
Authority
EP
European Patent Office
Prior art keywords
camera
door
sensor
household appliance
trigger
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP20716420.3A
Other languages
German (de)
English (en)
Other versions
EP3948119A1 (fr
Inventor
Daniel Bihr
Hans Peter Werner
Christopher Rodney
Stephan Kempfle
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BSH Hausgeraete GmbH
Original Assignee
BSH Hausgeraete GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BSH Hausgeraete GmbH filed Critical BSH Hausgeraete GmbH
Publication of EP3948119A1 publication Critical patent/EP3948119A1/fr
Application granted granted Critical
Publication of EP3948119B1 publication Critical patent/EP3948119B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F25D29/005—Mounting of control devices
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2700/00—Means for sensing or measuring; Sensors therefor
    • F25D2700/02—Sensors detecting door opening

Definitions

  • the invention relates to a household appliance, having a treatment room that can be closed by means of a pivotable door, at least one camera arranged in the door for recording images from the treatment room when the door is open, and a door movement sensor for detecting values of at least one parameter of a door movement, the household appliance being set up for this purpose is to trigger at least one device function by detecting at least one trigger value.
  • the invention can be applied particularly advantageously to cooling devices, in particular refrigerators.
  • door movement is detected by Hall sensors and magnets, one component of which is located on the door and the other component is located on a fixed part of the home appliance (hereinafter also referred to as “body”).
  • body a fixed part of the home appliance
  • reaching or overrunning a fixed predetermined door opening angle also referred to as “trigger angle”
  • a new trigger angle can only be determined by manually readjusting the position of the components on the device.
  • the practically non-existent possibility for easy readjustment of the position of the Hall sensor and/or magnet is particularly disadvantageous when changes in the position of the door on the household appliance occur due to use, e.g. a door lowering.
  • Deviations from the target trigger angle are disadvantageous, for example, in the event that a camera is installed in a door of a refrigerator, which, when the door is open, namely when the trigger angle is reached during an opening movement, begins to record images of a refrigerator compartment that can be closed by the door. If the trigger angle is misaligned, the camera triggers at the wrong time, which reduces the ability to evaluate the images recorded with it.
  • U.S. 2014/0293060 A1 reveals a refrigerator.
  • the refrigerator has a main body or body with a storage compartment, a first door rotatably installed on a first side of the main body to open and close a first portion of the storage space, and a second door rotatably installed on a second side of the Main body is installed to open and close-up a second section of the storage compartment.
  • a first camera may be installed on the first door to capture an image of an interior of the storage compartment during rotation of the first door
  • a second camera may be installed on the second door to capture an image of an interior of the storage compartment during rotation of the second door .
  • a controller may combine multiple images captured by the first camera and the second camera into a single corrected image of an area of the storage compartment that extends from the first door to the second door.
  • US 2014/0313331 A1 discloses a refrigerator and method of operation therefor.
  • the operating method of the refrigerator which may include a drawer and a camera, may include detecting the beginning of a drawer closing operation, capturing an internal image of the drawer using the camera at a time when the drawer closing operation is initiated, and a external viewing and/or transmission of the final image.
  • U.S. 2016/0182764 A1 discloses a camera system having a camera device serving as an image capture unit; a communication unit configured to transmit image information captured by the camera device to an external device; and a display configured to display image information captured by the camera device, the display configured to display at least one of image information captured by the camera device according to prescribed conditions and image information captured according to user instructions were recorded.
  • U.S. 2016/0182768 A1 discloses a camera device for use in a storage facility.
  • the camera device is provided with a housing configured to be installed in a storage facility; an image pickup element provided inside the case; and an image pickup window provided on a first surface portion of the case and configured for capturing an image within the storage device by the image pickup element.
  • the image capturing element is configured to capture an image in the storage device in which the case is installed.
  • WO 2018/142136 A1 discloses an imaging device on a movable structure, the imaging unit comprising a motion sensor and a position sensor, wherein the imaging unit can be placed in a low power mode by the motion sensor.
  • WO 2019/025443 A1 discloses a household refrigeration appliance with a pivoting door to which a sensor device can be attached.
  • the sensor device comprises an inertial sensor for providing a movement signal; and a processing device which is set up to determine a pivoting angle of the pivoting door on the basis of the movement signal and to output a signal when the pivoting angle has reached a predetermined threshold value.
  • U.S. 2016/138860 A1 discloses a refrigerator including a storage compartment, a drawer movably provided in the storage compartment and provided with a mark, a camera photographing inside the drawer from outside the drawer, and a controller controlling a position of the mark in by the camera captured photographs at time intervals, and determines the state information about the drawer based on a change in position of the marker.
  • DE 10 2013 216759 A1 discloses a refrigeration device with a camera module for accommodating items to be cooled inside the refrigeration device, which includes a camera housing module for hermetically encapsulating the camera module relative to the interior of the refrigeration device.
  • the at least one door movement parameter is a door opening angle, a door movement direction (e.g. a door opening or door closing) and/or a door speed (eg an angular speed when the door is pivoted).
  • This household appliance has the advantage that the at least one door movement parameter can be determined continuously or quasi-continuously over the entire door movement and not only a single trigger angle is detected, as is the case with Hall sensors, for example. This in turn results in the possibility that device functions can be controlled as a function of several trigger values, e.g. as a function of different door opening angles that have been reached.
  • the at least one trigger value can be adjusted as desired without having to make mechanical changes to the device.
  • This can be used to advantage, for example, to compensate for signs of use and/or assembly tolerances.
  • This also makes it easy to use different cameras that require different trigger values for triggering, e.g. due to different fields of view, in series or when replaced by customer service by adjusting the trigger value, etc.
  • the advantage of reduced assembly effort in production is achieved.
  • a number of lines in the device and in particular to the device door can be significantly reduced.
  • the possibility of a system failure due to incorrect assembly or damaged electrical wiring is also reduced.
  • a particularly compact structure is made possible.
  • An inertial sensor can be understood to mean a sensor that is set up to independently measure translational and/or rotational accelerations. Provision is made for the camera/sensor module to have one or more inertial sensors, in particular of different types and/or orientations. For example, a yaw rate sensor, an acceleration sensor or a combination thereof can be installed in the camera/sensor module. With an inertial sensor, a measured value resolution of +/- 1° can be achieved with a maximum opening speed of 90°/s or even better.
  • At least one inertial sensor is a yaw rate sensor. This is particularly suitable for determining a current opening angle of the door with high accuracy and little effort.
  • the angular velocity of the door can also be measured by means of the yaw rate sensor and the door opening angle can be determined therefrom—for example by integrating the measured angular velocity over time.
  • a door opening angle of zero (corresponding to a closed door) can be determined by switching a door switch.
  • the yaw rate sensor is a vibrating structure gyroscope (VSG). This is particularly robust, small and inexpensive.
  • At least one inertial sensor is an acceleration sensor.
  • the acceleration sensor is intended in particular for measuring linear accelerations.
  • a door opening angle can also be determined with an acceleration sensor, in particular when the door is only slightly open.
  • an acceleration sensor for a single acceleration sensor, a determination accuracy drops noticeably with larger door opening angles. This can be compensated for by using several differently aligned acceleration sensors.
  • an acceleration sensor is to determine a drift of a yaw rate sensor. Taking into account the drift determined in this way, a door movement parameter determined by the yaw rate sensor, in particular a door opening angle, can be corrected and thus determined even more precisely.
  • at least one yaw rate sensor and at least one (linear) acceleration sensor is advantageous for at least one yaw rate sensor and at least one (linear) acceleration sensor to be installed in at least one camera/sensor module.
  • At least one inertial sensor is a MEMS sensor.
  • a MEMS (“micro-electro-mechanical system”) sensor has the advantage that it can be implemented directly in integrated circuits
  • At least one inertial sensor can be a piezoelectric sensor.
  • This can have quartz rods, for example, which are slightly bent during acceleration and slightly detune an electrical oscillating circuit.
  • a further development that is advantageous for reducing the computing effort is that one or more axes of at least one inertial sensor are excluded from the evaluation. For example, if an inertial sensor measures an acceleration in all three Cartesian spatial axes, only the spatial axes that are perpendicular to an axis of rotation of the door need to be evaluated, since the door performs no or no practically usable movement along its axis of rotation.
  • the camera can be designed as a module (“camera module”), which can have, for example, a semiconductor-based image recording sensor (e.g. a CCD chip), camera electronics for operating the image recording sensor, optics upstream of the image recording sensor, etc.
  • the camera can be a black and white camera or, advantageously, a color camera.
  • the camera/sensor module is connected to an energy store for its operation, which can be charged wirelessly at least when the door is closed.
  • the energy store can have at least one supercapacitor, for example. Electrically operated components of the camera/sensor module, such as the camera, the at least one inertial sensor, etc., can be supplied with energy by means of the energy store.
  • the fact that the energy store can be charged wirelessly at least when the door is closed can mean that the energy supply is no longer effective when the door is noticeably opened. It is a development that the energy store can be charged inductively.
  • a pick-up coil in which an induction voltage can be induced by means of an inductive alternating field in order to charge the energy store and, if necessary, to operate further components of the camera/sensor module.
  • at least one primary coil configured and arranged for generating the inductive (“charging") alternating field can be present in the body of the household appliance. The primary coil faces the pickup coil for effective energy transfer when the door is closed.
  • the camera/sensor module can be supplied with power by a cable. This results in the advantage that an energy store can be dispensed with. To do this, a power supply line can be routed from the body into the door, e.g. a simple two-wire line.
  • the camera/sensor module can be charged wirelessly and at least one other camera located in the door can be supplied with power by a cable.
  • the camera/sensor module is set up to, with the detection of at least one trigger value by the at least one inertial sensor, at least one device function (“camera function”) or action assigned to the camera of the camera/sensor module (“internal module camera”) trigger.
  • camera function device function
  • internal module camera action assigned to the camera of the camera/sensor module
  • the at least one camera function may include waking or bringing the camera from a powered off state to an operable standby state, triggering the camera to take a picture, turning off the camera, and so on.
  • the data communication device has or is a wireless or wired data interface for wireless or wired communication with at least one other component of the household appliance, e.g. with a central control device, at least one additional camera, a screen, etc.
  • a wireless data interface results the advantage that no data transmission lines need to be routed into or in the door to the module.
  • the data communication device of the camera/sensor module has or is a bidirectional data interface and can use it to send and receive data, e.g. now also calibration data, control commands such as waking up a camera from a switched-off state to a standby state , triggering the camera, heating a case window, etc.
  • data e.g. now also calibration data
  • control commands such as waking up a camera from a switched-off state to a standby state , triggering the camera, heating a case window, etc.
  • the data communication facility can then also be referred to as a transceiver.
  • the bidirectional data interface also saves space in comparison to the provision of a unidirectional interface for data reception and a unidirectional interface for data transmission, which is also possible in principle.
  • the data communication device has a bidirectional data interface
  • the camera/sensor module or one or more of its components can be controlled externally.
  • the advantage achieved in this way is that the camera/sensor module can be used particularly flexibly. For example, at least one camera of the camera/sensor module can be woken up, triggered, switched off, etc. via a command received via the bidirectional data interface. If the camera/sensor module has a number of cameras, a received command can in particular trigger a specific camera for image recording, or a number of cameras, in particular all cameras, can be triggered. It is also possible to calibrate or reconfigure the evaluation device externally, e.g. to change, add, delete trigger values, etc.
  • the data communication device can only be connected to the camera.
  • the data communication device can be connected to the camera and the at least one inertial sensor.
  • the household appliance has at least one additional camera that does not belong to the camera/sensor module ("module-external") and is set up to detect at least one trigger value by the at least one inertial sensor of the camera/sensor module to trigger the device function or camera function assigned to the module-external camera.
  • module-external the camera/sensor module
  • the camera/sensor module can be coupled with the at least one module-external camera in terms of data technology either directly or indirectly, for example via a control device.
  • module-internal and/or module-external cameras can be triggered independently of one another based on a respective door opening angle. This results in the advantage that images can be recorded from a particularly advantageous direction or perspective.
  • the cameras can trigger at the same and/or different door opening angles.
  • the household appliance is set up to trigger at least one further appliance function that is not a camera function when at least one trigger value is detected by the at least one inertial sensor of the camera/sensor module.
  • the further device function can also be referred to as a "non-camera device function”.
  • the at least one further device function includes a light control of the household appliance.
  • Light generation can thus advantageously be adapted to the current door opening angle in a particularly varied manner.
  • the light control can include a change in brightness and/or a change in color of the light generated by the household appliance.
  • the household appliance can have at least one light-generating device that can be controlled, for example, directly by the camera/sensor module or via the control device.
  • the light-generating device can have, for example, one or more LEDs.
  • the light control comprises a light control of a light radiated into the treatment room by at least one light generating device.
  • the smaller the door opening angle the brighter the treatment room can be illuminated. This is advantageous in order to standardize an overall brightness in the treatment room—possibly taking into account incident ambient light.
  • a treatment room can be understood, for example, in the case of refrigeration devices as a cold room of a refrigerator, in the case of cooking devices, a cooking chamber, in the case of dishwashers, a rinsing chamber, etc.
  • the at least one further device function can in particular include a brief increase in an illuminance in the treatment room at the time the at least one camera is triggered, which depends on the door opening angle.
  • a brief increase in an illuminance in the treatment room at the time the at least one camera is triggered which depends on the door opening angle.
  • this can include the emission of one or more flashes of light into the treatment room synchronously with a triggering time of a camera.
  • the illuminance can be briefly increased in a targeted manner when the door is open at several angles.
  • the light control includes light control of a light emitted by the household appliance into the environment.
  • a color of light that is emitted by operating elements and/or decorative elements can be changed depending on the door opening angle. This can be advantageous, for example, in order to communicate the door open status to a user even more effectively.
  • Voice control using the at least one inertial sensor can also be implemented particularly advantageously as a further device function.
  • voice control can be activated or deactivated depending on the opening angle of the door.
  • the camera/sensor module has a housing in which the at least one camera and on or in which the at least one inertial sensor are arranged.
  • a housing in which the at least one camera and on or in which the at least one inertial sensor are arranged.
  • the components of the module housed in the housing are particularly protected against external influences such as dirt, dust and/or moisture.
  • the housing can consequently in particular be a dust-tight and/or moisture-tight housing.
  • the housing has a transparent window ("see-through window") arranged in the field of view of the camera.
  • the window can be in the form of a housing opening, for example, which is covered by a transparent pane, for example a glass pane or a plastic pane.
  • a transparent pane for example a glass pane or a plastic pane.
  • the use of a glass pane in particular has the advantage that the window is highly resistant, optically transparent and discolouration-proof.
  • the transparent window or its pane can be heated, for example by means of a window heater, in particular of the module.
  • the window heater can, for example, have one or more thin wires or electrically conductive, transparent conductor tracks (e.g. made of ITO) which serve as electrical resistance heating lines.
  • ITO electrically conductive, transparent conductor tracks
  • the use of window heating has the advantage, particularly in the case of refrigerators, that the window does not fog up when the door is opened.
  • the window heating can be activated and deactivated as a function of a trigger value detected by the at least one inertial sensor, in particular a specific door opening angle. In this way, the advantage is achieved that the window heating is only heated in practically relevant movement states of the door, which saves on electricity costs.
  • the window heating can be activated when the at least one inertial sensor detects that a first door opening angle has been reached when the door is opened, and deactivated when a second, larger door opening angle has been reached when the door is opened.
  • the window heating cannot be activated when the door is closed.
  • the housing of the camera/sensor module can also have an uncovered housing opening, which is arranged in the door behind a transparent window in the inner wall of the door.
  • the transparent window on the inside wall of the door or its pane can also be heated.
  • the housing and/or a door wall has a transparent, heatable window arranged in the field of view of the camera, the pane of which can be heated depending on at least one trigger value of at least one door movement parameter detected by the module or its at least one inertial sensor being reached.
  • the camera/sensor module has an evaluation device that is set up, in particular programmed, to evaluate measurement signals from the at least one inertial sensor to determine the at least one parameter value, to compare them with one or more trigger values or setpoint values, and to detect at least one trigger value trigger action. So will achieves the advantage that the camera/sensor module has a higher level of "intelligence" and can therefore also carry out more complex control processes autonomously.
  • the at least one action can include, for example, triggering the at least one camera of the module, triggering at least one additional camera of the household appliance, and so on.
  • the evaluation device can have at least one processor unit such as a microprocessor, an FPGA, an ASIC, etc.
  • the camera/sensor module can be controlled at least partially by the control device of the household appliance.
  • the camera/sensor module can thus be designed in a particularly simple manner.
  • the evaluation device is set up to be configured via the data interface. This achieves the advantage that flexible adjustment of the camera/sensor module is made possible, for example for the adjustment of trigger values such as predetermined door opening angles ("trigger angles"). For example, trigger values can be changed, newly added and/or deleted.
  • the evaluation device has a data memory for this purpose, in particular a programmable non-volatile data memory such as an EEPROM or the like.
  • the camera/sensor module has a housing, in particular as described above, the housing has an insertion opening for inserting the camera, and the insertion opening is closed by the communication circuit board or is covered.
  • the communication circuit board can therefore serve as a cover for the housing and can be arranged in or on the housing, in particular inserted into the housing.
  • the at least one camera, the at least one inertial sensor, the data communication device, the evaluation device and/or other components such as a light source for illuminating a field of view of the camera etc. can be accommodated in the housing.
  • each camera or each camera module of the household appliance has a device-unique code.
  • an identification routine for identifying the cameras e.g. a door camera and a treatment room camera
  • the code is provided by means of a hardware-side coding of the camera or the camera module.
  • this data can also be generated by the camera/sensor module itself, in particular its evaluation device.
  • the camera in the standby state can be triggered using a corresponding control command.
  • the household appliance is a refrigeration appliance and the treatment space is a refrigerated space.
  • the refrigerating appliance may comprise a refrigerator, e.g.
  • a camera for taking pictures of the refrigerator compartment can also be referred to as a "camera in fridge", CiF.
  • the household appliance can in principle also be any other household appliance, in particular an electrically operated one, e.g. a large household appliance or a small household appliance, in particular a kitchen appliance, specifically in the sense of white goods.
  • the household appliance can also be a cooking appliance, a laundry care appliance, a dishwasher, etc.
  • Fig.1 shows a sectional top view of a sketch of a household appliance in the form of a refrigerator 1.
  • the refrigerator 1 has a treatment chamber in the form of a refrigerator 2, the loading opening 3 of which on the front side can be closed by means of a door 5 that can be pivoted about a vertically aligned axis of rotation 4, as well as by the indicated by a double arrow.
  • a camera/sensor module 6 is arranged in the door 5 .
  • the camera/sensor module 6 has a camera 7 designed here as a camera module ("inherent in the module"), which is arranged in such a way that it can record images from the cold room 2 at least when the door 5 is only slightly open.
  • the camera/sensor module 6 also has at least one door movement sensor in the form of an inertial sensor 8, a wired data communication device 9, for example, and an evaluation device 10. These components 7 to 10 are accommodated or attached in a housing 11 of the camera/sensor module 6 .
  • the housing 11 can have a heatable see-through window (not shown) for the camera 7 .
  • the at least one inertial sensor 8 is set up (i.e. arranged and designed) to detect at least one door movement parameter of the door 5 .
  • these currently detected door movement parameters are compared with specified setpoint or trigger values. If the currently detected door movement parameters reach at least one trigger value such as a specific door opening angle (possibly also a combination of several trigger values such as a specific door opening angle in connection with a determination of a door opening), the evaluation device 10 can trigger a corresponding action, e.g. a corresponding trigger signal or trigger information output, specifically to an internal component 7 to 9 of the camera/sensor module 6 and/or via the data communication device 9 to a component external to the module.
  • a corresponding action e.g. a corresponding trigger signal or trigger information output
  • the camera/sensor module 6 is communicatively coupled to a control device 12 of the refrigerator 1, for example via a point-to-point data line or a bus system.
  • the control device 12 is in particular a central control device for controlling the refrigerator 1.
  • the refrigerator 1 also optionally has at least one additional camera 13, ie a camera that does not belong to the camera/sensor module 6 ("external to the module"), which is shown here is arranged, for example, in a body 14 of the refrigerator 1 (eg, as shown, on a side wall, on the ceiling, etc.), but can also be arranged in the door 5 .
  • the module-external camera 13 can be directly communicatively coupled to the camera/sensor module 6 , for example via a point-to-point data line or a bus system, and/or coupled to the control device 12 .
  • Each camera 7, 13 or the associated camera modules can each have several contacts or pins, e.g. for data transmission, power supply, etc. It is particularly advantageous if several of these pins are used as coding pins, which have fixed (possibly reconfigurable) signal states are occupied. From the signal assignment of these coding pins, a device-unique camera identifier can be linked to transmitted data.
  • Image data can also be sent via the data communication device 9, e.g. to the control device 12 and/or to a screen 15 arranged on the outside, on which the images can be displayed.
  • the data communication device 9 is in particular a bidirectional data communication device 9 for sending and receiving data, e.g. for receiving data such as control commands, calibration or configuration data from the control device 12. It has a bidirectional data interface for this purpose.
  • the evaluation device 10 can be used to monitor or determine the achievement of a plurality of trigger values, one or more actions being able to be assigned to a trigger value.
  • At least two actions can be associated with the same trigger value or different trigger values.
  • Corresponding actions can be triggered when the door is closed, including triggering the cameras 7, 13, turning off the camera 7 when the door 5 reaches a closed state, etc.
  • control the camera/sensor module 6 externally, e.g. by the control device 12, independently of the at least one inertial sensor 8, e.g. in order to put the module-internal camera 7 into the standby state and/or to trigger the evaluation device calibrate or reconfigure (e.g. to change trigger values, add, delete etc.), etc.
  • Fig.2 shows a sectional side view of a sketch of a possible implementation of the camera/sensor module 6.
  • the camera/sensor module 6 has an in particular tubular housing 16, which has a housing opening 17 on the front side, which is covered by a transparent glass pane 18, which can be heated in particular .
  • housing 16 designed as a camera module camera 7 is housed, as components such as an image sensor 22 such as a CCD chip, camera electronics 23 for operating the image recording sensor 22, an optical system 25 etc. connected upstream of the image recording sensor 22, for example via a frame 24.
  • an image sensor 22 such as a CCD chip
  • camera electronics 23 for operating the image recording sensor 22
  • an optical system 25 etc. connected upstream of the image recording sensor 22, for example via a frame 24.
  • the camera 7 can be inserted into the housing 16 through an insertion opening 19 on the rear.
  • the insertion opening 19 is closed by means of a board ("communications board 20"), which can then also serve as a cover.
  • the communication circuit board 20 is located in the housing 16.
  • the communication board 20 which is in Fig.3 is shown in an oblique view, has an integrated sensor 8, 10, in which the inertial sensor 8 and the evaluation device 10 are integrated, as well as the data communication device 9 on a side pointing into the housing 16.
  • the communication circuit board 20 can be fitted with additional components such as a data interface 26 for connection to components external to the module.
  • the communication circuit board 20 is also fitted with a plug-in connection element 21 , which is connected to a matching mating plug-in connection element 25 of the camera 7 when the communication circuit board 20 is inserted into the housing 16 .
  • the mating connector element 25 of the camera 7 can have a plurality of contacts or pins which are assigned fixed predetermined signal levels in order to encode the camera 7 .
  • the camera 7 therefore has a device-unique hardware code or coding.
  • the plug-in connection element 21 and the plug-in connection counter-element 25 are connected to one another by a simple plug-in movement to form a plug-in connection 21, 25 when the communication circuit board 20 is inserted into the housing 16.
  • the plug connection 21, 25 also serves as a spacer between the communication circuit board 20 and the camera, in particular a base support 27 of the camera 7.
  • the camera 7 can be held in the housing 16 by means of the communication circuit board 20.
  • the camera 7, in particular its base support 27, and/or the communication circuit board 20 in the housing 16 can be held in the housing 16 by friction fit, positive fit (eg latching) and/or material connection (eg bonding).
  • dedicated fasteners such as screws, clamps, pins, etc. can be used for mounting the camera 7, in particular its base support 27, and/or the communication circuit board 20 in or on the housing 16.
  • the camera 7, in particular its base support 27, and/or the communication circuit board 20 can also be placed in a respective circumferential projection of the housing 16 which is formed on the inside.
  • the communication circuit board 20 can also be placed on a rear edge of the housing 16 and thereby also forms a cover for the housing 16.
  • a numerical specification can also include exactly the specified number as well as a usual tolerance range, as long as this is not explicitly excluded.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
  • Studio Devices (AREA)

Claims (12)

  1. Appareil électroménager (1), comprenant :
    - un espace de traitement (2) pouvant être fermé au moyen d'une porte pivotante (5),
    - au moins une caméra (7) disposée dans la porte (5) pour capturer des images de l'espace de traitement (2) lorsque la porte (5) est ouverte, et
    - un capteur de mouvement de porte pour détecter des valeurs d'au moins un paramètre d'un mouvement de porte et
    dans lequel :
    - le capteur de mouvement de porte comprend au moins un capteur inertiel (8), et l'au moins une caméra (7) et l'au moins un capteur inertiel (8) sont intégrés dans un module de caméra / capteur (6), qui est disposé dans la porte (5),
    - le module de caméra / capteur (6) comprend un dispositif de communication de données (9) permettant au moins d'envoyer des données d'image de la caméra (7) du module de caméra / capteur (6),
    - l'appareil électroménager (1) est configuré pour déclencher au moins une fonction d'appareil lors de la détection d'au moins une valeur de déclenchement,
    - le module de caméra / capteur (6) comprend un dispositif d'évaluation (10), qui est configuré pour évaluer des signaux de mesure de l"au moins un capteur inertiel (8) afin de déterminer l'au moins une valeur de paramètre et pour déclencher au moins une action lors de la détection d'au moins une valeur de déclenchement, caractérisé en ce que le dispositif d'évaluation (10) est regroupé avec l'au moins un capteur inertiel (8) dans un capteur intégré commun, qui est formé parallèlement avec le dispositif de communication de données (9) sur une carte de communication (20).
  2. Appareil électroménager (1) selon la revendication 1, dans lequel l'au moins un paramètre de mouvement de porte comprend un angle d'ouverture de porte, une direction d'ouverture de porte et/ou une vitesse de porte.
  3. Appareil électroménager (1) selon l'une des revendications précédentes, dans lequel le module de caméra / capteur (6) est configuré pour déclencher au moins une fonction d'appareil associée à la caméra (7) du module de caméra / capteur (6) lors de la détection d'au moins une valeur de déclenchement par l'au moins un capteur inertiel (8) du module de caméra / capteur (6).
  4. Appareil électroménager (1) selon l'une des revendications précédentes, dans lequel le dispositif de communication de données (9) du module de caméra / capteur (6) comprend une interface de données bidirectionnelle.
  5. Appareil électroménager (1) selon la revendication 4, dans lequel le module de caméra / capteur (6) ou l'une ou plusieurs de ses composantes (7, 10) est commandable de l'extérieur.
  6. Appareil électroménager (1) selon l'une des revendications précédentes, dans lequel l'appareil électroménager (1) comprend au moins une caméra extérieure au module (13) et l'appareil électroménager (1) est configuré pour déclencher au moins une fonction d'appareil associée à la caméra extérieure au module (13) lors de la détection d'au moins une valeur de déclenchement par l'au moins un capteur inertiel (8) du module de caméra / capteur (6).
  7. Appareil électroménager (1) selon l'une des revendications précédentes, dans lequel l'appareil électroménager (1) est configuré pour déclencher au moins une fonction d'appareil supplémentaire lors de la détection d'au moins une valeur de déclenchement par l'au moins un capteur inertiel (8) du module de caméra / capteur (6).
  8. Appareil électroménager (1) selon l'une des revendications précédentes, dans lequel le module de caméra / capteur (6) comprend un boîtier (16), dans lequel l'au moins une caméra (7) et l'au moins un capteur inertiel (8) sont disposés.
  9. Appareil électroménager (1) selon la revendication 8, dans lequel le boîtier (16) comprend une fenêtre transparente (17, 18), pouvant être chauffée, disposée dans le champ de vision de la caméra (7), qui peut être chauffée en fonction de l'atteinte d'au moins une valeur de déclenchement d'au moins un paramètre de mouvement de porte.
  10. Appareil électroménager (1) selon l'une des revendications précédentes, dans lequel le boîtier (16) comprend un orifice d'introduction (21) pour insérer la caméra (7) et l'orifice d'introduction (21) est fermé par la carte de communication (20).
  11. Appareil électroménager (1) selon l'une des revendications précédentes, dans lequel chaque caméra (7) de l'appareil électroménager (1) comprend un code matériel unique pour l'appareil.
  12. Appareil électroménager (1) selon l'une des revendications précédentes, dans lequel l'appareil électroménager (1) est un appareil frigorifique, en particulier un réfrigérateur et l'espace de traitement (2) est une enceinte réfrigérante.
EP20716420.3A 2019-04-01 2020-03-30 Appareil ménager avec caméra disposée dans une porte Active EP3948119B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102019204534.0A DE102019204534A1 (de) 2019-04-01 2019-04-01 Haushaltsgerät mit in einer Tür angeordneter Kamera
PCT/EP2020/058923 WO2020201199A1 (fr) 2019-04-01 2020-03-30 Appareil ménager avec caméra disposée dans une porte

Publications (2)

Publication Number Publication Date
EP3948119A1 EP3948119A1 (fr) 2022-02-09
EP3948119B1 true EP3948119B1 (fr) 2023-06-07

Family

ID=70154383

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20716420.3A Active EP3948119B1 (fr) 2019-04-01 2020-03-30 Appareil ménager avec caméra disposée dans une porte

Country Status (6)

Country Link
US (1) US11988444B2 (fr)
EP (1) EP3948119B1 (fr)
CN (1) CN113661369B (fr)
DE (1) DE102019204534A1 (fr)
PL (1) PL3948119T3 (fr)
WO (1) WO2020201199A1 (fr)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102019204534A1 (de) * 2019-04-01 2020-10-01 BSH Hausgeräte GmbH Haushaltsgerät mit in einer Tür angeordneter Kamera
DE102021200495A1 (de) * 2021-01-20 2022-07-21 BSH Hausgeräte GmbH Haushaltsgerät mit einer Kamera und positionsfixierter Anordnung eines Moduls in einem Gehäuseschacht der Kamera, sowie Verfahren
EP4130623A1 (fr) * 2021-08-02 2023-02-08 Liebherr-Hausgeräte Ochsenhausen GmbH Appareil de refroidissement et/ou de congélation
DE102021127900A1 (de) * 2021-10-27 2023-04-27 Miele & Cie. Kg Einbauhaushaltsgerätesystem
DE102021214692A1 (de) 2021-12-20 2023-06-22 BSH Hausgeräte GmbH Aufnehmen von Bildern aus einem Haushalts-Kältegerät
DE102021214690A1 (de) 2021-12-20 2023-06-22 BSH Hausgeräte GmbH Aufnehmen von Bildern aus einem Haushalts-Kältegerät
DE102022205769A1 (de) * 2022-06-07 2023-12-07 BSH Hausgeräte GmbH Kommunikationsmodul als Sensor-Hub für ein Haushaltskältegerät, sowie Haushaltskältegerät
EP4296597A1 (fr) * 2022-06-20 2023-12-27 Liebherr-Hausgeräte Ochsenhausen GmbH Appareil de refroidissement et/ou de congélation

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160182868A1 (en) * 2013-08-28 2016-06-23 Kabushiki Kaisha Toshiba Camera device for refrigerator and refrigerator comprising same
US20170372176A1 (en) * 2016-06-28 2017-12-28 Denso Corporation Camera system

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102000448B1 (ko) * 2013-03-27 2019-10-01 엘지전자 주식회사 냉장고
KR102023014B1 (ko) * 2013-04-23 2019-11-04 엘지전자 주식회사 냉장고 및 그 동작 방법
CN105222520B (zh) * 2013-04-23 2019-03-29 Lg电子株式会社 冰箱及其控制方法
DE102013216759A1 (de) * 2013-08-23 2015-02-26 BSH Bosch und Siemens Hausgeräte GmbH Kältegerät mit einem Kameramodul
US10365034B2 (en) * 2013-10-18 2019-07-30 Lg Electronics Inc. Refrigerator and control method for the same
DE102014210668A1 (de) * 2014-06-05 2015-12-17 BSH Hausgeräte GmbH Haushaltsgerät mit Speisenbehandlungsraum und Kamera
JP6524659B2 (ja) 2014-12-17 2019-06-05 セイコーエプソン株式会社 印刷データ生成装置及び印刷装置
EE05781B1 (et) 2014-12-18 2016-10-17 Tallinna Tehnikaülikool Meetod ja seade täpsete ajatemplitega pideva pildivoo kujutisehõiveks
DE102015213780A1 (de) * 2015-07-22 2017-01-26 BSH Hausgeräte GmbH Betreiben einer Kamera eines Haushaltsgeräts
GB201701593D0 (en) * 2017-01-31 2017-03-15 Smarter Applications Ltd Imaging apparatus
DE102017213425A1 (de) * 2017-08-02 2019-02-07 BSH Hausgeräte GmbH Sensorvorrichtung für ein Haushaltskühlgerät
DE102017221868A1 (de) * 2017-12-05 2019-06-06 BSH Hausgeräte GmbH Haushaltsgerät mit Sensor zum Detektieren einer Türbewegung
DE102019204534A1 (de) * 2019-04-01 2020-10-01 BSH Hausgeräte GmbH Haushaltsgerät mit in einer Tür angeordneter Kamera
KR102245911B1 (ko) * 2019-08-09 2021-04-30 엘지전자 주식회사 인공 지능을 이용하여, 아이템의 정보를 제공하는 냉장고 및 그의 동작 방법
KR102273192B1 (ko) * 2020-01-03 2021-07-05 엘지전자 주식회사 인공 지능 냉장고 및 그의 동작 방법
DE102021214691A1 (de) * 2021-12-20 2023-06-22 BSH Hausgeräte GmbH Kalibrieren eines Gyrosensors eines Haushalts-Kältegeräts
DE102021214690A1 (de) * 2021-12-20 2023-06-22 BSH Hausgeräte GmbH Aufnehmen von Bildern aus einem Haushalts-Kältegerät
DE102021214692A1 (de) * 2021-12-20 2023-06-22 BSH Hausgeräte GmbH Aufnehmen von Bildern aus einem Haushalts-Kältegerät

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160182868A1 (en) * 2013-08-28 2016-06-23 Kabushiki Kaisha Toshiba Camera device for refrigerator and refrigerator comprising same
US20170372176A1 (en) * 2016-06-28 2017-12-28 Denso Corporation Camera system

Also Published As

Publication number Publication date
PL3948119T3 (pl) 2023-09-04
DE102019204534A1 (de) 2020-10-01
US11988444B2 (en) 2024-05-21
CN113661369B (zh) 2023-10-13
EP3948119A1 (fr) 2022-02-09
CN113661369A (zh) 2021-11-16
US20220412645A1 (en) 2022-12-29
WO2020201199A1 (fr) 2020-10-08

Similar Documents

Publication Publication Date Title
EP3948119B1 (fr) Appareil ménager avec caméra disposée dans une porte
DE102017221868A1 (de) Haushaltsgerät mit Sensor zum Detektieren einer Türbewegung
WO2020144081A1 (fr) Appareil multifonctionnel universel
DE102015203150A1 (de) Haushaltskältegerät und Verfahren zum Betreiben eines Haushaltskältegerätes
DE102004034187A1 (de) Personendetektor und damit ausgerüstete elektronische Einrichtung
DE202017106985U1 (de) Beleuchtungs- und Überwachungsapparate
DE202019000228U1 (de) Universelles Gerät zu Gebäudeautomatisierungsanwendungen
EP3416337A1 (fr) Dispositif d'automatisation d'une maison ou d'un bâtiment
DE102010061735A1 (de) Belüftungsüberwachungsgerät für ein Fenster oder für eine Tür und Fenster/Tür mit einem solchen
EP0970456A1 (fr) Appareil d'eclairage a detecteur
EP1865755B1 (fr) Dispositif destiné à la commande d'un éclairage avec détection de présence
DE102021214690A1 (de) Aufnehmen von Bildern aus einem Haushalts-Kältegerät
DE102014102564A1 (de) Absolutwert-Singleturn-Drehgeber mit auswählbarer Multiturn-Funktion
DE102021214692A1 (de) Aufnehmen von Bildern aus einem Haushalts-Kältegerät
DE202012100909U1 (de) Bedieneinheit
CN209787320U (zh) 一种小流量远程抄表装置
EP3318948B1 (fr) Thermostat de radiateur
US8860879B1 (en) Suction cup camera
DE202007008363U1 (de) Vorrichtung zur Beleuchtungssteuerung
CN215494751U (zh) 一种摄影器材存储柜
EP3396172B1 (fr) Ventilateur avec un dispositif de lecture et d'affichage des paramètres de configuration à partir d'une unité de stockage de données du ventilateur
EP3244704B1 (fr) Système de commande et procédé de commande d'éclairages et/ou de dispositifs de protection contre la lumiere pouvant être commandés
EP2400609B1 (fr) Capteur de lumière d'ambiance dans une configuration modulaire
DE102022208379A1 (de) Kameravorrichtung und Kamera
DE202012104249U1 (de) Lampenfassungskamera

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20211102

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230307

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1576244

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230615

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502020003667

Country of ref document: DE

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20230607

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230907

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230908

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231007

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231009

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231007

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502020003667

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240331

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

26N No opposition filed

Effective date: 20240308

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230607

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: TR

Payment date: 20240319

Year of fee payment: 5

Ref country code: PL

Payment date: 20240319

Year of fee payment: 5