EP4453487A1 - A refrigerator with camera wherein the opening distance of the door is detected - Google Patents

A refrigerator with camera wherein the opening distance of the door is detected

Info

Publication number
EP4453487A1
EP4453487A1 EP22912137.1A EP22912137A EP4453487A1 EP 4453487 A1 EP4453487 A1 EP 4453487A1 EP 22912137 A EP22912137 A EP 22912137A EP 4453487 A1 EP4453487 A1 EP 4453487A1
Authority
EP
European Patent Office
Prior art keywords
door
refrigerator
camera
control unit
optical sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP22912137.1A
Other languages
German (de)
French (fr)
Other versions
EP4453487A4 (en
Inventor
smet ARSAN
Gizem ERDAL
Turan Erdem SIMSEK
Nihat Kandemir
Atif ASK
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Arcelik AS
Original Assignee
Arcelik AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Arcelik AS filed Critical Arcelik AS
Priority claimed from PCT/TR2022/050719 external-priority patent/WO2023121606A1/en
Publication of EP4453487A1 publication Critical patent/EP4453487A1/en
Publication of EP4453487A4 publication Critical patent/EP4453487A4/en
Pending legal-status Critical Current

Links

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F25D29/005—Mounting of control devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2700/00—Means for sensing or measuring; Sensors therefor
    • F25D2700/02—Sensors detecting door opening

Definitions

  • the present invention relates to a refrigerator wherein the opening distance of the door is measured in order to achieve an effective imaging and the image of the shelves on the door and the body is captured at the correct angle and time based on the measurement.
  • the accessibility of the consumption status and the stock management of the food stored in refrigerators by the user remotely is a necessity in today’s advanced technology.
  • the image of the shelves in the refrigerator is captured by imaging devices such as cameras, wherein at least one is placed onto the door and at least one is placed onto the body, and the user is enabled to access to the interior of the refrigerator via a mobile application or device.
  • Receiving proper images from the imaging device is critical in enabling the user to monitor the food in the refrigerator properly and manage said information such as food consumption.
  • the imaging has to be performed by means of the camera on the body and/or the camera on the door when the door is at a certain angle and about to be closed after the food items are placed into or taken out of the refrigerator by the user.
  • the camera takes a plurality of pictures randomly and these images are stored.
  • a refrigerator wherein the camera captures the image by means of angle adjustment when the refrigerator door is opened and moved to a predetermined angle.
  • a magnetic sensor An example of these is the use of a magnetic sensor.
  • the opening of the door is detected by using a magnet and a magnetic sensor (reed, hall etc.) on the door and the body so as to be aligned with each other.
  • the opening detection in said method is effective only in a narrow distance range and functions as an all-or-nothing relay.
  • the magnetic sensor-magnet pair is generally used when it is desired to detect if the door is left open in any refrigerator, independently of the presence or absence of a camera.
  • Another state of the art door opening detection method is the usage of an infrared sensor.
  • Said sensors can be placed onto the body or the door as a transmitter receiver or onto the door-body so as to correspond to each other as a receiver and a transmitter.
  • Infrared sensors are affected by the sunlight and other light sources. Consequently, their sensitivities are low.
  • the aim of the present invention is the realization of a refrigerator with camera wherein the suitable imaging angle is determined by detecting the position of the door relative to the body continuously (uninterruptedly).
  • Another aim of the present invention is the detection of the opening angle of the refrigerator by means of a detection unit such as a sensor which is placed onto the top wall without experiencing difficulty in the mounting process so that the best imaging is achieved by a camera which is on the body and/or the door and the image of the shelves on the body and/or the door is captured by the camera.
  • a detection unit such as a sensor which is placed onto the top wall without experiencing difficulty in the mounting process so that the best imaging is achieved by a camera which is on the body and/or the door and the image of the shelves on the body and/or the door is captured by the camera.
  • the refrigerator of the present invention comprises an optical sensor which is placed onto the top wall of the body and which faces the top face wall of the door.
  • the optical sensor is placed so as to be at an angle of 30 to 60 degrees with the long edge of the top face wall of the door which contacts the top wall when the door is in the closed position.
  • 30-60 degree angle between the door and the body is the most effective door opening angle to achieve the optimal imaging of the food items on the shelves on the inner panel of the door by means of at least one camera placed onto the body and the food items on the shelves on the body by means of at least one camera placed onto the door by the manufacturer.
  • Optimal imaging conditions are the conditions wherein the image is not blurry, the food items on the door shelves are seen clearly and distinguishably and all the shelves from the bottom shelf to the top shelf can be viewed.
  • the refrigerator calculates the time spent by the door to reach the position determined by the control unit when the door is being closed by the user, wherein the camera captures the most effective image.
  • the camera is activated based on the calculated time when the door is being closed.
  • the refrigerator confirms whether the door reaches the required position in the calculated period of time by means of the optical sensor. After this confirmation, if the door is detected to be at a different angle relative to the body, the camera on the body or the door is prevented from capturing images. Then, an error message related to the situation is sent to the user via a mobile device, monitoring screen, etc. At the end of the calculated duration, an error message can be generated, which indicates that the door must be closed slower if the door is closer to the body than the desired position or the door must be closed faster if the door is further away from the body than the desired position.
  • a refrigerator with camera is realized, wherein the opening distance of the door relative to the body can be measured during the entire movement of the body without the need for modifications on the body and the door of the refrigerator, without using a receiver and a transmitter on opposite sides and without being affected by external light sources.
  • Figure 1 - is the perspective view of the refrigerator in an embodiment of the present invention.
  • Figure 2 - is the view of the top wall of the body whereon the optical sensor is placed in the refrigerator in an embodiment of the present invention.
  • Figure 3 - is the exploded view of the optical sensor, the control unit and the casing placed into the refrigerator of the present invention.
  • the refrigerator (1) comprises a body (2) having side walls, a rear wall and a top wall (3) which form the cooling volume, wherein the food items to be cooled are placed; a door (4) which provides access into the body (2) and which is in connection with the body (2); a door top face wall (5) at least a part of which can be seen from the top wall (3) when the door (4) is in the closed position; at least one shelf attached onto the body (2) and/or the inner panel of the door (4), whereon the food items are placed; at least one camera (6) placed in a position on the body (2) so as to capture the image of the shelves on the door (4) and at least one camera (6) placed in a position on the door (4) so as to capture the shelves in the body (2); and a control unit (9).
  • the refrigerator (1) of the present invention comprises an optical sensor (7) which is placed onto the top wall (3) so that there is an angle of 30°-60° between the same and the door top face wall (5) when the door (4) is in the closed position and which measures the distance between the door top face wall (5) and the body (2) and the control unit (9) which triggers the activation of at least one camera (6) to capture images when the door (4) is in the open position at an angle (a) which is between the predetermined angle of 30°-60°, i.e. at an angle which enables the cameras (6) to capture images in optimal conditions.
  • the optical sensor (7) provided on the top wall (3) of the refrigerator (1) of the present invention, the distance between the door top face wall (5) and the body (2) at a moment when the door (4) is open can be measured.
  • the opening distance of the door (4) is the distance between the body (2) and the door (4) while the user is closing the door (4) after taking food items from the shelves or placing newly purchased food items to the shelves. Said distance which forms an angle (a) between the door (4) and the body (2) can be detected by means of the light sent by the optical sensor (7).
  • the optical sensor (7) is placed onto the top wall (3) at angle between 30° and 60° which is predetermined by the manufacturer.
  • the sensor (7) and the door (4) reach a position between these angles, wherein they are in corresponding positions so as to be parallel with each other. Consequently, while the door (4) is being closed, the image of the shelves in the body (2) can be captured by means of at least one camera (6) placed onto the door (4) and/or the image of the shelves on the door (4) can be captured by means of at least one camera (6) placed in the body (2). Similarly, the camera (6) is prevented from capturing images when the door (4) is open at an angle relative to the body (2) which is for example 15 degrees or 85 degrees and the imaging of the camera (6) is insufficient.
  • the refrigerator (1) comprises the control unit (9) which triggers at least one camera (6) to capture at least one image when the door top face wall (5) and the optical sensor (7) move to a position so as to be parallel with each other while the door (4) is being closed after the user places food items to the shelves in the body (2) or the door (4) or takes food items from the shelves.
  • the control unit 9 which triggers at least one camera (6) to capture at least one image when the door top face wall (5) and the optical sensor (7) move to a position so as to be parallel with each other while the door (4) is being closed after the user places food items to the shelves in the body (2) or the door (4) or takes food items from the shelves.
  • the optimal imaging predetermined by the manufacturer is provided when the door (4) is open at an angle of 40 degrees
  • the optical sensor (7) is placed so as to be at an angle of 40 degrees with the door top face wall (5) when the door (4) is closed.
  • the control unit 9 and at this moment, at least one camera (6) is enabled to capture an image.
  • the refrigerator (1) comprises the control unit (9) which calculates the opening and closing speed of the door (4) based on the time spent between a first position wherein the door (4) is closed and a second position wherein the door (4) is open, and calculates the time required for the door (4) to reach a position where the optimal imaging predetermined by the manufacturer can be performed based on the calculated speed and activates the camera (4) while the door (4) is being closed based on the calculated time.
  • the control unit (9) activates and enables at least one camera (6) to capture images while the door (4) is being closed.
  • the refrigerator (1) comprises the optical sensor (7) which sends a signal to confirm the position of the door (4) which is calculated based on the speed of the door (4), and the control unit (9) which terminates the image capturing of the at least one camera (6) if the door (4) is not in the calculated position based on the data received from the optical sensor (7).
  • the control unit (9) prevents the at least one camera (6) from capturing images.
  • the refrigerator (1) comprises the control unit (9) which generates an audio or written error message to be delivered to the user by means of an imaging unit, indicating that the image cannot be generated since the door (4) is not in the calculated position.
  • the refrigerator (1) comprises the optical sensor (7) which is a time of flight (TOF) sensor.
  • the refrigerator (1) comprises a cover (8) which covers the optical sensor (7) and the control unit (9).
  • the optical sensor (7) and the control unit (9) are protected against external factors such as dust and humidity, and have a longer economic life.
  • a refrigerator (1) with camera (6) is realized, wherein at least one camera (6) on the body (2) and/or the door (4) is activated at the correct time when the door (4) reaches a position where a correct image can be captured and the user is provided with clear food images without storing unnecessary amounts of data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Accounting & Taxation (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Development Economics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The present invention relates to a refrigerator (1) comprising a body (2) having side walls, a rear wall and a top wall (3) which form the cooling volume, into which the food items to be cooled are placed; a door (4) which provides access into the body (2) and which is in connection with the body (2); a door top face wall (5) at least a part of which can be seen from the top wall (3) when the door (4) is in closed position; at least one shelf attached onto the body (2) and/or the inner panel of the door (4); at least one camera (6) placed in a position on each of the body (2) and the door (4) so as to capture the image of the shelves on the door (4) or the shelves in the body (2) respectively; and a control unit (9).

Description

A REFRIGERATOR WITH CAMERA WHEREIN THE OPENING DISTANCE OF THE DOOR IS DETECTED
The present invention relates to a refrigerator wherein the opening distance of the door is measured in order to achieve an effective imaging and the image of the shelves on the door and the body is captured at the correct angle and time based on the measurement.
The accessibility of the consumption status and the stock management of the food stored in refrigerators by the user remotely is a necessity in today’s advanced technology. When the users are away from the refrigerator, it is important for them to monitor which products are in the refrigerator, which products are running low or which products are close to their expiration dates without opening the refrigerator door. To this end, the image of the shelves in the refrigerator is captured by imaging devices such as cameras, wherein at least one is placed onto the door and at least one is placed onto the body, and the user is enabled to access to the interior of the refrigerator via a mobile application or device. Receiving proper images from the imaging device is critical in enabling the user to monitor the food in the refrigerator properly and manage said information such as food consumption. Capturing a clear image of all the shelves in the body with a camera placed onto the door and all the food on the shelves on the door with a camera placed onto the body is difficult. In order to capture a clear image, several solutions are provided, such as using a plurality of cameras, placing cameras at different angles and using wide-angle cameras.
When the image of the shelves on the door is desired to be captured by means of a camera placed onto the body, it is very difficult to capture the image of the top and bottom edges of the door and all the shelves in between when the door is closed. Similarly, when the door is closed, capturing a clear image of the shelves on the body by means of a camera placed on the door is difficult. Therefore, the imaging has to be performed by means of the camera on the body and/or the camera on the door when the door is at a certain angle and about to be closed after the food items are placed into or taken out of the refrigerator by the user. In order to capture the best image, methods are provided, wherein the camera takes a plurality of pictures randomly and these images are stored. However, actions such as storing several images captured by the camera, uploading these images to the cloud and a server system to be managed by the manufacturer make the procedure difficult and require the processing of high volumes of data. Therefore, determining the most effective door opening angle (the opening distance of the door while the user is closing the door) and offering the user the correct photograph with a single image are important in terms of both user satisfaction and the volume of data to be processed by the manufacturer.
In the state of the art Japanese Patent Application No. JP2003004366A, a refrigerator is disclosed, wherein the camera captures the image by means of angle adjustment when the refrigerator door is opened and moved to a predetermined angle.
In the state of the art Japanese Patent Application No. JP2004183987A, a refrigerator is disclosed, wherein photographs are taken based on the angle of the door.
In the state of the art European Patent Application No. EP3325902B1, a refrigerator is disclosed, wherein the cameras are calibrated upon the opening of the door and a triggering signal is generated for the cameras when the door is moved to a predetermined angle.
In the state of the United States of America Patent Document No. US9951989B2, a refrigerator is disclosed, wherein the angle of opening of the door is detected by means of the magnetic members placed onto the hinge and the door.
In the state of the refrigerators, several opening detection solutions are proposed in order to detect if the door is left open or to determine the opening angle of the door in refrigerators comprising cameras.
An example of these is the use of a magnetic sensor. The opening of the door is detected by using a magnet and a magnetic sensor (reed, hall etc.) on the door and the body so as to be aligned with each other. The opening detection in said method is effective only in a narrow distance range and functions as an all-or-nothing relay. Thus, the magnetic sensor-magnet pair is generally used when it is desired to detect if the door is left open in any refrigerator, independently of the presence or absence of a camera.
Another state of the art door opening detection method is the usage of an infrared sensor. Said sensors can be placed onto the body or the door as a transmitter receiver or onto the door-body so as to correspond to each other as a receiver and a transmitter. Infrared sensors are affected by the sunlight and other light sources. Consequently, their sensitivities are low.
Another solution proposed is the use of a sensor on the door hinge, such as a potentiometer. The measurement obtained by means of this method is relatively more precise compared to others but said sensor is difficult to be adapted to the hinge and the economic life of such sensors is short.
The aim of the present invention is the realization of a refrigerator with camera wherein the suitable imaging angle is determined by detecting the position of the door relative to the body continuously (uninterruptedly).
Another aim of the present invention is the detection of the opening angle of the refrigerator by means of a detection unit such as a sensor which is placed onto the top wall without experiencing difficulty in the mounting process so that the best imaging is achieved by a camera which is on the body and/or the door and the image of the shelves on the body and/or the door is captured by the camera.
The refrigerator of the present invention comprises an optical sensor which is placed onto the top wall of the body and which faces the top face wall of the door. The optical sensor is placed so as to be at an angle of 30 to 60 degrees with the long edge of the top face wall of the door which contacts the top wall when the door is in the closed position. Thus, when the user is closing the door after opening the door and taking food items from the shelves on the body or the door or placing food items, when the door is open with an angle in said range, the optical sensor and the door are brought to a parallel position. It is known that 30-60 degree angle between the door and the body is the most effective door opening angle to achieve the optimal imaging of the food items on the shelves on the inner panel of the door by means of at least one camera placed onto the body and the food items on the shelves on the body by means of at least one camera placed onto the door by the manufacturer.
Optimal imaging conditions are the conditions wherein the image is not blurry, the food items on the door shelves are seen clearly and distinguishably and all the shelves from the bottom shelf to the top shelf can be viewed.
In an embodiment of the present invention, the refrigerator calculates the time spent by the door to reach the position determined by the control unit when the door is being closed by the user, wherein the camera captures the most effective image. The camera is activated based on the calculated time when the door is being closed.
In another embodiment of the present invention, the refrigerator confirms whether the door reaches the required position in the calculated period of time by means of the optical sensor. After this confirmation, if the door is detected to be at a different angle relative to the body, the camera on the body or the door is prevented from capturing images. Then, an error message related to the situation is sent to the user via a mobile device, monitoring screen, etc. At the end of the calculated duration, an error message can be generated, which indicates that the door must be closed slower if the door is closer to the body than the desired position or the door must be closed faster if the door is further away from the body than the desired position.
By means of the present invention, a refrigerator with camera is realized, wherein the opening distance of the door relative to the body can be measured during the entire movement of the body without the need for modifications on the body and the door of the refrigerator, without using a receiver and a transmitter on opposite sides and without being affected by external light sources.
The model embodiments related to the refrigerator realized in order to attain the aim of the present invention are shown in the attached figures, where:
Figure 1 - is the perspective view of the refrigerator in an embodiment of the present invention.
Figure 2 - is the view of the top wall of the body whereon the optical sensor is placed in the refrigerator in an embodiment of the present invention. Figure 3 - is the exploded view of the optical sensor, the control unit and the casing placed into the refrigerator of the present invention.
The elements illustrated in the figures are numbered as follows:
1. Refrigerator
2. Body
3. Top wall
4. Door
5. Door top face wall
6. Camera
7. Optical sensor
8. Cover
9. Control unit a. Angle
The refrigerator (1) comprises a body (2) having side walls, a rear wall and a top wall (3) which form the cooling volume, wherein the food items to be cooled are placed; a door (4) which provides access into the body (2) and which is in connection with the body (2); a door top face wall (5) at least a part of which can be seen from the top wall (3) when the door (4) is in the closed position; at least one shelf attached onto the body (2) and/or the inner panel of the door (4), whereon the food items are placed; at least one camera (6) placed in a position on the body (2) so as to capture the image of the shelves on the door (4) and at least one camera (6) placed in a position on the door (4) so as to capture the shelves in the body (2); and a control unit (9).
The refrigerator (1) of the present invention comprises an optical sensor (7) which is placed onto the top wall (3) so that there is an angle of 30°-60° between the same and the door top face wall (5) when the door (4) is in the closed position and which measures the distance between the door top face wall (5) and the body (2) and the control unit (9) which triggers the activation of at least one camera (6) to capture images when the door (4) is in the open position at an angle (a) which is between the predetermined angle of 30°-60°, i.e. at an angle which enables the cameras (6) to capture images in optimal conditions.
By means of the optical sensor (7) provided on the top wall (3) of the refrigerator (1) of the present invention, the distance between the door top face wall (5) and the body (2) at a moment when the door (4) is open can be measured. In the refrigerator (1) of the present invention, the opening distance of the door (4) is the distance between the body (2) and the door (4) while the user is closing the door (4) after taking food items from the shelves or placing newly purchased food items to the shelves. Said distance which forms an angle (a) between the door (4) and the body (2) can be detected by means of the light sent by the optical sensor (7). The optical sensor (7) is placed onto the top wall (3) at angle between 30° and 60° which is predetermined by the manufacturer. Thus, after the door (4) is opened, the sensor (7) and the door (4) reach a position between these angles, wherein they are in corresponding positions so as to be parallel with each other. Consequently, while the door (4) is being closed, the image of the shelves in the body (2) can be captured by means of at least one camera (6) placed onto the door (4) and/or the image of the shelves on the door (4) can be captured by means of at least one camera (6) placed in the body (2). Similarly, the camera (6) is prevented from capturing images when the door (4) is open at an angle relative to the body (2) which is for example 15 degrees or 85 degrees and the imaging of the camera (6) is insufficient.
In an embodiment of the present invention, the refrigerator (1) comprises the control unit (9) which triggers at least one camera (6) to capture at least one image when the door top face wall (5) and the optical sensor (7) move to a position so as to be parallel with each other while the door (4) is being closed after the user places food items to the shelves in the body (2) or the door (4) or takes food items from the shelves. In this embodiment, for example, if the optimal imaging predetermined by the manufacturer is provided when the door (4) is open at an angle of 40 degrees, the optical sensor (7) is placed so as to be at an angle of 40 degrees with the door top face wall (5) when the door (4) is closed. When the user starts closing the door (4), the angle at which the optical sensor (7) and the door (4) is perfectly parallel with each other is detected by the control unit (9 and at this moment, at least one camera (6) is enabled to capture an image.
In an embodiment of the present invention, the refrigerator (1) comprises the control unit (9) which calculates the opening and closing speed of the door (4) based on the time spent between a first position wherein the door (4) is closed and a second position wherein the door (4) is open, and calculates the time required for the door (4) to reach a position where the optimal imaging predetermined by the manufacturer can be performed based on the calculated speed and activates the camera (4) while the door (4) is being closed based on the calculated time. In this embodiment, for example, the time (At) required for the door (4) to reach the opening distance of the door (4) which is equal to Ax between the door (4) and the body (2) which corresponds to, for example, 40 degrees based on the calculated speed of the door (4) without detecting the point where the door (4) and the optical sensor (7) are parallel with each other. Based on this duration, the control unit (9) activates and enables at least one camera (6) to capture images while the door (4) is being closed.
In an embodiment of the present invention, the refrigerator (1) comprises the optical sensor (7) which sends a signal to confirm the position of the door (4) which is calculated based on the speed of the door (4), and the control unit (9) which terminates the image capturing of the at least one camera (6) if the door (4) is not in the calculated position based on the data received from the optical sensor (7). In this embodiment, before the camera (6) captures images, it is controlled whether the door (4) is in the correct position by means of the signal sent by the optical sensor (7). If the door (4) is not in the calculated door (4) opening distance of Ax, the control unit (9) prevents the at least one camera (6) from capturing images. Thus, capturing imperfect images and storing unnecessary data by capturing more than one image can be prevented.
In an embodiment of the present invention, the refrigerator (1) comprises the control unit (9) which generates an audio or written error message to be delivered to the user by means of an imaging unit, indicating that the image cannot be generated since the door (4) is not in the calculated position.
In an embodiment of the present invention, the refrigerator (1) comprises the optical sensor (7) which is a time of flight (TOF) sensor. In an embodiment of the present invention, the refrigerator (1) comprises a cover (8) which covers the optical sensor (7) and the control unit (9). Thus, the optical sensor (7) and the control unit (9) are protected against external factors such as dust and humidity, and have a longer economic life.
By means of the present invention, a refrigerator (1) with camera (6) is realized, wherein at least one camera (6) on the body (2) and/or the door (4) is activated at the correct time when the door (4) reaches a position where a correct image can be captured and the user is provided with clear food images without storing unnecessary amounts of data.

Claims

1. A refrigerator (1) comprising a body (2) having side walls, a rear wall and a top wall (3) which form the cooling volume, wherein the food items to be cooled are placed; a door (4) which provides access into the body (2) and which is in connection with the body (2); a door top face wall (5) at least a part of which can be seen from the top wall (3) when the door (4) is in the closed position; at least one shelf attached onto the body (2) and/or the inner panel of the door (4), whereon the food items are placed; at least one camera (6) placed in a position on the body (2) so as to capture the image of the shelves on the door (4) and at least one camera (6) placed in a position on the door (4) so as to capture the shelves in the body (2); and a control unit (9), characterized by an optical sensor (7) which is placed onto the top wall (3) so that there is an angle of 30°-60° between the same and the door top face wall (5) when the door (4) is in the closed position and which measures the distance between the door top face wall (5) and the body (2) and the control unit (9) which triggers the activation of at least one camera (6) to capture images when the door (4) is in the open position at an angle (a) which is between the predetermined angle of 30°-60°, i.e. at an angle which enables the cameras (6) to capture images in optimal conditions.
2. A refrigerator (1) as in Claim 1, characterized by the control unit (9) which triggers at least one camera (6) to capture at least one image when the door top face wall (5) and the optical sensor (7) move to a position so as to be parallel with each other while the door (4) is being closed after the user places food items to the shelves in the body (2) or the door (4) or takes food items from the shelves.
3. A refrigerator (1) as in Claim 1, characterized by the control unit (9) which calculates the opening and closing speed of the door (4) based on the time spent between a first position wherein the door (4) is closed and a second position wherein the door (4) is open, and calculates the time required for the door (4) to reach a position where the optimal imaging predetermined by the manufacturer can be performed based on the calculated speed and activates the camera (4) while the door (4) is being closed based on the calculated time.
9
4. A refrigerator (1) as in Claim 3, characterized by the optical sensor (7) which sends a signal to confirm the position of the door (4) which is calculated based on the speed of the door (4), and the control unit (9) which terminates the image capturing of the at least one camera (6) if the door (4) is not in the calculated position based on the data received from the optical sensor (7).
5. A refrigerator (1) as in Claim 4, characterized by the control unit (9) which generates an audio or written error message to be delivered to the user by means of an imaging unit, indicating that the image cannot be generated since the door (4) is not in the calculated position.
6. A refrigerator (1) as in any one of the above claims, characterized by the optical sensor (7) which is a time of flight sensor (TOF).
7. A refrigerator (1) as in any one of the above claims, characterized by a cover (8) which covers the optical sensor (7) and the control unit (9).
EP22912137.1A 2021-12-21 2022-07-07 REFRIGERATOR WITH CAMERA THAT DETECTS THE OPENING DISTANCE OF THE DOOR Pending EP4453487A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR202120528 2021-12-21
PCT/TR2022/050719 WO2023121606A1 (en) 2021-12-21 2022-07-07 A refrigerator with camera wherein the opening distance of the door is detected

Publications (2)

Publication Number Publication Date
EP4453487A1 true EP4453487A1 (en) 2024-10-30
EP4453487A4 EP4453487A4 (en) 2025-10-15

Family

ID=92931675

Family Applications (1)

Application Number Title Priority Date Filing Date
EP22912137.1A Pending EP4453487A4 (en) 2021-12-21 2022-07-07 REFRIGERATOR WITH CAMERA THAT DETECTS THE OPENING DISTANCE OF THE DOOR

Country Status (1)

Country Link
EP (1) EP4453487A4 (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003207258A (en) * 2002-01-16 2003-07-25 Toshiba Corp refrigerator
KR102023013B1 (en) * 2013-04-18 2019-09-19 엘지전자 주식회사 Refrigerator and operating method thereof
DE102015213780A1 (en) * 2015-07-22 2017-01-26 BSH Hausgeräte GmbH Operating a camera of a household appliance
DE102017221868A1 (en) * 2017-12-05 2019-06-06 BSH Hausgeräte GmbH Household appliance with sensor for detecting a door movement
DE102019204309A1 (en) * 2019-03-28 2020-10-01 BSH Hausgeräte GmbH Household refrigeration appliance with a digital camera and method for operating a household appliance comprising a digital camera

Also Published As

Publication number Publication date
EP4453487A4 (en) 2025-10-15

Similar Documents

Publication Publication Date Title
US20150042789A1 (en) Determining the distance of an object to an electronic device
CN105827954A (en) Image acquisition device used for container and image processing system
CN107763955B (en) A refrigerator and its control method
JP6818407B2 (en) Refrigerator, image management system and program in the refrigerator
JP6571407B2 (en) Inside shooting device
US10785456B1 (en) Methods for viewing and tracking stored items
JP6655908B2 (en) Refrigerators and programs
CN106052294A (en) Refrigerator and method for judging change of objects in object storage area of refrigerator
US20210089769A1 (en) Refrigerator appliances and methods for tracking stored items
JP2000032438A (en) Surveillance camera device
EP4453487A1 (en) A refrigerator with camera wherein the opening distance of the door is detected
WO2023121606A1 (en) A refrigerator with camera wherein the opening distance of the door is detected
JP2006019845A5 (en)
JP6006929B2 (en) Inside monitoring device
US10999504B1 (en) Lens cover-based image capture device operation
CN217090154U (en) Article display device, container and inventory management system
CN112149465A (en) Item identification method and device
CN114500832A (en) Locker, image acquisition method, readable storage medium, and computer program product
JP6976046B2 (en) Management equipment, management system, management method and management program
US20250383141A1 (en) A domestic appliance and a method for processing images in a domestic appliance
US20230316755A1 (en) Refrigerator appliance and methods for tracking stored items in a freezer chamber
JP6898825B2 (en) Monitoring device
WO2023193756A1 (en) Refrigeration device and control method therefor
US12320580B2 (en) Refrigerator appliance and methods of item location identification
CN112307807A (en) Image recognition method, image recognition device and refrigerator

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20240326

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20250917

RIC1 Information provided on ipc code assigned before grant

Ipc: F25D 29/00 20060101AFI20250911BHEP

Ipc: F25D 23/00 20060101ALI20250911BHEP

Ipc: G06Q 10/08 20240101ALI20250911BHEP