WO2021212993A1 - 制冷电器摄像头模块和用于防止镜头起雾的方法 - Google Patents

制冷电器摄像头模块和用于防止镜头起雾的方法 Download PDF

Info

Publication number
WO2021212993A1
WO2021212993A1 PCT/CN2021/077333 CN2021077333W WO2021212993A1 WO 2021212993 A1 WO2021212993 A1 WO 2021212993A1 CN 2021077333 W CN2021077333 W CN 2021077333W WO 2021212993 A1 WO2021212993 A1 WO 2021212993A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera module
fog
capture
refrigeration appliance
camera
Prior art date
Application number
PCT/CN2021/077333
Other languages
English (en)
French (fr)
Inventor
古德曼 施罗德迈克尔
Original Assignee
海尔智家股份有限公司
青岛海尔电冰箱有限公司
海尔美国电器解决方案有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海尔智家股份有限公司, 青岛海尔电冰箱有限公司, 海尔美国电器解决方案有限公司 filed Critical 海尔智家股份有限公司
Publication of WO2021212993A1 publication Critical patent/WO2021212993A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D21/00—Defrosting; Preventing frosting; Removing condensed or defrost water
    • F25D21/04—Preventing the formation of frost or condensate
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D23/00—General constructional features
    • F25D23/02—Doors; Covers
    • F25D23/028—Details
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F25D29/005—Mounting of control devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2700/00—Means for sensing or measuring; Sensors therefor
    • F25D2700/02—Sensors detecting door opening

Definitions

  • the present invention generally relates to a system and a method for preventing fog from obstructing the line of sight of a camera, in particular to a camera in a refrigeration appliance.
  • Storage boxes (such as refrigeration appliances and food cabinets) generally provide enclosed rooms for accommodating various items or objects.
  • a refrigerating appliance generally includes a box defining a refrigerating compartment. The user can place food or objects in the refrigeration room to prevent this type of food from decay. Therefore, the use time of perishable items or objects can be extended.
  • the existing system solves these problems by setting a camera in the refrigeration room of the refrigeration appliance (for example, to view or track the contents in the refrigeration room). Nevertheless, the use of cameras in the refrigeration room can cause other problems.
  • rapid changes in air temperature or moisture content can cause condensate (ie, fog) to accumulate on the surface of the refrigeration compartment.
  • condensate ie, fog
  • moisture may condense on the lens of the camera module, thereby blocking or otherwise obstructing the line of sight of the camera, and generally degrading performance.
  • a refrigeration appliance in another exemplary aspect of the present disclosure, includes a box, a door, a camera module and a controller.
  • the box can define a refrigeration compartment.
  • the door is rotatably hinged to the box body for selective access to the refrigeration compartment.
  • the camera module can be installed on the box in the refrigeration room.
  • the controller is operatively connected to the camera module.
  • the controller may be configured to initiate a continuous anti-fog capture procedure on the camera module; during the continuous anti-fog capture procedure, receive a still image signal from the camera module; and discard the received still image signal.
  • an operating method of a refrigeration appliance includes: starting a continuous anti-fog capture program on the camera module.
  • the method further includes receiving a still image signal from the camera module during the continuous anti-fog capture procedure.
  • the method may still further include: discarding the received still image signal.
  • Fig. 1 provides a front elevation view of a refrigeration appliance according to an exemplary embodiment of the present disclosure.
  • Fig. 2 provides a front elevation view of a refrigerating appliance according to an exemplary embodiment of the present disclosure, in which the refrigerating door is shown in an open position.
  • Fig. 3 provides a schematic diagram of a refrigeration appliance according to an exemplary embodiment of the present disclosure.
  • Fig. 4 provides a schematic cross-sectional view of a camera module of a refrigeration appliance according to an exemplary embodiment of the present disclosure.
  • Fig. 5 provides a schematic cross-sectional view of a camera module of a refrigeration appliance according to other exemplary embodiments of the present disclosure.
  • Fig. 6 provides a flowchart illustrating a method of operating a refrigeration appliance according to an exemplary embodiment of the present disclosure.
  • the term “or” is generally intended to be inclusive (ie, "A or B” is intended to mean “A or B or both”).
  • the terms “first”, “second” and “third” can be used interchangeably to distinguish one component from another, and are not used to indicate the position or importance of each component.
  • approximate terms such as “approximately”, “substantially” or “approximately”, mean within a tolerance of ten percent (10%) of error.
  • the present disclosure provides a system and method for generating heat at a camera module in a low temperature environment (such as a refrigeration compartment of a refrigerating appliance), which is sufficient to prevent the accumulation of condensate that may otherwise block the camera.
  • a low temperature environment such as a refrigeration compartment of a refrigerating appliance
  • the system and method can generate such heat without requiring or using dedicated heating elements, such as resistance heating elements.
  • FIG. 1 provides a front elevation view of a refrigerating appliance 100 according to an exemplary embodiment of the present disclosure, in which the refrigerating door 128 of the refrigerating appliance 100 is shown in a closed position.
  • FIG. 2 shows a front elevation view of the refrigerating appliance 100, in which the refrigerating door 128 is shown in an open position to show the food preservation compartment 122 of the refrigerating appliance 100.
  • the refrigerating appliance 100 includes a casing or box 120 that extends along the vertical direction V between the top 101 and the bottom 102.
  • the box body 120 defines a refrigerating compartment for accommodating food to be stored.
  • the box body 120 defines a food preservation compartment 122 located at or near the top 101 of the box 120, and a freezer compartment 124 arranged at or near the bottom 102 of the box 120.
  • the refrigeration appliance 100 is generally called a bottom-mounted refrigeration appliance.
  • the advantages of the present disclosure are applicable to other types and styles of storage boxes, such as overhead refrigeration appliances, side-by-side refrigeration appliances, and the like. Therefore, the description set forth in this article is only for providing instructions, and is not limited to any specific storage box or refrigerating room configuration in any respect.
  • the refrigerating door 128 is rotatably hinged to the edge of the box body 120 to selectively enter the fresh food compartment 122.
  • the freezing door 130 is arranged below the refrigerating door 128 so as to selectively enter the freezing compartment 124.
  • the freezer door 130 is connected to a freezer drawer 142 (not shown), which is slidably installed in the freezer compartment 124.
  • Figure 1 shows the refrigerating door 128 and the freezer door 130 in a closed configuration
  • Figure 2 shows the refrigerating door 128 in an open position.
  • various storage components are installed in the food preservation compartment 122 to store food therein, as those skilled in the art will understand.
  • the storage part includes a box body 140, a drawer 142, and a shelf 144 installed in the food preservation compartment 122.
  • the box 140, the drawer 142, and the shelf 144 are configured to store items (for example, beverages or solid foods), and can assist in organizing such foods.
  • the drawer 142 may contain fresh food (for example, vegetables, fruits, or cheese), and may extend the service life of such fresh food.
  • the refrigerating appliance 100 further includes features for assisting the user to recognize the food in the food preservation compartment 122 or the freezing compartment 124.
  • the user can use such a feature to view the food (ie, stored items) stored in the fresh food compartment 122 or the freezer 124, or create an inventory list of such stored items.
  • FIG. 3 provides a schematic diagram of the refrigeration appliance 100.
  • the refrigeration appliance 100 includes a controller 150 that is operatively connected to or communicates with components of the refrigeration system of the refrigeration appliance 100, and these components are configured to cool the food preservation compartment 122 or the freezing compartment 124. These components include compressor 170, evaporator fan 172, and condenser fan 174.
  • the controller 150 can selectively operate these components in order to cool the food preservation compartment 122 or the freezing compartment 124.
  • the controller 150 also communicates with a thermostat (e.g., a thermocouple or a thermistor).
  • the thermostat may be located in the food preservation compartment 122 or the freezing compartment 124.
  • the controller 150 may receive a signal corresponding to the temperature of the food preservation compartment 122 or the freezing compartment 124 from the thermostat.
  • the controller 150 also includes an internal timer for calculating the elapsed time period.
  • the controller 150 may include a memory and one or more microprocessors, CPUs, etc., such as a general-purpose or special-purpose microprocessor operable to execute programming instructions or micro-control codes associated with the operation of the refrigeration appliance 100.
  • the memory may mean random access memory such as DRAM, or read-only memory such as ROM or FLASH.
  • the processor executes non-temporary programming instructions stored in memory.
  • the instructions include a software package configured to operate the appliance 100 or perform operation steps (for example, the exemplary method 600 described below with reference to FIG. 6).
  • the memory may be a separate component from the processor or included on a board within the processor.
  • controller 150 may be configured to perform without using a microprocessor (for example, using a combination of discrete analog or digital logic circuits; such as switches, amplifiers, integrators, comparators, flip-flops, AND gates, etc.) Control functions, but rely on software.
  • a microprocessor for example, using a combination of discrete analog or digital logic circuits; such as switches, amplifiers, integrators, comparators, flip-flops, AND gates, etc.
  • the controller 150 may be located at various positions in the entire refrigerating appliance 100. Input/output ("I/O") signals may be routed between the controller and various operating components of the refrigeration appliance 100. One or more components of the refrigeration appliance 100 may communicate with the controller 150 (for example, electrical communication) via one or more conductive signal lines or a shared communication bus. In addition, one or more components of the refrigeration appliance 100 may communicate with the controller 150 (for example, wireless communication) via one or more wireless signal lines.
  • I/O Input/output
  • the refrigeration appliance 100 further includes a camera or a camera module 160.
  • the camera 160 may be any type of device suitable for capturing two-dimensional pictures or images.
  • the camera 160 may be a video camera or a digital camera with an electronic image sensor (for example, a charge coupled device (CCD) or CMOS sensor).
  • the camera 160 communicates with the controller 150 (for example, electrical communication or wireless communication) so that the controller 150 can receive a signal corresponding to the image captured by the camera 160 from the camera 160.
  • the controller 150 for example, electrical communication or wireless communication
  • the camera 160 is located on the refrigerating appliance 100.
  • the camera 160 is installed on the top of the food preservation compartment 122 (for example, on the near side of the top 101 and on the far side of the bottom 102).
  • the camera 160 can be fixed to or guided through the top wall defining the inner container of the food preservation compartment 122. In such an embodiment, the camera 160 may be guided downward, as shown in FIG. 2.
  • the camera 160 is directed toward one or more refrigerated compartments (for example, the food preservation compartment 122).
  • the camera 160 may be directed toward at least a part of any specific one or combination of the drawer 142 and the shelf 144. Therefore, the camera 160 can capture images of one of the drawers 142, all of the drawers 142, one of the shelves 144, all of the shelves 144, or any suitable combination thereof.
  • the camera 160 including the circuit board 162_ and its main lens 164_ is disposed in the camera housing 210_.
  • the camera housing 210 extends around at least a portion of the camera 160 (for example, on the inner container 123).
  • the housing side wall 212_ may extend from the inner liner 123 around the camera 160 (for example, so that the camera is surrounded by the housing side wall 212_ in the radial direction).
  • the housing side wall 212_ may extend from the top end 214_ to the bottom end 216_.
  • the bottom end 216_ may be disposed below the bottommost surface of the camera 160 (e.g., as defined at the main lens 164).
  • the front wall 218_ extends radially inwardly from the housing side wall 212 (eg, at the bottom end 216_).
  • the front wall 218_ can define an opening or hole 220_ along the line of sight LS of the camera 160 or aligned with the line of sight LS of the camera 160, so that the viewing angle of the camera 160 is usually not blocked, and the camera 160 can collect the food preservation room through the hole 220_ 122 images.
  • FIG. 4 shows the hole 220_ as an open gap
  • the hole 220 may be covered by a transparent auxiliary lens 224_ spaced apart from the main lens 164 to close or seal the camera housing 210_, thereby preventing or restricting the camera 160 Fluid communication occurs with the refrigerated compartment (for example, the food preservation compartment 122) in which the camera is installed.
  • the refrigerated compartment for example, the food preservation compartment 122
  • the front wall 218_ is spaced apart from the camera 160 (eg, perpendicularly).
  • the camera housing 210_ When assembled, the camera housing 210_ usually defines an open space 222_ surrounding the camera 160.
  • the camera housing 210 may be formed of an impermeable solid material, such as a suitable polymer or metal.
  • the camera 160 When the camera 160 generates heat for capturing images (for example, partly caused by circuit resistance generated when current is introduced into or derived from the camera 160), this heat can be maintained or stored in the open space 222, which is beneficial Prevent condensate from accumulating on the main lens 164 or the auxiliary lens 224_.
  • the refrigeration appliance 100 includes an integrated display 180.
  • the integrated display 180 can be installed on the refrigerating door 128 or any other suitable position on the refrigerating appliance 100.
  • the integrated display 180 communicates with the controller 150 so that the integrated display 180 can receive a signal corresponding to the image captured by the camera 160 from the controller 150.
  • the integrated display 180 may receive such a signal from the controller 150 and present the image to the user in a visual manner.
  • the integrated display 180 may include, for example, a liquid crystal display panel (LCD), a plasma display panel (PDP), or any other suitable mechanism for displaying images (for example, a projector).
  • the refrigeration appliance 100 includes a network interface (not shown) that connects the refrigeration appliance 100 (for example, the controller 150) to the network 190, so that the refrigeration appliance 100 can be sent through the network 190 And receive information.
  • the network 190 may be any wired or wireless network, such as WAN, LAN, or HAN.
  • the refrigeration appliance 100 communicates with the mobile display 182 via the network 190.
  • the mobile display 182 may be configured as any device that communicates through the network 190 and displays images received therefrom.
  • the mobile display 182 may be a computer, a smart phone, or a tablet computer.
  • the mobile display 182 communicates with the controller 150 so that the mobile display 182 can receive a signal corresponding to the user interface or an image captured by the camera 160 from the controller 150 (via the network 190).
  • the mobile display 182 may receive such a signal from the controller 150 and present one or more images to the user in a visual manner.
  • the mobile display 182 includes, for example, a liquid crystal display panel (LCD), a plasma display panel (PDP), or any other suitable mechanism for displaying images (for example, a projector).
  • the mobile display 182 also includes an interface (for example, a tactile input such as a button, or a graphical user interface), which allows the mobile display 182 to initiate communication with the refrigerating appliance 100 via the network 190.
  • the refrigeration appliance 100 includes a detection component 186 (for example, to detect whether a user exists).
  • the detection component 186 includes one or more sensors configured to directly detect the presence of a user (for example, by detecting a biometric or personalized mark corresponding to a specific individual user), or indirectly detect whether the user exists (for example, , By detecting the movement of the door 128 or 130).
  • the detection component 186 includes a front-pointing camera configured to recognize or authenticate the user's face based on the captured two-dimensional image.
  • the detection component 186 includes a fingerprint imaging sensor configured to visually detect a user's fingerprint.
  • the detection component 186 includes a signal detection sensor configured to detect a device address through a wireless communication frequency band (for example, a BLE frequency band using short-wavelength UHF radio waves in the ISM frequency band from 2.4 GHz to 2.485 GHz) .
  • the device address may be a Bluetooth address programmed by the mobile display 182. Therefore, the detection component 186 can determine whether and when the mobile display 182 is in close proximity to the refrigeration appliance 100.
  • the detection component 186 includes a door switch (eg, a reed switch, a button switch, a Hall effect sensor, etc.) that is selectively engaged with the refrigerated door 128 to detect whether/when the door 128 is open Location.
  • a door switch eg, a reed switch, a button switch, a Hall effect sensor, etc.
  • opening the refrigerating door 128 can turn on the light and send a signal indicating that the user has been detected.
  • the camera 160 may capture (e.g., in the form of a data signal) one or more two-dimensional images (e.g., as a video feed or a series of Sequential static images), as commonly understood.
  • the camera 160 generates heat waves or heat pulses from the resistance of the current or voltage transmitted through various electronic components or circuits of the camera. Therefore, the heat wave or heat pulse usually corresponds to the sampling rate or frame rate of a particular image capture program.
  • the specific image capturing program may be changed or converted at the controller 150 (for example, based on one or more conditions of the refrigerating appliance 100) or the received image signal may be further analyzed.
  • the continuous anti-fog capture program can instruct the camera 160 to collect and transmit images (for example, in sequence at a set sampling rate, As defined by the number of frames per second).
  • images for example, in sequence at a set sampling rate, As defined by the number of frames per second.
  • such an image will be static (for example, objects in the field of view of the camera 160 will not move, or the lights in the food preservation compartment 122 will not be enough to collect anything other than a blank image).
  • the blank image or static image can be discarded (e.g., at the controller 150).
  • the door-opening capture program may instruct the camera 160 to collect and transmit images (for example, at a sampling rate different from that of the continuous anti-fog capture program). Set the sampling rate in order).
  • images for example, information or data values of objects or light within the field of view of the camera 160
  • the occupied image can be recorded (e.g., at least temporarily at the controller 150) so that the occupied image can be sent for presentation (e.g., at the integrated display 180 or the remote display 182).
  • items within the field of view (e.g., set field of view) of the camera 160 e.g., storage items such as food, or non-user accessories, shelves, movable drawers, etc.
  • the stored items can be automatically identified by the controller 150 (for example, to classify the items in the food preservation compartment 122).
  • these items can be identified or authenticated by edge matching, divide-and-conquer search, gray-scale matching, histogram of the received domain response, or another suitable routine (for example, based on one captured from the camera 160). Or multiple images are executed at the controller 150).
  • the camera 160 switches between a continuous anti-fog capture program and a door opening capture program so that the camera 160 remains activated to generate heat periodically (eg, based on the sampling rate for any image capture at a given moment).
  • the generation of such heat can prevent condensation or fog from accumulating in the line of sight LS of the camera 160 (for example, at the lens or auxiliary lens 224), and prevent blurring of the image captured by the camera 160.
  • the door opening capture program is started by a predetermined engagement action (for example, to stop or interrupt the continuous anti-fog capture procedure), the predetermined engagement action can open the door 128 and detect the presence of the inside of the refrigerated compartment (for example, the food preservation compartment 122).
  • the user enters or moves within the range of the detection component 186, provides user input at the user interface or integrated display 180, and so on.
  • the anti-fog capture program can be started (for example, to stop or interrupt the door capture program).
  • the camera 160 and the controller 150 are configured to capture multiple (e.g., a pair) two-dimensional sequential images (e.g., at a set sampling rate).
  • each two-dimensional image includes a plurality of pixels (e.g., arranged in a predetermined grid), as understood.
  • the sequential images for example, the previously captured image and the most recently captured image
  • the same field of view or line of sight for example, the same area of the food preservation compartment 122
  • the controller 150 may be discarded at the controller 150.
  • sequential images can be compared with each other or with a baseline value/value set (for example, a baseline value/value set for pixel brightness or color).
  • Changes in sequential images or changes relative to the baseline value/value set can be detected to prompt a new image capture program.
  • the detected change e.g., increased image value
  • the elevated image value can be detected by any suitable comparison or pixel feature that can indicate the brightness value or color value of the brightness value change or (for example, from the corresponding pixel in the sequential two-dimensional image) detected exercise.
  • each pixel in the two-dimensional image or the set field of view has a brightness range.
  • the brightness range may be an RGB brightness range between 0 and 255 (for example, where "0" is the minimum RGB pixel brightness value and "255" is the maximum RGB pixel brightness value).
  • the brightness values of multiple pixels can be detected for brightness measurement.
  • the average brightness (Bm) value of the pixel brightness value can be calculated for the corresponding two-dimensional image (or its sub-areas).
  • the deviation value of a plurality of pixels can be calculated (for example, as a brightness value).
  • the brightness value (Vbr) of the captured image can be calculated as the average brightness value minus the balance value (for example, 125) divided by the absolute value of the balance value.
  • the brightness value is expressed as
  • Vbr ( ⁇ Bm–125 ⁇ )/125.
  • the increased brightness value may prompt the door open capture procedure.
  • the increased brightness value may be an increase in the brightness value between one or more pixels in the first captured image and one or more corresponding pixels in the second captured image.
  • the brightness value of the corresponding captured image is relatively low.
  • the light from the inside of the fresh food compartment 122 may cause the brightness value of the corresponding captured image to be relatively high. Therefore, an increase in the detected brightness value (e.g., increase in a set amount, relative percentage, etc.) may indicate that the door 128 is open.
  • the method 600 provides a method for operating the refrigeration appliance 100 (FIG. 1), the refrigeration appliance 100 includes a camera, as described above.
  • the method 600 may be executed by the controller 150 (FIG. 3).
  • the controller 150 may communicate with the camera 160 or the detection component 186 (FIG. 3).
  • the controller 150 may send signals to the camera 160 or the detection component 186 and receive signals from the camera 160 or the detection component 186.
  • the controller 150 may further communicate with other suitable components of the electric appliance 100 in order to perform the overall operation of the electric appliance 100.
  • the method according to the present disclosure can efficiently prevent condensation from occurring in a part of the freezer compartment (for example, without requiring or using a dedicated heater or heating element).
  • the disclosed method allows the camera to generate heat by itself to continuously prevent condensation from accumulating (for example, on the lens of the camera) when the cooling appliance is running.
  • the method helps to efficiently manage the captured images (for example, so that the controller is not covered by stored or housed data).
  • Figure 6 depicts the steps performed in a specific order for illustration and discussion. Using the disclosure provided herein, those of ordinary skill in the art will understand that the steps of any method discussed herein can be modified, adjusted, rearranged, omitted or expanded in various ways without departing from the scope of the present disclosure. .
  • the method 600 includes: initiating a continuous anti-fog capture program at a camera or a camera module installed in a refrigerating compartment (for example, a food preservation room) of the refrigerating appliance.
  • the continuous anti-fog capture program can guide the sequential capture of images at the camera module. For example, capture a two-dimensional image at a set sampling rate.
  • the sampling rate of the anti-fog capture program may be relatively low, for example, between 1 frame per second to 25 frames per second. In addition, the sampling rate of the anti-fog capture program may be approximately 10 frames per second.
  • the start of the anti-fog capture program corresponds to the operation or turning on of the refrigeration appliance. Therefore, when the refrigeration appliance guides the operation of one or more features, the capture program can be directed to the camera. Specifically, the refrigeration appliance can guide multiple discrete capture programs to the camera. For example, the refrigeration appliance can switch between at least two capture procedures, such as a continuous anti-fog capture procedure and a door opening capture procedure. Alternatively, the continuous anti-fog capture procedure may be initiated at the end of (e.g., in response to this) another capture procedure (e.g., a door-opening capture procedure), and vice versa.
  • the continuous anti-fog capture procedure may be initiated at the end of (e.g., in response to this) another capture procedure (e.g., a door-opening capture procedure), and vice versa.
  • the method 600 includes receiving a still image signal from the camera module during the continuous anti-fog capture procedure.
  • the images captured at the camera can be sent to (and received by the controller of the cooling appliance) of the refrigeration appliance (for example, when these images are captured). Therefore, the still image signal corresponds to the image captured at the camera module as part of the continuous anti-fog capture procedure.
  • the method 600 includes discarding the received still image signal.
  • a continuous anti-fog capture program can capture images of the refrigerated compartment. Therefore, such an image (as provided with the image signal) can be deleted or discarded from the controller.
  • the static image signal is discarded immediately after the controller receives it.
  • the static image signal is discarded after a brief evaluation (e.g., in response to this) to detect rising pixel values or to compare a pair of sequential image signals.
  • the method 600 includes receiving an occupied image signal from the camera module during the door opening capture procedure.
  • the refrigeration appliance can switch between at least two capture procedures. Therefore, the method 600 includes converting from a continuous anti-fog capture program to an open door capture program at the camera module.
  • the images captured at the camera module can be sent to (and received by) the controller of the refrigeration appliance (for example, when these images are captured). Therefore, the occupied image signal in 640 corresponds to the image captured at the camera module as part of the door opening capture procedure.
  • the door opening capture program can guide the camera module to capture images sequentially. For example, a two-dimensional image is captured at a set sampling rate greater than the sampling rate of the anti-fog capture program. Therefore, the sampling rate of the door-opening capture program can be relatively high, for example, between 25 frames per second and 120 frames per second. In addition, the sampling rate can be greater than or equal to 30 frames per second. In addition, the sampling rate may be approximately 60 frames per second.
  • the switch to open door capture is prompted by a signal received or a detection performed during the continuous anti-fog capture procedure.
  • the controller may receive an opening signal from a door switch selectively connected to the door of the refrigeration appliance. In response to receiving the open signal, it usually prompts 640 and the door open capture program.
  • the controller detects an increased image value from a static image signal received in 620 (for example, before 630).
  • the elevated image value may be the brightness value or color value of a pixel or a group of pixels in a still image of a continuous anti-fog capture program.
  • the elevated image value may be an image value that exceeds the baseline image value or value set.
  • 630 is activated when or immediately before the transition to the door opening capture program.
  • the controller receives a pair of sequential image signals from a continuous anti-fog capture program.
  • a change for example, a change in brightness value or movement
  • a change between a pair of sequential image signals usually prompt 640 and open the door to capture the procedure.
  • 630 is activated when or immediately before the transition to the door opening capture program.
  • the method 600 includes (e.g., at least temporarily) recording an occupied image signal at the controller. Once recorded, the occupied image signal can be further analyzed. As an example, the occupied image signal can be sent to the display or rendered at the display. Therefore, as described above, a two-dimensional image corresponding to the occupied image signal can be presented at a suitable connected display (for example, an integrated display or a remote display). In addition, the two-dimensional image corresponding to the occupied image signal can be further evaluated according to the image recognition routine, as described further above (for example, to identify or classify the items stored in the refrigeration appliance).
  • the image recognition routine for example, to identify or classify the items stored in the refrigeration appliance.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

本发明提供了制冷电器摄像头模块和用于防止镜头起雾的方法。制冷电器包括箱体、门、摄像头模块和控制器。箱体可以限定出制冷间室。门可旋转地铰接至箱体，以便选择性地进入制冷间室。摄像头模块可以安装至制冷间室内的箱体上。控制器可操作地连接至摄像头模块。控制器配置为在摄像头模块上启动连续防雾捕获程序；在连续防雾捕获程序期间，从摄像头模块接收静态图像信号；以及丢弃所接收的静态图像信号。

Description

制冷电器摄像头模块和用于防止镜头起雾的方法 技术领域
本发明一般涉及用于防止雾遮挡摄像头视线的系统和方法，特别是一种制冷电器中的摄像头。
背景技术
储藏箱(例如制冷电器和食品柜)一般提供用于容纳多种物品或物体的封闭室。例如，制冷电器一般包括限定出制冷间室的箱体。用户可将食品或物体放置在制冷间室内，以防止此类食品腐烂。因此，可以延长易腐物品或物体的使用时间。
随着时间的推移，大量或许多储存的物品(例如食品)会积聚在制冷电器的制冷间室中。随着储存的物品的堆积，制冷电器的用户会难以鉴别制冷电器中的物品。另外，用户还可能会难以确定制冷电器内某些物品的数量。当多个用户不经与其他用户沟通即向普通制冷电器中添加或从中取出物品时，尤其如此。因此，用户可能会意外购买过量或不需要的物品。例如，某些食品在制冷间室内不容易腐烂，并且此类食品可能不经常食用。因此，此类食品可以长时间存放在制冷间室内。尽管有可接受的食品，但用户可能会忘记此类食品而购买替代品，进而可能给用户带来麻烦或增添不必要的开销。另外，一些用户可能不知道某些食物已清理或食用。因此，这些用户未能更新或补充这些食品。
现有系统通过在制冷电器的制冷间室内设置摄像头(例如，以查看或跟踪制冷间室内的内容物)来解决这些问题。尽管如此，在制冷间室内使用摄像头会产生其他问题。特别是，空气温度或水分含量的快速变化(例如，由开/关门所致)会导致冷凝物(即，雾)积聚在制冷间室的表面上。举例来说，水分可能会凝结在摄像头模块的镜头上，从而阻挡或以其他方式遮挡摄像头的视线，而且一般会使性能降低。
因此，一种具有用于防止冷凝物或雾沿着摄像头视线积聚的特征的方法或制冷电器将十分有益。
发明内容
本发明的各方面和优点将在以下描述中进行部分阐述，通过该描述清晰呈现，或通过实施本发明充分了解。
在本公开的另一个示例性方面，提供了一种制冷电器。该制冷电器包括箱体、门、摄像头模块和控制器。箱体可以限定出制冷间室。门可旋转地铰接至箱体，以便选择性地进入制 冷间室。摄像头模块可以安装至制冷间室内的箱体上。控制器可操作地连接至摄像头模块。控制器可以配置为在摄像头模块上启动连续防雾捕获程序；在连续防雾捕获程序期间，从摄像头模块接收静态图像信号；以及丢弃所接收的静态图像信号。
在本公开的另一个示例性方面，提供了一种制冷电器的操作方法。该方法包括：在摄像头模块上启动连续防雾捕获程序。该方法进一步包括：在连续防雾捕获程序期间，从摄像头模块接收静态图像信号。该方法仍可进一步包括：丢弃所接收的静态图像信号。
参考以下描述和所附权利要求，有助于更好地理解本发明的上述和其他特征、方面和优点。并入本说明书中并构成本说明书一部分的附图，示出了本发明的实施例，与描述一起用于说明本发明的原理。
附图说明
在参考附图的说明书中，针对本领域普通技术人员阐述了本发明的完整、可行公开内容，其中包括其最佳方式。
图1提供了根据本公开的示例性实施例的制冷电器前立视图。
图2提供了根据本公开的示例性实施例的制冷电器前立视图，其中显示的冷藏门处于打开位置。
图3提供了根据本公开的示例性实施例的制冷电器示意图。
图4提供了根据本公开的示例性实施例的制冷电器的摄像头模块示意性剖视图。
图5提供了根据本公开的其他示例性实施例的制冷电器的摄像头模块示意性剖视图。
图6提供了示出根据本公开的示例性实施例的一种操作制冷电器方法的流程图。
具体实施方式
现在将详细介绍本发明的实施例，这些实施例的一个或多个示例已在附图中示出。所提供的每个示例均用于说明本发明，而不是用于限制本发明。对于本领域技术人员，在不脱离本发明范围的情况下，可以对本发明进行各种修改和改变。举例来说，作为一个实施例的一部分示出或描述的特征，可以和另一个实施例一起使用，以形成另一个实施例。因此，本发明旨在涵盖落入所附权利要求及其等同物范围内的此类修改和变型。
在本文中，术语“或”一般旨在具有包含性(即，“A或B”旨在表示“A或B或二者”)。术语“第一”、“第二”和“第三”可以互换使用，以将一个部件与另一个部件区分开来，并不用于指示各个部件的位置或重要性。此外，如本文中所使用的，表示近似术语，例如“近似地”、“基本上”或“大约”，是指在误差百分之十(10％)的容限内。
一般，本公开提供用于在低温环境(例如制冷电器的制冷间室)中在摄像头模块处产生 热量的系统和方法，该系统和方法足以防止可能会以其他方式遮挡摄像头的冷凝物积聚。该系统和方法可以产生这种热量，而不需要或使用专用加热元件，例如电阻加热元件。
转到附图，图1提供了根据本公开示例性实施例的制冷电器100的前立视图，其中显示的制冷电器100的冷藏门128处于关闭位置。图2示出了制冷电器100的前立视图，其中示出的冷藏门128处于打开位置，以展示制冷电器100的食物保鲜室122。
制冷电器100包括壳体或箱体120，壳体或箱体120沿着竖直方向V在顶部101和底部102之间延伸。箱体120限定出制冷间室，用于容纳进行储藏的食品。特别地，箱体120限定出位于箱体120的顶部101或其附近的食物保鲜室122，以及布置在箱体120底部102或其附近的冷冻室124。制冷电器100一般称为底置式制冷电器。然而，经确认，本公开的优点适用于其他类型和样式的储藏箱，例如顶置式制冷电器、对开门式制冷电器等。因此，本文所阐述的描述仅用于提供说明，并不在任何方面限制为任何特定的储藏箱或冷藏室配置。
冷藏门128可旋转地铰接至箱体120的边缘，以便选择性地进入食物保鲜室122。在一些实施例中，冷冻门130布置在冷藏门128下方，以便选择性地进入冷冻室124。冷冻门130连接至冷冻抽屉142(未示出)，该冷冻抽屉142可滑动地安装在冷冻室124内。如上文所讨论的，图1示出了处于关闭配置的冷藏门128和冷冻门130，图2示出了出于打开位置的冷藏门128.
在一些实施例中，各个储藏部件安装在食物保鲜室122内，以便将食品储藏在其中，如本领域技术人员将理解的。特别地，储藏部件包括安装在食物保鲜室122内的盒体140、抽屉142和搁架144。盒体140、抽屉142和搁架144配置成用于储藏的物品(例如，饮料或固体食品)，并可辅助整理此类食品。作为示例，抽屉142可以容纳新鲜食品(例如，蔬菜、水果或奶酪)，并可延长此类新鲜食品的使用寿命。
在可选的实施例中，制冷电器100还包括用于辅助用户识别位于食物保鲜室122或冷冻室124内的食品的特征。用户可以使用这样的特征查看储藏在食物保鲜室122或冷冻室124内的食品(即，所储藏的物品)等，或创建此类所储藏的物品的存货单。
转到图1至图3，图3提供了制冷电器100的示意图。制冷电器100包括控制器150，该控制器150可操作地连接至制冷电器100的制冷系统的部件或与之通信，这些部件配置成用于冷却食物保鲜室122或冷冻室124。这些部件包括压缩机170、蒸发器风扇172和冷凝器风扇174。控制器150能够选择性地操作这些部件，以便冷却食物保鲜室122或冷冻室124。控制器150还与恒温器(例如，热电偶或热敏电阻)通信。恒温器可以位于食物保鲜室122或冷冻室124中。控制器150可以从恒温器接收与食物保鲜室122或冷冻室124的温度相对应的信号。控制器150还包括用于计算经过的时间段内部计时器。
控制器150可以包括存储器和一个或多个微处理器、CPU等，例如可操作执行与制冷电器100的操作相关联的编程指令或微控制代码的通用或专用微处理器。存储器可以表示DRAM之类的随机存取存储器，或ROM或FLASH之类的只读存储器。在一些实施例中，处理器执行存储在存储器中的非临时编程指令。对于某些实施例，指令包括软件包，该软件包配置为操作电器100或执行操作步骤(例如，下面参照图6所描述的示例性方法600)。存储器可以是与处理器分离的部件，或包含在处理器内的板上。另选地，控制器150可以构造成不使用微处理器(例如，使用分立的模拟或数字逻辑电路的组合；例如开关、放大器、积分器、比较器、触发器、“与”门等)执行控制功能，而是依靠软件。
控制器150可以位于整个制冷电器100中的各个位置。可以在控制器与制冷电器100的各个操作部件之间对输入/输出(“I/O”)信号进行路由。制冷电器100的一个或多个部件可以经由一根或多根传导性信号线或共享的通信总线，与控制器150通信(例如，电通信)。另外，制冷电器100的一个或多个部件可以经由一根或多根无线信号线，与控制器150通信(例如，无线通信)。
在一些实施例中，制冷电器100还包括摄像头或摄像头模块160。摄像头160可以是适合于捕获二维图片或图像的任何类型的装置。作为一个示例，摄像头160可以是具有电子图像传感器(例如，电荷耦合装置(CCD)或CMOS传感器)的视频摄像头或数字摄像头。在组装时，摄像头160与控制器150通信(例如，电通信或无线通信)，使得控制器150可以从摄像头160接收与由摄像头160捕获的图像相对应的信号。
通常，摄像头160位于制冷电器100上。在一些实施例中，摄像头160在食物保鲜室122内安装在其顶部(例如，在顶部101的近侧并在底部102的远侧)。举例来说，可以将摄像头160固定至或引导穿过限定出食物保鲜室122内胆的顶壁。在这样的实施例中，可以将摄像头160向下引导，如图2所示。
在某些实施例中，将摄像头160朝向一个或多个制冷间室(例如，食物保鲜室122)引导。举例来说，可以将摄像头160朝向抽屉142和搁架144中任何特定的一个或组合的至少一部分引导。因此，摄像头160可以捕获抽屉142之一、所有抽屉142、搁架144之一、所有搁架144或其任何合适组合的图像。
转向图4和图5，在一些实施例中，包括电路板162_及其主镜头164_的摄像头160设置在摄像头外壳210_内。如图所示，摄像头外壳210围绕摄像头160(例如，在内胆123上)的至少一部分延伸。举例来说，外壳侧壁212_可以围绕摄像头160从内胆123延伸(例如，使得摄像头在径向被外壳侧壁212_环绕)。具体地，外壳侧壁212_可以从顶端214_延伸到底端216_。如果安装在内胆123的顶部，底端216_则可以设置在摄像头160(例如，如在主镜 头164处所限定的)的最底部表面下方。前壁218_从外壳侧壁212(例如，在底端216_处)向内径向延伸。前壁218_可以沿着摄像头160的视线LS或与摄像头160的视线LS对齐地限定出开口或孔220_，使得摄像头160的视角通常不被遮挡，而摄像头160能够通过孔220_收集食物保鲜室122的图像。虽然图4将孔220_示出为开放空隙，但图5示出孔220可以由与主镜头164间隔开的透明辅镜头224_覆盖，以关闭或密封摄像头外壳210_，从而防止或限制摄像头160和其中安装摄像头的制冷间室(例如食物保鲜室122)之间发生流体连通。
如图4和图5大体所示，前壁218_与摄像头160(例如，垂直)间隔开。在组装时，摄像头外壳210_通常限定出围绕摄像头160的开放空间222_。摄像头外壳210可以由不可渗透的固体材料(例如合适的聚合物或金属)形成。当摄像头160产生用于捕获图像的热量(例如，部分由电流导入摄像头160或从摄像头160导出时产生的电路电阻所致)时，这种热量可保持或储存在开放空间222内，从而有利于防止冷凝物积聚在主镜头164或辅镜头224_。
大致回到图1至图3，在某些实施例中，制冷电器100包括集成显示器180。集成显示器180可以安装在冷藏门128上，或安装在制冷电器100上的任何其他合适的位置。集成显示器180与控制器150通信，使得集成显示器180可以从控制器150接收与摄像头160捕获的图像相对应的信号。集成显示器180可以从控制器150接收这样的信号，并且将该图像以可视的方式呈现给用户。集成显示器180可以包括：例如，液晶显示面板(LCD)，等离子显示面板(PDP)或用于显示图像的任何其他合适的机构(例如，投影仪)。
在另外或另选的实施例中，制冷电器100包括网络接口(未示出)，该网络接口将制冷电器100(例如，控制器150)连接至网络190，使得制冷电器100可以通过网络190发送和接收信息。网络190可以是任何有线或无线网络，例如WAN、LAN或HAN。
在一些这样的实施例中，制冷电器100(例如，控制器150)经由网络190与移动显示器182通信。移动显示器182可配置为通过网络190进行通信并显示从其接收的图像的任何装置。例如，移动显示器182可以是计算机、智能手机或平板电脑。移动显示器182与控制器150通信，使得移动显示器182可以(经由网络190)从控制器150接收与用户界面相对应的信号或由摄像头160捕获的图像。移动显示器182可以从控制器150接收这种信号，将一个或多个图像以可视方式呈现给用户。移动显示器182包括：例如，液晶显示面板(LCD)、等离子显示面板(PDP)或用于显示图像的任何其他合适机构(例如，投影仪)。移动显示器182还包括界面(例如，按键之类的触觉输入，或图形用户界面)，该界面允许移动显示器182通过网络190发起与制冷电器100的通信。
在某些实施例中，制冷电器100包括检测组件186(例如，以检测用户是否存在)。举例来说，检测组件186包括一个或多个传感器，其配置为直接检测用户是否存在(例如，通过 检测与具体个体用户相对应的生物特征或个性化标记)，或间接检测用户是否存在(例如，通过检测门128或130的运动)。
作为一个示例，检测组件186包括前向摄像头，该前向摄像头配置为基于所捕获的二维图像，识别或鉴别用户的面部。
作为另一个示例，检测组件186包括指纹成像传感器，该指纹成像传感器配置为视觉检测用户的指纹。
作为又一个示例，检测组件186包括信号检测传感器，该信号检测传感器配置为通过无线通信频带(例如，使用从2.4GHz到2.485GHz的ISM频带中的短波长UHF无线电波的BLE频带)检测装置地址。举例来说，装置地址可以是移动显示器182编程的蓝牙地址。因此，检测组件186可以确定移动显示器182是否以及何时紧密接近制冷电器100。
作为另一个示例，检测组件186包括门开关(例如，簧片开关、按钮开关、霍尔效应传感器等)，该门开关与冷藏门128选择性地接合，以检测门128是否/何时处于打开位置。举例来说，这样的开关通常可同时控制用于照亮食物保鲜室122的灯的开启。因此，打开冷藏门128可以开启灯并发送指示检测到用户的信号。
在使用期间，例如在一个或多个图像捕获程序期间，摄像头160可以捕获(例如，以数据信号的形式)发送至控制器150的一个或多个二维图像(例如，作为视频馈送或一系列顺序静态图像)，如通常所理解的。每次图像捕获时，摄像头160从通过摄像头的各个电子部件或电路传输的电流或电压的电阻产生热浪或热脉冲。因此，该热浪或热脉冲通常对应于特定图像捕获程序的采样率或帧速率。可以在控制器150处，(例如，基于制冷电器100的一个或多个条件)改变或转换该特定图像捕获程序或进一步分析所接收的图像信号。
作为用途的一个示例，即使一个或多个门128已关闭或者没有其他用户以其他方式在场，连续防雾捕获程序可以指示摄像头160摄像头收集并传输图像(例如，以设定采样率按顺序进行，如每秒帧数所定义的)。通常，这样的图像将是静态的(例如，处于摄像头160视野内的物体将不会移动，或食物保鲜室122内的灯将不足以收集除空白图像以外的任何东西)。一旦捕获，即可(例如，在控制器150处)丢弃空白图像或静态图像。
作为用途的另一个示例，虽然一个或多个门128已打开或者有用户以其他方式在场，开门捕获程序可以指示摄像头160收集并传输图像(例如，以与连续防雾捕获程序的采样率不同的设定采样率按顺序进行)。通常，这样的图像(例如，摄像头160视野内的物体或光的信息或数据值)将被占用。一旦捕获，即可记录已占用图像(例如，至少暂时在控制器150处)，使得可以发送该已占用图像进行呈现(例如，在集成显示器180或远程显示器182处)。另外，从所记录的已占用图像中，摄像头160的视野(例如，设定的视野)内的物品(例如，食物 之类的储藏物品，或用户附件、搁架、可移动抽屉之类的非储藏物品)可以由控制器150自动鉴别(例如，以对食物保鲜室122内的物品进行分类)。如所理解的，可以通过边缘匹配、分治法搜索、灰度匹配、接收域响应的直方图或另一合适的例程进行对这些物品的识别或鉴别(例如，基于从摄像头160捕获的一个或多个图像在控制器150处执行)。
在一些实施例中，摄像头160在连续防雾捕捉程序和开门捕捉程序之间转换，使得摄像头160保持启动，以便定期产生热量(例如，根据在给定时刻进行任何图像捕捉的采样率)。有利地，这种热量的产生可以防止冷凝物或雾在摄像头160的视线LS内积聚(例如，在镜头或辅镜头224处)，并防止使摄像头160捕获的图像模糊。可选地，通过预定接合动作启动开门捕获程序(例如，从而停止或中断连续防雾捕获程序)，该预定接合动作可打开门128、检测到制冷间室(例如，食物保鲜室122)内的移动、用户进入检测组件186的范围或在其中移动、在用户界面或集成显示器180处提供用户输入等。另外，通过单独的预定动作或在不存在启动开门捕获程序的接合动作的情况下，可以启动防雾捕获程序(例如，从而停止或中断开门捕获程序)。
在可选的实施例中，作为防雾捕捉程序的一部分，摄像头160和控制器150被配置为捕获多个(例如，一对)二维顺序图像(例如，以设定的采样率)。通常，每个二维图像包括多个像素(例如，以预定网格布置)，如所理解的。可以在丢弃用于防雾捕获程序的相同视野或视线(例如，食物保鲜室122的相同区域)的顺序图像(例如，先前捕获的图像和最近捕获的图像)之前，在控制器150处对其进行比较。举例来说，可以将顺序图像互相比较或与基线值/值集(例如，像素亮度或颜色的基线值/值集)进行比较。可以检测到顺序图像的变化或相对于基线值/值集的变化，以提示新的图像捕获程序。具体而言，检测到的变化(例如升高的图像值)可以提示控制器150从连续防雾程序转换为开门捕获程序。可以通过任何合适的比较或像素特征来检测升高的图像值，该比较或像素特征可以指示亮度值变化的亮度值或颜色值或(例如，从顺序二维图像中的相应像素中)检测到的运动。
可以理解，二维图像或设定的视场内的每个像素都具有亮度范围。可选地，亮度范围可以是0至255之间的RGB亮度范围(例如，其中“0”是最小RGB像素亮度值，“255”是最大RGB像素亮度值)。在某些实施例中，可以检测多个像素的亮度值以进行亮度测量。举例来说，可以针对对应的二维图像(或其子区域)，计算像素亮度值的平均亮度(Bm)值。另外，与平衡值相比，可以计算多个像素的偏差值(例如，作为亮度值)。举例来说，可以将捕获的图像的亮度值(Vbr)计算为平均亮度值减去平衡值(例如125)除以平衡值的绝对值。换言之，在一些实施例中，亮度值表示为
Vbr＝(│Bm–125│)/125。
在一些实施例中，在防雾捕获程序期间，升高的亮度值可以提示开门捕获程序。举例来说，升高的亮度值可以是第一捕获图像中一个或多个像素与第二捕获图像中一个或多个对应像素之间的亮度值增加。当门128关闭时，相应捕获图像的亮度值相对较低。相比之下，当门128打开时，来自食物保鲜室122内部的光可以导致相应捕获图像的亮度值相对较高。因此，检测到的亮度值的增加(例如，设定量、相对百分比等的增加)可以指示门128是打开的。
转到图6，提供了根据本公开的示例性实施例的方法600的流程图。通常，方法600提供一种操作制冷电器100的方法(图1)，该制冷电器100包括摄像头，如上文所述。举例来说，方法600可以由控制器150执行(图3)。例如，如所讨论的，控制器150可以与摄像头160或检测组件186通信(图3)。在操作期间，控制器150可以向摄像头160或检测组件186发送信号并从摄像头160或检测组件186接收信号。控制器150可以进一步与电器100的其他合适组件通信，以便执行电器100的总体操作。
有利地，根据本公开的方法可以高效地防止在冷冻室的一部分内发生冷凝(例如，而不需要或使用专用加热器或加热元件)。例如，所公开的方法准许摄像头自身产生热量，以在制冷电器运行时不断地防止冷凝物积聚(例如，在摄像头的镜头上)。另外，本方法有助于对捕获的图像进行高效管理(例如，使得控制器不被储藏或容纳的数据覆盖)。
图6描绘了以特定顺序执行的步骤，以用于说明和讨论。使用本文提供的公开内容，本领域普通技术人员将理解，在不背离本公开范围的情况下，能够以各种方式对本文所讨论的任何方法的步骤进行修改、调整、重新布置、省略或扩展。
在610中，方法600包括：在安装在制冷电器的制冷间室(例如，食物保鲜室)内的摄像头或摄像头模块处启动连续防雾捕获程序。通常，连续防雾捕获程序可以引导在摄像头模块处按顺序捕获图像。举例来说，以设定采样率捕获二维图像。防雾捕获程序的采样率可能相对较低，例如在每秒1帧至每秒25帧之间。另外，防雾捕获程序的采样率可以是大约每秒10帧。
通常，防雾捕获程序的启动对应于制冷电器的操作或开启。因此，当制冷电器引导一个或多个特征的操作时，捕获程序可以指向摄像头。具体地，制冷电器可以将多个离散的捕获程序引导至摄像头。举例来说，制冷电器可以在至少两个捕获程序之间转换，例如连续防雾捕获程序和开门捕获程序。可选地，连续防雾捕获程序可以在另一捕获程序(例如，开门捕获程序)结束时(例如，响应于此)启动，反之亦然。
在620中，方法600包括：在连续防雾捕获程序期间，从摄像头模块接收静态图像信号。如上文所述，在摄像头处捕获的图像可以发送至制冷电器的控制器(并由制冷电器的控制器 接收)(例如，当捕获这些图像时)。因此，静态图像信号对应于作为连续防雾捕获程序一部分而在摄像头模块处捕获的图像。
在630中，方法600包括：丢弃所接收的静态图像信号。通常，当预期很少或没有信息可辨别时，连续防雾捕获程序可以捕获制冷间室的图像。因此，可以从控制器中删除或丢弃这样的图像(如与图像信号一起提供的)。可选地，在控制器接收到静态图像信号后立即将其丢弃。另选地，在短暂的评价之后(例如，响应于此)丢弃静态图像信号，以检测升高的像素值或比较一对顺序图像信号。
在640中，方法600包括：在开门捕获程序期间，从摄像头模块接收已占用图像信号。在某些实施例中，制冷电器可以在至少两个捕获程序之间转换。因此，方法600包括：在摄像头模块处从连续防雾捕获程序转换为开门捕获程序。在开门捕获程序期间，在摄像头模块处捕获的图像可以发送到制冷电器的控制器(并由制冷电器的控制器接收)(例如，当捕获这些图像时)。因此，640中的已占用图像信号对应于作为开门捕获程序一部分而在摄像头模块处捕获的图像。
通常，开门捕获程序可以引导在摄像头模块处按顺序捕获图像。举例来说，以大于防雾捕获程序采样率的设定采样率捕获二维图像。因此，开门捕获程序的采样率可以相对较高，例如在每秒25帧至每秒120帧之间。另外，采样率可大于或等于每秒30帧。另外，采样率可以是大约每秒60帧。
在一些实施例中，通过在连续防雾捕获程序期间接收到的信号或进行的检测来提示转换为开门捕获。
作为一个示例，如上所述，控制器可以从与制冷电器的门选择性地连接的门开关接收打开信号。响应于接收打开信号，通常提示640和开门捕获程序。
作为另外或另选的示例，控制器从620中(例如，在630之前)所接收的静态图像信号检测到升高的图像值。如上文所述，升高的图像值可以是连续防雾捕获程序的静态图像中一个像素或一组像素的亮度值或颜色值。特别地，升高的图像值可以是超出基线图像值或值集的图像值。响应于接收或检测到升高的图像值，通常提示640和开门捕获程序。在一些这样的实施例中，在转换为开门捕获程序时或紧接在其之前启动630。
作为另外或另选的示例，控制器从连续防雾捕获程序接收一对顺序图像信号。如上文所述，在该对顺序图像信号之间，可以检测到变化(例如，亮度值或移动的变化)。响应于检测到一对顺序图像信号之间的变化，通常提示640和开门捕获程序。在一些这样的实施例中，在转换为开门捕获程序时或紧接在其之前启动630。
在650中，方法600包括：(例如，至少暂时地)在控制器处记录已占用图像信号。一旦 记录，即可对已占用图像信号进行进一步分析。作为一个示例，可以将已占用图像信号发送至显示器或在显示器处渲染。因此，如上文所述，可以在合适的已连接显示器(例如，集成显示器或远程显示器)处呈现与已占用图像信号相对应的二维图像。另外，可以根据图像识别例程进一步评价与已占用图像信号相对应的二维图像，如上文中进一步所述(例如，以鉴别储藏在制冷电器内的物品或对其进行分类)。
本书面描述使用示例来公开本发明(包括最佳方式)，可使本领域技术人员实践本发明，包括制造和使用任何设备或系统以及执行任何包含的方法。本发明的可授予专利权的范围由权利要求限定，包括本领域技术人员想到的其他示例。如果此类其他示例包括与权利要求的字面语言并无区别的结构元件，或此类其他示例包括与权利要求的字面语言没有实质性区别的等效结构元件，此类其他示例则包含在权利要求的范围内。

Claims (18)

  1. 一种制冷电器，其包括：
    箱体，其限定出制冷间室；
    门，其可旋转地铰接至所述箱体，以便选择性地进入所述制冷间室；
    摄像头模块，其安装至所述箱体上；和
    控制器，其可操作地连接至所述摄像头模块，所述控制器配置为用于启动操作步骤，所述操作步骤包括：
    在所述摄像头模块上启动连续防雾捕获程序，
    在所述连续防雾捕获程序期间，从所述摄像头模块接收静态图像信号，以及
    丢弃接收的所述静态图像信号。
  2. 根据权利要求1所述的制冷电器，其特征在于，所述防雾捕获程序的采样率在每秒1帧至25帧之间。
  3. 根据权利要求1所述的制冷电器，其特征在于，所述操作步骤进一步包括：
    在所述摄像头模块中从所述连续防雾捕获程序转换为开门捕获程序，以及
    在所述开门捕获程序期间，记录来自所述摄像头模块的图像信号。
  4. 根据权利要求3所述的制冷电器，其特征在于，所述开门捕获程序的采样率大于所述防雾捕获程序的采样率。
  5. 根据权利要求4所述的制冷电器，其特征在于，所述开门捕获程序的采样率大于或等于每秒30帧。
  6. 根据权利要求3所述的制冷电器，其进一步包括门开关，所述门开关与所述门选择性地连接，其特征在于，所述操作步骤进一步包括：从所述门开关接收打开信号，响应所述打开信号转换为所述开门捕获程序。
  7. 根据权利要求3所述的制冷电器，其特征在于，所述操作步骤进一步包括：在接收的所述静态图像信号中检测到升高的图像值，在所述连续防雾捕获程序期间，响应于在接收的所述静态图像信号中检测到升高的图像值，转换为所述开门捕获程序。
  8. 根据权利要求3所述的制冷电器，其特征在于，所述操作步骤进一步包括
    在所述连续防雾捕获程序期间，从所述摄像头模块接收一对顺序图像信号，以及
    检测所述一对顺序图像信号之间的像素变化，
    在所述连续防雾捕获程序期间，响应于所述检测所述一对顺序图像信号之间的像素变化，转换为所述开门捕获程序。
  9. 根据权利要求1所述的制冷电器，其特征在于，所述摄像头模块设置在摄像头外壳内，所述摄像头外壳包括前壁，所述前壁限定出沿着所述摄像头模块的视线的孔，所述前壁与所述摄像头模块间隔开。
  10. 一种操作制冷电器的方法，所述制冷电器包括安装在制冷间室内的摄像头模块，所述方法包括：
    在所述摄像头模块上启动连续防雾捕获程序；
    在所述连续防雾捕获程序期间，从所述摄像头模块接收静态图像信号；以及
    丢弃接收的所述静态图像信号。
  11. 根据权利要求10所述的方法，其特征在于，所述防雾捕获程序的采样率在每秒1帧至25帧之间。
  12. 根据权利要求10所述的方法，所述方法进一步包括：
    在所述摄像头模块中从所述连续防雾捕获程序转换为开门捕获程序；以及
    在所述开门捕获程序期间，记录来自所述摄像头模块的图像信号。
  13. 根据权利要求12所述的方法，其特征在于，所述开门捕获程序的采样率大于所述防雾捕获程序的采样率。
  14. 根据权利要求13所述的方法，其特征在于，所述开门捕获程序的采样率大于或等于每秒30帧。
  15. 根据权利要求12所述的方法，其特征在于，所述方法进一步包括：
    从与所述制冷电器的门选择性地连接的门开关中接收打开信号，响应于所述接收打开信号，转换为所述开门捕获程序。
  16. 根据权利要求12所述的方法，其特征在于，所述方法进一步包括：
    在接收的所述静态图像信号中检测到升高的图像值，
    在所述连续防雾捕获程序期间，响应于在接收的所述静态图像信号中检测到升高的图像值，转换为所述开门捕获程序。
  17. 根据权利要求12所述的方法，其特征在于，所述方法进一步包括：
    在所述连续防雾捕获程序期间，从所述摄像头模块中接收一对顺序图像信号，以及
    检测所述一对顺序图像信号之间的像素变化，
    在所述连续防雾捕获程序期间，响应于所述检测所述一对顺序图像信号之间的像素变化，转换为所述开门捕获程序。
  18. 根据权利要求10所述的方法，其特征在于，所述摄像头模块设置在摄像头外壳内，所述摄像头外壳包括前壁，所述前壁限定出沿着所述摄像头模块的视线的孔，所述前壁与所 述摄像头模块间隔开。
PCT/CN2021/077333 2020-05-26 2021-02-23 制冷电器摄像头模块和用于防止镜头起雾的方法 WO2021212993A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/882,820 US11122203B1 (en) 2020-05-26 2020-05-26 Refrigerator camera modules and methods for preventing lens fog
US16/882,820 2020-05-26

Publications (1)

Publication Number Publication Date
WO2021212993A1 true WO2021212993A1 (zh) 2021-10-28

Family

ID=77665937

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/077333 WO2021212993A1 (zh) 2020-05-26 2021-02-23 制冷电器摄像头模块和用于防止镜头起雾的方法

Country Status (2)

Country Link
US (1) US11122203B1 (zh)
WO (1) WO2021212993A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD965648S1 (en) * 2019-01-17 2022-10-04 Samsung Electronics Co., Ltd. Handle for home appliance
KR20220023599A (ko) * 2020-08-21 2022-03-02 주식회사 위니아전자 냉장고용 카메라 이슬맺힘 제거장치 및 그 제어방법
US20230308632A1 (en) * 2022-03-28 2023-09-28 Haier Us Appliance Solutions, Inc. Refrigerator camera modules and methods for addressing persistent conditions on the camera lens
US20240068742A1 (en) * 2022-08-24 2024-02-29 Haier Us Appliance Solutions, Inc. Gasket leak detection in a refrigerator appliance
CN116132773B (zh) * 2023-04-04 2023-06-23 合肥埃科光电科技股份有限公司 一种防雾系统、带有防雾系统的相机及其控制方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204272269U (zh) * 2015-01-09 2015-04-15 合肥美菱股份有限公司 一种冰箱用防雾摄像头
CN105571238A (zh) * 2016-02-25 2016-05-11 合肥华凌股份有限公司 冰箱
CN205647718U (zh) * 2016-05-06 2016-10-12 青岛海尔股份有限公司 摄像装置及具有该摄像装置的冰箱
CN106091557A (zh) * 2016-06-24 2016-11-09 青岛海尔电冰箱有限公司 一种用于冰箱的摄像头的防雾控制方法
CN106123475A (zh) * 2016-06-27 2016-11-16 青岛海尔特种电冰箱有限公司 一种用于冰箱的摄像头的防雾控制方法
US20190072322A1 (en) * 2016-03-07 2019-03-07 Samsung Electronics Co., Ltd Refrigerator

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2536074A4 (en) * 2010-02-12 2014-01-08 Hitachi Ltd INFORMATION PROCESSING DEVICE AND METHOD FOR PROCESSING INFORMATION ON THE INFORMATION PROCESSING DEVICE
JP6411753B2 (ja) * 2013-03-12 2018-10-24 東芝ライフスタイル株式会社 冷蔵庫、及びカメラ装置
CN105605881B (zh) 2013-04-23 2020-01-21 Lg电子株式会社 冰箱及其控制方法
DE102013211096A1 (de) 2013-06-14 2014-12-18 BSH Bosch und Siemens Hausgeräte GmbH Kältegerätesystem
JP6313014B2 (ja) * 2013-08-27 2018-04-18 東芝ライフスタイル株式会社 カメラシステム、冷蔵庫
US9697436B2 (en) * 2015-01-16 2017-07-04 Haier Us Appliance Solutions, Inc. Method for selecting an image of an appliance with a suitable position or orientation of a door of the appliance
US10956856B2 (en) * 2015-01-23 2021-03-23 Samsung Electronics Co., Ltd. Object recognition for a storage structure
US10365671B1 (en) 2015-06-25 2019-07-30 Amazon Technologies, Inc. Sensor window heating apparatus
US10257474B2 (en) * 2016-06-12 2019-04-09 Apple Inc. Network configurations for integrated accessory control
US11335010B2 (en) * 2019-08-15 2022-05-17 Haier Us Appliance Solutions, Inc. Methods for viewing and tracking stored items

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204272269U (zh) * 2015-01-09 2015-04-15 合肥美菱股份有限公司 一种冰箱用防雾摄像头
CN105571238A (zh) * 2016-02-25 2016-05-11 合肥华凌股份有限公司 冰箱
US20190072322A1 (en) * 2016-03-07 2019-03-07 Samsung Electronics Co., Ltd Refrigerator
CN205647718U (zh) * 2016-05-06 2016-10-12 青岛海尔股份有限公司 摄像装置及具有该摄像装置的冰箱
CN106091557A (zh) * 2016-06-24 2016-11-09 青岛海尔电冰箱有限公司 一种用于冰箱的摄像头的防雾控制方法
CN106123475A (zh) * 2016-06-27 2016-11-16 青岛海尔特种电冰箱有限公司 一种用于冰箱的摄像头的防雾控制方法

Also Published As

Publication number Publication date
US11122203B1 (en) 2021-09-14

Similar Documents

Publication Publication Date Title
WO2021212993A1 (zh) 制冷电器摄像头模块和用于防止镜头起雾的方法
JP6307698B2 (ja) 冷蔵庫
US11335010B2 (en) Methods for viewing and tracking stored items
US9860491B2 (en) Refrigerator having a camera and method of operating the same based on position of a door
WO2021057769A1 (zh) 用于查看并跟踪所储存的物品的方法
JP6307702B2 (ja) 冷蔵庫
JP7012263B2 (ja) 冷蔵庫
US20140168396A1 (en) Method for viewing contents of a refrigerator appliance
JP2014070796A (ja) 庫内撮影装置および冷蔵庫
JP7281755B2 (ja) 冷蔵庫
WO2021057820A1 (zh) 制冷电器和用于跟踪所储存物品的方法
JP2022033235A (ja) 冷蔵庫
JP7113281B2 (ja) 冷蔵庫
US11512896B2 (en) Refrigerator appliance having a movable camera
CN114562845B (zh) 冷藏冷冻设备的控制方法与冷藏冷冻设备
US20230308632A1 (en) Refrigerator camera modules and methods for addressing persistent conditions on the camera lens
US20230316755A1 (en) Refrigerator appliance and methods for tracking stored items in a freezer chamber
US11692767B2 (en) Refrigerator appliance and methods of user identification
US11800068B1 (en) Refrigerator camera modules and methods for conserving energy at the same
JP6518958B2 (ja) 冷蔵庫
JP7289084B2 (ja) 冷蔵庫
US20230375258A1 (en) Refrigerator appliances and image-based methods of detecting a door position
JP7289083B2 (ja) 冷蔵庫
JP2023099664A (ja) 冷蔵庫

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21793511

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21793511

Country of ref document: EP

Kind code of ref document: A1