CN113915871A - Refrigerator and control method thereof - Google Patents
Refrigerator and control method thereof Download PDFInfo
- Publication number
- CN113915871A CN113915871A CN202110244812.0A CN202110244812A CN113915871A CN 113915871 A CN113915871 A CN 113915871A CN 202110244812 A CN202110244812 A CN 202110244812A CN 113915871 A CN113915871 A CN 113915871A
- Authority
- CN
- China
- Prior art keywords
- spliced
- picture
- frame
- backlight plate
- pictures
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000003708 edge detection Methods 0.000 claims description 22
- 230000000694 effects Effects 0.000 abstract description 6
- 238000013527 convolutional neural network Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000008014 freezing Effects 0.000 description 4
- 238000007710 freezing Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000011176 pooling Methods 0.000 description 2
- 238000006748 scratching Methods 0.000 description 2
- 230000002393 scratching effect Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D11/00—Self-contained movable devices, e.g. domestic refrigerators
- F25D11/02—Self-contained movable devices, e.g. domestic refrigerators with cooling compartments at different temperatures
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
- F25D29/005—Mounting of control devices
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2500/00—Problems to be solved
- F25D2500/06—Stock management
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The invention discloses a refrigerator, comprising: a box body, wherein a plurality of storerooms are arranged inside the box body; the door is arranged at the opening of the storage chamber, and at least two camera devices in the same vertical direction are arranged on one surface of the door facing the storage chamber; the controller is configured to: responding to a shooting instruction, and controlling all the camera devices to shoot the storeroom; acquiring a picture to be spliced, which is shot by a camera device, and acquiring a frame of a backlight plate which is arranged in the picture to be spliced and opposite to the box door; acquiring an alignment line of each picture to be spliced according to a frame of the backlight plate; the alignment line is the central line of the backlight plate in the vertical direction; aligning the pictures to be spliced in the same vertical direction according to the alignment line; and splicing the aligned pictures to be spliced. The invention also discloses a refrigerator control method. By adopting the embodiment of the invention, the problem that the splicing effect is influenced because the relative positions of a plurality of pictures shot by a plurality of cameras are difficult to keep consistent can be solved.
Description
Technical Field
The invention relates to the technical field of refrigerators, in particular to a refrigerator and a control method thereof.
Background
Along with the improvement of people's standard of living, the application of intelligent refrigerator is more and more extensive, and a plurality of cameras of internally mounted of intelligent refrigerator for shoot to refrigerator inside, and upload to control end analysis processes, in order to realize the control and the analysis of the inside storage condition of refrigerator. In the in-service use process, when adopting many cameras to shoot, because of different cameras probably because the mounted position is different or the difference of camera parameter setting when shooing, when shooing refrigerator layer frame, many pictures of shooing are difficult to keep the unanimity of relative position, have finally influenced the concatenation effect, lead to the unable fine inside storage condition of reflection refrigerator of picture that the user received, user experience is not good.
Disclosure of Invention
The embodiment of the invention aims to provide a refrigerator and a control method thereof, which can solve the problem that the splicing effect is influenced because a plurality of pictures shot by a plurality of cameras are difficult to keep consistent relative positions.
To achieve the above object, an embodiment of the present invention provides a refrigerator, including:
a box body, wherein a plurality of storerooms are arranged inside the box body;
the door is arranged at the opening of the storage chamber, and one surface of the door facing the storage chamber is provided with at least two camera devices in the same vertical direction;
the controller is configured to:
responding to a shooting instruction, and controlling all the camera devices to shoot the storeroom;
acquiring a picture to be spliced shot by the camera device, and acquiring a frame of a backlight plate which is arranged in the picture to be spliced and is opposite to the box door;
acquiring an alignment line of each picture to be spliced according to the frame of the backlight plate; wherein the alignment line is a central line of the backlight plate in the vertical direction;
aligning the pictures to be spliced in the same vertical direction according to the alignment line;
and splicing the aligned pictures to be spliced.
As an improvement of the above scheme, the acquiring an alignment line of each of the pictures to be stitched according to the frame of the backlight plate includes:
acquiring a left frame and a right frame of the backlight plate;
calculating a first linear distance from the left frame to a left boundary of the picture to be spliced, and calculating a second linear distance from the right frame to the left boundary;
and adding the first straight line distance and the second straight line distance and dividing by 2 to obtain the position of the central line.
As an improvement of the above, after aligning the pictures to be stitched in the same vertical direction according to the alignment line, the controller is further configured to:
and obtaining the boundary of the picture to be spliced, which is shortest from the central line, as a cutting standard, and cutting the picture to be spliced.
As an improvement of the above scheme, the obtaining of the frame of the backlight plate arranged opposite to the box door in the picture to be spliced includes:
inputting the pictures to be spliced into a picture recognition model which is trained in advance; the picture identification model is used for identifying the frame of the backlight plate in the picture to be spliced;
and acquiring the frame of the backlight plate according to the recognition result of the picture recognition model.
As an improvement of the above scheme, the obtaining of the frame of the backlight plate arranged opposite to the box door in the picture to be spliced includes:
carrying out edge detection on the pictures to be spliced by utilizing an edge detection algorithm;
and acquiring the frame of the backlight plate based on the edge detection result.
In order to achieve the above object, an embodiment of the present invention further provides a refrigerator control method, including:
responding to a shooting instruction, and controlling all the camera devices to shoot the storeroom; the image pick-up devices comprise at least two image pick-up devices and are arranged in the refrigerator door of the refrigerator in the same vertical direction;
acquiring a picture to be spliced shot by the camera device, and acquiring a frame of a backlight plate which is arranged in the picture to be spliced and is opposite to the box door;
acquiring an alignment line of each picture to be spliced according to the frame of the backlight plate; wherein the alignment line is a central line of the backlight plate in the vertical direction;
aligning the pictures to be spliced in the same vertical direction according to the alignment line;
and splicing the aligned pictures to be spliced.
As an improvement of the above scheme, the acquiring an alignment line of each of the pictures to be stitched according to the frame of the backlight plate includes:
acquiring a left frame and a right frame of the backlight plate;
calculating a first linear distance from the left frame to a left boundary of the picture to be spliced, and calculating a second linear distance from the right frame to the left boundary;
and adding the first straight line distance and the second straight line distance and dividing by 2 to obtain the position of the central line.
As an improvement of the above scheme, after the pictures to be stitched are aligned in the same vertical direction according to the alignment line, the method further includes:
and obtaining the boundary of the picture to be spliced, which is shortest from the central line, as a cutting standard, and cutting the picture to be spliced.
As an improvement of the above scheme, the obtaining of the frame of the backlight plate arranged opposite to the box door in the picture to be spliced includes:
inputting the pictures to be spliced into a picture recognition model which is trained in advance; the picture identification model is used for identifying the frame of the backlight plate in the picture to be spliced;
and acquiring the frame of the backlight plate according to the recognition result of the picture recognition model.
As an improvement of the above scheme, the obtaining of the frame of the backlight plate arranged opposite to the box door in the picture to be spliced includes:
carrying out edge detection on the pictures to be spliced by utilizing an edge detection algorithm;
and acquiring the frame of the backlight plate based on the edge detection result.
Compared with the prior art, the refrigerator and the control method thereof disclosed by the embodiment of the invention have the advantages that the plurality of camera devices are arranged on the same vertical line, so that the plurality of camera devices are ensured to be positioned at the same shooting angle as much as possible, and the shot pictures are aligned as much as possible. In addition, after the pictures to be spliced, which are shot by the camera device, are obtained, the frame of the backlight plate which is arranged opposite to the box door in the pictures to be spliced is obtained, the alignment line of each picture to be spliced is obtained based on the frame of the backlight plate, the backlight plate in the refrigerator is of an inherent structure of the refrigerator, the center line of the backlight plate in the vertical direction is found to be the alignment line, all the pictures to be spliced are aligned and spliced in the same vertical direction according to the alignment line, and the problem that the splicing effect is influenced due to the fact that multiple pictures shot by the cameras are difficult to keep the same relative position can be solved.
Drawings
Fig. 1 is a flowchart of a controller in a refrigerator according to an embodiment of the present invention;
fig. 2 is a schematic mounting diagram of an image pickup apparatus provided in an embodiment of the present invention;
fig. 3 is a schematic diagram of pictures to be stitched, which are taken by a plurality of image pickup devices according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of aligned pictures to be stitched according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a clipped picture to be stitched according to an embodiment of the present invention;
fig. 6 is a flowchart of a refrigerator control method according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of a controller in a refrigerator according to an embodiment of the present invention, where the refrigerator includes:
a box body, wherein a plurality of storerooms are arranged inside the box body;
the door is arranged at the opening of the storage chamber, and one surface of the door facing the storage chamber is provided with at least two camera devices in the same vertical direction;
the controller is configured to:
s11, responding to the shooting instruction, controlling all the camera devices to shoot the storeroom;
s12, obtaining the picture to be spliced shot by the camera device, and obtaining a frame of a backlight plate which is arranged in the picture to be spliced and is opposite to the box door;
s13, acquiring an alignment line of each picture to be spliced according to the frame of the backlight plate; wherein the alignment line is a central line of the backlight plate in the vertical direction;
s14, aligning the pictures to be spliced in the same vertical direction according to the alignment lines;
and S15, splicing the aligned pictures to be spliced.
It should be noted that the number of the camera devices can be correspondingly installed according to the structure of the refrigerator, in the embodiment of the present invention, the storage chambers include a refrigerating chamber, a freezing chamber and a temperature changing chamber, and each storage chamber is correspondingly provided with a camera device. Further, in the embodiment of the present invention, all pictures taken by the camera devices in different storage rooms may be spliced together, for example, pictures of a refrigerating room and a freezing room are spliced together; or, only pictures of one storage room are spliced, at this time, at least two shelves are arranged in the storage room, and each shelf is correspondingly provided with one camera device, for example, two shelves are arranged in the refrigerating room, and at this time, pictures shot by the camera devices corresponding to the two shelves are spliced.
Referring to fig. 2, fig. 2 is an installation schematic diagram of a camera device provided in an embodiment of the present invention, taking a refrigerating chamber in a refrigerator as an example, where there are 3 shelves in the refrigerating chamber, and there are 3 camera devices correspondingly installed on a door of the refrigerator, it can be understood that the camera device can be embedded in the door of the refrigerator, and does not occupy the space of the refrigerator, and can also protect the camera device, so as to prevent a user from scratching a lens of the camera device during a process of storing and taking articles; or the camera shooting device is detachably arranged on the box door, a user can replace the camera shooting device, and the user can independently select whether to install the camera shooting device. The backlight plate is an inner wall which is arranged in the refrigerator storage chamber and corresponds to the refrigerator door, the whole back surface can be covered, and the frame of the backlight plate is a boundary line between the backlight plate and two adjacent side walls of the backlight plate.
Specifically, the trigger conditions of the shooting instruction are as follows: detecting that the box door is closed; or the shooting instruction is triggered by the user at the client, and the user can trigger the camera device to shoot at a remote place. The controller controls all the camera devices to shoot the storerooms after responding to the shooting instruction, so that a plurality of pictures to be spliced are obtained, at the moment, the schematic diagram of the pictures to be spliced can refer to fig. 3, 3 pictures to be spliced exist in fig. 3 and respectively come from 3 camera devices, at the moment, if the 3 pictures are directly spliced according to the sizes of the pictures, articles in the spliced pictures can be deformed, and the user experience in vision is poor.
In an embodiment, the obtaining a frame of a backlight plate disposed opposite to the box door in the to-be-spliced picture includes: the controller inputs the pictures to be spliced into a picture recognition model which is trained in advance; the picture identification model is used for identifying the frame of the backlight plate in the picture to be spliced; and acquiring the frame of the backlight plate according to the recognition result of the picture recognition model. For example, the picture recognition model may be a CNN (Convolutional neural network) model. The CNN is a feedforward neural network, comprises a convolutional layer and a pooling layer, and has wide application in the field of image recognition. Theoretically, as long as there are enough training samples, the CNN model with the corresponding recognition function can be obtained, the training samples refer to the original data marked with the recognition result, and in the picture recognition scene, the training samples are the images marked with the frame of the backlight panel of the refrigerator. In the process of training the picture recognition model, in order to improve the recognition accuracy and the convergence rate of the model, the training sample may be preprocessed before being input to the picture recognition model to be trained, specifically, the training sample is subjected to preliminary feature extraction, so as to improve the convergence rate of the model by reducing the calculation amount.
In another embodiment, the obtaining a frame of a backlight plate arranged opposite to the box door in the to-be-spliced picture includes: carrying out edge detection on the pictures to be spliced by utilizing an edge detection algorithm; and acquiring the frame of the backlight plate based on the edge detection result. For example, the purpose of the edge detection algorithm is to identify points (typically, edges of a graph) in a digital image where brightness changes are obvious, in an embodiment of the present invention, a canny operator may be used to perform edge detection on the picture to be stitched, so as to identify a frame of a backlight panel in the picture to be stitched.
Specifically, after recognizing the frame of the backlight panel, the method obtains the alignment line of each of the to-be-spliced pictures according to the frame of the backlight panel, and includes:
acquiring a left frame and a right frame of the backlight plate;
calculating a first linear distance from the left frame to a left boundary of the picture to be spliced, and calculating a second linear distance from the right frame to the left boundary;
and adding the first straight line distance and the second straight line distance and dividing by 2 to obtain the position of the central line.
For example, as shown in fig. 3, a first picture to be stitched is taken as an example (the way of calculating the center line of the remaining pictures to be stitched is the same as that of the first picture to be stitched, and is not described again): a represents the left frame of the backlight plate, b represents the right frame of the backlight plate, and A represents the left boundary of the picture to be spliced. Calculating a first straight-line distance La from the left frame a to a left boundary A of the picture to be spliced, and calculating a second straight-line distance Lb from the right frame b to the left boundary A, wherein if La is 293pix and Lb is 733pix, the central position is: LB (La + LB)/2 (513 pix), where B is the center line.
Specifically, after the alignment line is obtained, the controller aligns and splices the pictures to be spliced based on the alignment line, and at this time, the spliced pictures are as shown in fig. 4. As can be seen from fig. 4, the spliced picture has a situation that the boundaries cannot be aligned, and at this time, the picture to be spliced may be cut.
Specifically, after aligning the pictures to be stitched in the same vertical direction according to the alignment line, the controller is further configured to:
and obtaining the boundary of the picture to be spliced, which is shortest from the central line, as a cutting standard, and cutting the picture to be spliced.
For example, in fig. 4, the boundary C and the boundary D are the boundaries whose left and right sides are the shortest from the center line, and the picture to be spliced is cropped according to the boundary C and the boundary D, and the cropped picture to be spliced can refer to fig. 5.
Further, in the embodiment of the present invention, after the controller processes the picture to be stitched, the picture to be stitched is stored locally, so as to be conveniently sent to the user subsequently.
Compared with the prior art, the refrigerator disclosed by the embodiment of the invention has the advantages that the plurality of camera devices are arranged on the same vertical line, so that the plurality of camera devices are ensured to be positioned at the same shooting angle as much as possible, and the shot pictures are aligned as much as possible. In addition, after the pictures to be spliced, which are shot by the camera device, are obtained, the frame of the backlight plate which is arranged opposite to the box door in the pictures to be spliced is obtained, the alignment line of each picture to be spliced is obtained based on the frame of the backlight plate, the backlight plate in the refrigerator is of an inherent structure of the refrigerator, the center line of the backlight plate in the vertical direction is found to be the alignment line, all the pictures to be spliced are aligned and spliced in the same vertical direction according to the alignment line, and the problem that the splicing effect is influenced due to the fact that multiple pictures shot by the cameras are difficult to keep the same relative position can be solved.
Referring to fig. 6, fig. 6 is a flowchart of a refrigerator control method according to an embodiment of the present invention, where the refrigerator control method includes:
s21, responding to the shooting instruction, controlling all the camera devices to shoot the storeroom; the image pick-up devices comprise at least two image pick-up devices and are arranged in the refrigerator door of the refrigerator in the same vertical direction;
s22, obtaining the picture to be spliced shot by the camera device, and obtaining a frame of a backlight plate which is arranged in the picture to be spliced and is opposite to the box door;
s23, acquiring an alignment line of each picture to be spliced according to the frame of the backlight plate; wherein the alignment line is a central line of the backlight plate in the vertical direction;
s24, aligning the pictures to be spliced in the same vertical direction according to the alignment lines;
and S25, splicing the aligned pictures to be spliced.
It should be noted that the refrigerator control method according to the embodiment of the present invention is implemented by a controller in the refrigerator. The number of the camera devices can be correspondingly installed according to the structure of the refrigerator, in the embodiment of the invention, the storage chambers comprise a refrigerating chamber, a freezing chamber and a temperature changing chamber, and each storage chamber is correspondingly provided with the camera device. Further, in the embodiment of the present invention, all pictures taken by the camera devices in different storage rooms may be spliced together, for example, pictures of a refrigerating room and a freezing room are spliced together; or, only pictures of one storage room are spliced, at this time, at least two shelves are arranged in the storage room, and each shelf is correspondingly provided with one camera device, for example, two shelves are arranged in the refrigerating room, and at this time, pictures shot by the camera devices corresponding to the two shelves are spliced.
The camera shooting device can be embedded in the refrigerator door, so that the space of the refrigerator is not occupied, the camera shooting device can be protected, and a user is prevented from scratching a lens of the camera shooting device in the process of storing and taking articles; or the camera shooting device is detachably arranged on the box door, a user can replace the camera shooting device, and the user can independently select whether to install the camera shooting device. The backlight plate is an inner wall which is arranged in the refrigerator storage chamber and corresponds to the refrigerator door, the whole back surface can be covered, and the frame of the backlight plate is a boundary line between the backlight plate and two adjacent side walls of the backlight plate.
Specifically, in step S21, the trigger condition of the shooting instruction is: detecting that the box door is closed; or the shooting instruction is triggered by the user at the client, and the user can trigger the camera device to shoot at a remote place.
Specifically, in step S22, the controller controls all the image capturing devices to capture images of the storage room after responding to the capturing instruction, so as to obtain a plurality of pictures to be spliced.
In one embodiment, the step S22 includes:
s221, the controller inputs the picture to be spliced into a picture recognition model which is trained in advance; the picture identification model is used for identifying the frame of the backlight plate in the picture to be spliced;
s222, obtaining the frame of the backlight plate according to the recognition result of the picture recognition model.
For example, the picture recognition model may be a CNN (Convolutional neural network) model. The CNN is a feedforward neural network, comprises a convolutional layer and a pooling layer, and has wide application in the field of image recognition. Theoretically, as long as there are enough training samples, the CNN model with the corresponding recognition function can be obtained, the training samples refer to the original data marked with the recognition result, and in the picture recognition scene, the training samples are the images marked with the frame of the backlight panel of the refrigerator. In the process of training the picture recognition model, in order to improve the recognition accuracy and the convergence rate of the model, the training sample may be preprocessed before being input to the picture recognition model to be trained, specifically, the training sample is subjected to preliminary feature extraction, so as to improve the convergence rate of the model by reducing the calculation amount.
In another embodiment, the step S22 includes:
s223, carrying out edge detection on the picture to be spliced by utilizing an edge detection algorithm;
s224, acquiring the frame of the backlight plate based on the edge detection result.
For example, the purpose of the edge detection algorithm is to identify points (typically, edges of a graph) in a digital image where brightness changes are obvious, in an embodiment of the present invention, a canny operator may be used to perform edge detection on the picture to be stitched, so as to identify a frame of a backlight panel in the picture to be stitched.
Specifically, in step S23, after the frame of the backlight panel is identified, the alignment line of each of the pictures to be stitched is obtained according to the frame of the backlight panel, which includes steps S231 to S233:
s231, obtaining a left frame and a right frame of the backlight plate;
s232, calculating a first straight-line distance from the left frame to a left boundary of the picture to be spliced, and calculating a second straight-line distance from the right frame to the left boundary;
and S233, adding the first straight line distance and the second straight line distance and dividing by 2 to obtain the position of the central line.
For example, as shown in fig. 3, a first picture to be stitched is taken as an example (the way of calculating the center line of the remaining pictures to be stitched is the same as that of the first picture to be stitched, and is not described again): a represents the left frame of the backlight plate, b represents the right frame of the backlight plate, and A represents the left boundary of the picture to be spliced. Calculating a first straight-line distance La from the left frame a to a left boundary A of the picture to be spliced, and calculating a second straight-line distance Lb from the right frame b to the left boundary A, wherein if La is 293pix and Lb is 733pix, the central position is: LB (La + LB)/2 (513 pix), where B is the center line.
Specifically, in steps S24 to S25, after the alignment line is acquired, the pictures to be stitched are aligned and stitched based on the alignment line.
Further, after the pictures to be spliced are aligned in the same vertical direction according to the alignment line, the method further includes:
and S26, obtaining the boundary of the picture to be spliced, which is the shortest distance from the center line, as a cutting standard, and cutting the picture to be spliced.
For example, in fig. 4, the boundary C and the boundary D are the boundaries whose left and right sides are the shortest from the center line, and the picture to be spliced is cropped according to the boundary C and the boundary D, and the cropped picture to be spliced can refer to fig. 5.
Further, in the embodiment of the present invention, after the controller processes the picture to be stitched, the picture to be stitched is stored locally, so as to be conveniently sent to the user subsequently.
Compared with the prior art, the refrigerator control method disclosed by the embodiment of the invention has the advantages that the plurality of camera devices are arranged on the same vertical line, so that the plurality of camera devices are ensured to be positioned at the same shooting angle as much as possible, and the shot pictures are aligned as much as possible. In addition, after the pictures to be spliced, which are shot by the camera device, are obtained, the frame of the backlight plate which is arranged opposite to the box door in the pictures to be spliced is obtained, the alignment line of each picture to be spliced is obtained based on the frame of the backlight plate, the backlight plate in the refrigerator is of an inherent structure of the refrigerator, the center line of the backlight plate in the vertical direction is found to be the alignment line, all the pictures to be spliced are aligned and spliced in the same vertical direction according to the alignment line, and the problem that the splicing effect is influenced due to the fact that multiple pictures shot by the cameras are difficult to keep the same relative position can be solved.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (10)
1. A refrigerator, characterized by comprising:
a box body, wherein a plurality of storerooms are arranged inside the box body;
the door is arranged at the opening of the storage chamber, and one surface of the door facing the storage chamber is provided with at least two camera devices in the same vertical direction;
the controller is configured to:
responding to a shooting instruction, and controlling all the camera devices to shoot the storeroom;
acquiring a picture to be spliced shot by the camera device, and acquiring a frame of a backlight plate which is arranged in the picture to be spliced and is opposite to the box door;
acquiring an alignment line of each picture to be spliced according to the frame of the backlight plate; wherein the alignment line is a central line of the backlight plate in the vertical direction;
aligning the pictures to be spliced in the same vertical direction according to the alignment line;
and splicing the aligned pictures to be spliced.
2. The refrigerator as claimed in claim 1, wherein the obtaining of the alignment line of each of the pictures to be stitched according to the frame of the backlight panel comprises:
acquiring a left frame and a right frame of the backlight plate;
calculating a first linear distance from the left frame to a left boundary of the picture to be spliced, and calculating a second linear distance from the right frame to the left boundary;
and adding the first straight line distance and the second straight line distance and dividing by 2 to obtain the position of the central line.
3. The refrigerator of claim 1, wherein after the pictures to be stitched are aligned in the same vertical direction according to the alignment line, the controller is further configured to:
and obtaining the boundary of the picture to be spliced, which is shortest from the central line, as a cutting standard, and cutting the picture to be spliced.
4. The refrigerator according to claim 1, wherein the obtaining of the frame of the backlight plate disposed opposite to the door of the refrigerator in the picture to be stitched comprises:
inputting the pictures to be spliced into a picture recognition model which is trained in advance; the picture identification model is used for identifying the frame of the backlight plate in the picture to be spliced;
and acquiring the frame of the backlight plate according to the recognition result of the picture recognition model.
5. The refrigerator according to claim 1, wherein the obtaining of the frame of the backlight plate disposed opposite to the door of the refrigerator in the picture to be stitched comprises:
carrying out edge detection on the pictures to be spliced by utilizing an edge detection algorithm;
and acquiring the frame of the backlight plate based on the edge detection result.
6. A refrigerator control method, comprising:
responding to a shooting instruction, and controlling all the camera devices to shoot the storeroom; the image pick-up devices comprise at least two image pick-up devices and are arranged in the refrigerator door of the refrigerator in the same vertical direction;
acquiring a picture to be spliced shot by the camera device, and acquiring a frame of a backlight plate which is arranged in the picture to be spliced and is opposite to the box door;
acquiring an alignment line of each picture to be spliced according to the frame of the backlight plate; wherein the alignment line is a central line of the backlight plate in the vertical direction;
aligning the pictures to be spliced in the same vertical direction according to the alignment line;
and splicing the aligned pictures to be spliced.
7. The method as claimed in claim 6, wherein the obtaining the alignment line of each of the pictures to be stitched according to the frame of the backlight panel comprises:
acquiring a left frame and a right frame of the backlight plate;
calculating a first linear distance from the left frame to a left boundary of the picture to be spliced, and calculating a second linear distance from the right frame to the left boundary;
and adding the first straight line distance and the second straight line distance and dividing by 2 to obtain the position of the central line.
8. The refrigerator control method according to claim 6, wherein after the pictures to be spliced are aligned in the same vertical direction according to the alignment line, the method further comprises:
and obtaining the boundary of the picture to be spliced, which is shortest from the central line, as a cutting standard, and cutting the picture to be spliced.
9. The method as claimed in claim 6, wherein the step of obtaining the frame of the backlight plate arranged opposite to the box door in the picture to be spliced comprises:
inputting the pictures to be spliced into a picture recognition model which is trained in advance; the picture identification model is used for identifying the frame of the backlight plate in the picture to be spliced;
and acquiring the frame of the backlight plate according to the recognition result of the picture recognition model.
10. The method as claimed in claim 6, wherein the step of obtaining the frame of the backlight plate arranged opposite to the box door in the picture to be spliced comprises:
carrying out edge detection on the pictures to be spliced by utilizing an edge detection algorithm;
and acquiring the frame of the backlight plate based on the edge detection result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110244812.0A CN113915871A (en) | 2021-03-05 | 2021-03-05 | Refrigerator and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110244812.0A CN113915871A (en) | 2021-03-05 | 2021-03-05 | Refrigerator and control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113915871A true CN113915871A (en) | 2022-01-11 |
Family
ID=79232649
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110244812.0A Pending CN113915871A (en) | 2021-03-05 | 2021-03-05 | Refrigerator and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113915871A (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102032740A (en) * | 2009-09-29 | 2011-04-27 | 北京爱国者存储科技有限责任公司 | Refrigerator |
| CN104019615A (en) * | 2014-05-16 | 2014-09-03 | 上海尖顶信息技术有限公司 | Method for checking food materials in refrigerator |
| US20140300265A1 (en) * | 2013-04-08 | 2014-10-09 | Jihyun Lee | Refrigerator |
| JP2014196842A (en) * | 2013-03-29 | 2014-10-16 | パナソニック株式会社 | Refrigerator and refrigerator system |
| CN104508679A (en) * | 2012-06-12 | 2015-04-08 | 实耐宝公司 | Tool training for automated tool control systems |
| CN105091501A (en) * | 2015-09-10 | 2015-11-25 | 武克易 | Visible refrigerator |
| JP2016023892A (en) * | 2014-07-23 | 2016-02-08 | 株式会社東芝 | refrigerator |
| WO2016162956A1 (en) * | 2015-04-07 | 2016-10-13 | 三菱電機株式会社 | Refrigerator |
| CN106123481A (en) * | 2016-08-10 | 2016-11-16 | 广东格兰仕集团有限公司 | Refrigerator food camera system and management image processing method thereof |
| JP2017142059A (en) * | 2017-04-18 | 2017-08-17 | パナソニックＩｐマネジメント株式会社 | refrigerator |
| CN110738599A (en) * | 2019-10-14 | 2020-01-31 | 北京百度网讯科技有限公司 | Image splicing method and device, electronic equipment and storage medium |
| CN111288744A (en) * | 2020-02-27 | 2020-06-16 | 海信（山东）冰箱有限公司 | Refrigerator and control method thereof |
| CN112215770A (en) * | 2020-10-10 | 2021-01-12 | 成都数之联科技有限公司 | Image processing method, system, device and medium |
-
2021
- 2021-03-05 CN CN202110244812.0A patent/CN113915871A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102032740A (en) * | 2009-09-29 | 2011-04-27 | 北京爱国者存储科技有限责任公司 | Refrigerator |
| CN104508679A (en) * | 2012-06-12 | 2015-04-08 | 实耐宝公司 | Tool training for automated tool control systems |
| JP2014196842A (en) * | 2013-03-29 | 2014-10-16 | パナソニック株式会社 | Refrigerator and refrigerator system |
| US20140300265A1 (en) * | 2013-04-08 | 2014-10-09 | Jihyun Lee | Refrigerator |
| CN104019615A (en) * | 2014-05-16 | 2014-09-03 | 上海尖顶信息技术有限公司 | Method for checking food materials in refrigerator |
| JP2016023892A (en) * | 2014-07-23 | 2016-02-08 | 株式会社東芝 | refrigerator |
| WO2016162956A1 (en) * | 2015-04-07 | 2016-10-13 | 三菱電機株式会社 | Refrigerator |
| CN105091501A (en) * | 2015-09-10 | 2015-11-25 | 武克易 | Visible refrigerator |
| CN106123481A (en) * | 2016-08-10 | 2016-11-16 | 广东格兰仕集团有限公司 | Refrigerator food camera system and management image processing method thereof |
| JP2017142059A (en) * | 2017-04-18 | 2017-08-17 | パナソニックＩｐマネジメント株式会社 | refrigerator |
| CN110738599A (en) * | 2019-10-14 | 2020-01-31 | 北京百度网讯科技有限公司 | Image splicing method and device, electronic equipment and storage medium |
| CN111288744A (en) * | 2020-02-27 | 2020-06-16 | 海信（山东）冰箱有限公司 | Refrigerator and control method thereof |
| CN112215770A (en) * | 2020-10-10 | 2021-01-12 | 成都数之联科技有限公司 | Image processing method, system, device and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7113616B2 (en) | Object tracking method and apparatus using template matching | |
| US10511759B2 (en) | Image capturing terminal and image capturing method | |
| CN104019615B (en) | A kind of check the method for food materials in refrigerator | |
| JP4699040B2 (en) | Automatic tracking control device, automatic tracking control method, program, and automatic tracking system | |
| CN110800282B (en) | Holder adjusting method, holder adjusting device, mobile platform and medium | |
| US20170223256A1 (en) | Image capturing terminal and image capturing method | |
| US20140232818A1 (en) | Method and device for spherical resampling for video generation | |
| CN101640788B (en) | Method and device for controlling monitoring and monitoring system | |
| EP2757771B1 (en) | Image pickup apparatus, remote control apparatus, and methods of controlling image pickup apparatus and remote control apparatus | |
| US20200275018A1 (en) | Image capture method and device | |
| KR101749900B1 (en) | Apparatus for image brighteness controlling, and control method thereof | |
| CN101246541A (en) | Image-processing device and image-processing method, image-pickup device, and computer program | |
| KR101658212B1 (en) | Method of selecting an optimal viewing angle position for a camera | |
| CN102970571A (en) | Stereoscopic image display apparatus | |
| CN105783413A (en) | Method of obtaining information of articles stored in refrigerator and refrigerator | |
| CN103890813A (en) | Gain value of image capture component | |
| US10909388B2 (en) | Population density determination from multi-camera sourced imagery | |
| CN105611373A (en) | Video picture processing method and device | |
| CN110769148A (en) | Camera automatic control method and device based on face recognition | |
| CN111339811A (en) | Image processing method, device, equipment and storage medium | |
| EP3432575A1 (en) | Method for performing multi-camera automatic patrol control with aid of statistics data in a surveillance system, and associated apparatus | |
| CN111832345B (en) | Container monitoring method, device and equipment and storage medium | |
| CN109543530B (en) | Blackboard writing position detection method, storage medium and system | |
| KR101396838B1 (en) | Video stabilization method and system by selection one of various motion models | |
| CN113915871A (en) | Refrigerator and control method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220111 |
|
| RJ01 | Rejection of invention patent application after publication |