CN112019743A - Object information prompting method and device, storage medium and electronic device - Google Patents
Object information prompting method and device, storage medium and electronic device Download PDFInfo
- Publication number
- CN112019743A CN112019743A CN202010872741.4A CN202010872741A CN112019743A CN 112019743 A CN112019743 A CN 112019743A CN 202010872741 A CN202010872741 A CN 202010872741A CN 112019743 A CN112019743 A CN 112019743A
- Authority
- CN
- China
- Prior art keywords
- target
- angle
- image information
- information
- placement area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
The invention provides a method and a device for prompting object information, a storage medium and an electronic device, wherein the method comprises the following steps: under the condition that the target equipment is determined to be at a preset angle, image information of a target placement area is obtained through the image pickup equipment, wherein object information of a target object placed in the target placement area is displayed in the image information, and the image pickup equipment is arranged in the target equipment; displaying the image information; and outputting prompt information under the condition that the number of the target objects is smaller than a preset value, wherein the prompt information is used for prompting that the target objects are in a missing state. According to the invention, the problem of inaccurate monitoring of the information of the food materials in the refrigerator in the related art is solved, and the effect of accurately monitoring the food materials in the refrigerator is achieved.
Description
Technical Field
The invention relates to the field of equipment, in particular to a method and a device for prompting object information, a storage medium and an electronic device.
Background
The user who uses the single-door refrigerator wants to go to supermarket or farmer's market and purchase the edible material when leaving work or leaving home, but suffers from the edible material condition that can not look over in the refrigerator, often appears missing the circumstances of purchasing or excessive purchasing, causes the user can't eat the edible material of wanting to eat like this or causes the waste. In addition, users who pay attention to nutrition matching or users who prefer special food materials pay attention to timely supplement of certain food materials (such as milk, eggs, beer and beverages), but due to busy work and the like, the users often forget to supplement the food materials.
The scheme is looked over to present existing refrigerator long-range, and the cost that uses three routes camera to shoot is higher, and because it installs in the refrigerator box, the object distance is nearer (the camera lens is nearer with the distance of eating the material), and the camera lens is sheltered from completely by the edible material of near, can't shoot other edible materials, and this also greatly increased eats the material and discerns the degree of difficulty.
In conclusion, the prior art has the problem that the information monitoring on the food materials in the refrigerator is inaccurate.
In view of the above technical problems, no effective solution has been proposed in the related art.
Disclosure of Invention
The embodiment of the invention provides a method and a device for prompting object information, a storage medium and an electronic device, and at least solves the problem that monitoring of information of food materials in a refrigerator is inaccurate in related technologies.
According to an embodiment of the present invention, a method for prompting object information is provided, including: under the condition that it is determined that target equipment is at a preset angle, image information of a target placement area is obtained through image pickup equipment, wherein object information of a target object placed in the target placement area is displayed in the image information, and the image pickup equipment is arranged in the target equipment; displaying the image information; and outputting prompt information under the condition that the number of the target objects is smaller than a preset value, wherein the prompt information is used for prompting that the target objects are in a missing state.
According to another embodiment of the present invention, there is provided an object information presentation apparatus including: the device comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring image information of a target placement area through a camera device under the condition that the target device is determined to be at a preset angle, the image information displays object information of a target object placed in the target placement area, and the camera device is arranged in the target device; the display module is used for displaying the image information; and the output module is used for outputting prompt information under the condition that the number of the target objects is smaller than a preset value, wherein the prompt information is used for prompting that the target objects are in a missing state.
Optionally, the first obtaining module includes: the device comprises a first determining unit, a second determining unit and a control unit, wherein the first determining unit is used for determining the opening angle or the closing angle of the target device through an angle sensor, and the angle sensor is arranged in the target device; a first acquisition unit configured to acquire the image information of the target placement area by the image pickup apparatus, in a case where it is determined that an opening angle or a closing angle of the target apparatus is at a predetermined angle.
Optionally, the apparatus further comprises: the device comprises a first triggering module and a second triggering module, wherein the first triggering module is used for triggering an angle sensor to detect the opening angle or the closing angle of a target device under the condition that the target device is determined to be in the opening state or the closing state through a preset interface before the opening angle or the closing angle of the target device is determined through the angle sensor.
Optionally, the first obtaining module includes: the first adjusting unit is used for adjusting a camera of the camera device to a preset position by controlling a program-controlled telescopic piece and a program-controlled rotating piece in the camera device under the condition that the target device is determined to be at a preset angle, so as to acquire the image information of the target placement area, wherein the preset position corresponds to the target placement area.
Optionally, the apparatus further comprises: and the first determining module is used for determining the corresponding relation between the target placement area and the target object through a client before the image pickup device acquires the image information of the target placement area under the condition that the target device is determined to be at the preset angle.
Optionally, the apparatus further comprises: and the first setting module is used for setting the corresponding relation in the image information after the image information of the target placement area is acquired through the image pickup equipment under the condition that the target equipment is determined to be at the preset angle, so that the corresponding relation is displayed on a client.
Optionally, the display module includes: and the first display unit is used for displaying the image information on the client.
Optionally, the outputting the prompt information includes at least one of: playing a target audio on a client, wherein the prompt message includes the target audio; displaying target characters on a client, wherein the prompt message comprises the target characters; and displaying a target image on the client, wherein the prompt message comprises the target image.
According to a further embodiment of the present invention, there is also provided a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
According to yet another embodiment of the present invention, there is also provided an electronic device, including a memory and a processor, the memory having a computer program stored therein, the processor being configured to perform the steps of any of the above method embodiments by the computer program.
According to the invention, under the condition that the target equipment is determined to be at the preset angle, the image information of the target placement area is obtained through the camera equipment, wherein the image information displays the object information of the target object placed in the target placement area, and the camera equipment is arranged in the target equipment; displaying the image information; and outputting prompt information under the condition that the number of the target objects is smaller than a preset value, wherein the prompt information is used for prompting that the target objects are in a missing state. The angle of shooting of the shooting equipment can be adjusted based on the angle of the target equipment, so that the object information of the target object in the target placement area can be clearly acquired. Therefore, the problem that the information of the food in the refrigerator is monitored inaccurately in the related art can be solved, and the effect of accurately acquiring the information of the food in the refrigerator is achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware structure of a mobile terminal of a method for prompting object information according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method for prompting for object information according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of interaction between a refrigerator and other devices according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of zoning a refrigerator according to an embodiment of the present invention;
fig. 5 is a schematic configuration diagram of an image pickup apparatus according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a hardware configuration of an image pickup apparatus according to an embodiment of the present invention;
fig. 7 is a block diagram of a structure of an object information presentation apparatus according to an embodiment of the present invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
The method provided by the first embodiment of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking the example of the application in a mobile terminal, fig. 1 is a block diagram of a hardware structure of the mobile terminal of a method for prompting object information according to an embodiment of the present invention. As shown in fig. 1, the mobile terminal 10 may include one or more (only one shown) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmitting device 106 for communication functions. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the electronic device. For example, the mobile terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used to store computer programs, for example, software programs and modules of application software, such as a computer program corresponding to the object information prompting method in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, so as to implement the above-mentioned method. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the mobile terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal 10. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In this embodiment, a method for prompting object information is provided, and fig. 2 is a flowchart of a method for prompting object information according to an embodiment of the present invention, as shown in fig. 2, the flowchart includes the following steps:
step S202, under the condition that the target equipment is determined to be at the preset angle, image information of the target placement area is obtained through the image pickup equipment, wherein object information of a target object placed in the target placement area is displayed in the image information, and the image pickup equipment is arranged in the target equipment;
step S204, displaying image information;
and step S206, outputting prompt information under the condition that the number of the target objects is less than a preset value, wherein the prompt information is used for prompting that the target objects are in a missing state.
Optionally, the present embodiment includes, but is not limited to, being applied to a scenario of monitoring food materials in a refrigerator. For example, the target apparatus is a refrigerator (single-door refrigerator); the camera equipment is a camera arranged at the refrigerator door; the target placement area is an area of the square food material in the refrigerator; the target object may be a food material placed in the target placement area. The predetermined angle includes an angle of opening or closing the refrigerator door,
alternatively, in this embodiment, in the case of being applied to a scene of monitoring food materials in a refrigerator, the interaction between the image capturing device and the refrigerator and other devices is as shown in fig. 3, the image capturing device is disposed at a refrigerator door, and the refrigerator and the image capturing device are connected through a UART interface. The refrigerator supplies power to a Wireless local area network (WIFI) module 5V, and the Camera equipment (Camera) gets power from the WIFI module through a Universal Serial Bus (USB) interface; camera obtains the door opening and closing signal of the refrigerator through the UART interface, the door opening and closing signal is used for calibrating the angle sensor and adjusting the position angle to shoot areas a, b and c in the graph 4 after judging that the refrigerator is closed. Camera sends the food material pictures and the food material quantity identification results to a WIFI module through a USB interface, the WIFI module sends the food material pictures and the food material quantity results to a cloud server, a user can remotely check the food material pictures at a client, and the client can remind the user of the food material quantity through short messages and remind the user of timely replenishment.
Alternatively, as shown in fig. 4, the image pickup device is installed right below the edge of the first-layer bottle seat of the refrigerator door body, and the included angle between the image pickup device and the refrigerator needs to be adjusted according to the size of the refrigerator (related to the width of the refrigerator). After the refrigerator is closed, the camera shooting equipment is adjusted to a proper angle for shooting by virtue of the program-controlled rotating piece when shooting a zone and a zone b zone, and the camera is adjusted to a proper position angle for shooting by virtue of the program-controlled rotating piece and the program-controlled telescopic piece when shooting a zone c zone. For compatible different refrigerator materials, the WIFI module is not integrated in the camera (if the refrigerator door body is made of metal, the WIFI signal is shielded after the door is closed), but is independently installed in a hinge box at the top of the refrigerator.
Alternatively, the image pickup apparatus is configured as shown in fig. 5, and includes: the camera comprises a front shell of the camera, a program-controlled rotating piece and a program-controlled telescopic piece. Openings are formed in the front shell of the camera for a speaker spreader, a Media Interface Connector (MIC) (MIC1 and MIC2) and a lens. The voice function can be integrated, and the cost of opening the refrigerator door body is saved.
Alternatively, the hardware configuration of the image pickup apparatus is as shown in fig. 6, and the image pickup apparatus includes:
a controller unit: the main chip of the camera selects dual-core ARM Cortex-A53 with dominant frequency of 1.4GHz, and video coding and decoding and audio coding and decoding are integrated inside the camera. Thus, the resources of the main chip can support both the voice function and the image function. In addition, the NNIE (deep learning acceleration processing unit) is integrated in the main chip, the calculation power can reach 2TOPS, and therefore the operation of an off-line identification model can be supported. In this embodiment, the main chip needs to be implanted with a food material quantity recognition algorithm and an angle calculation algorithm.
A sensor unit: including angle sensors and Complementary Metal-Oxide-Semiconductor (CMOS) photosensors. The angle sensor is used for detecting the door closing angle of the refrigerator, and angle calculation is executed in the controller unit; the CMOS photosensitive sensor is used for photosensitive imaging of the camera, and in order to improve image quality, the CMOS sensor with 200 ten thousand pixels is selected.
An audio receiving unit: the system mainly comprises an audio analog signal receiving circuit with double MICs, and after audio signals enter a controller unit and are demodulated, the audio signals are sent to a cloud server through a WIFI module to be subjected to semantic analysis.
An audio transmission unit: mainly comprises an audio amplifier and a loudspeaker, wherein the loudspeaker with the power of 5W and the audio amplifier with the power of 8W are selected.
A motor unit: the camera comprises two groups of motor power units which are respectively used for driving a program-controlled rotating part and a program-controlled telescopic part so as to realize the position angle adjustment of the camera.
A heating wire unit: install on the shells inner wall around the camera lens for prevent that the condensation from appearing in the camera lens surface when the refrigerator switch door.
External interface: the USB interface is used for supplying power and transmitting food material pictures and food material quantity identification results; a UART interface: used for receiving the door opening and closing signal of the refrigerator.
In an optional embodiment, in a case that it is determined that the target device is at the predetermined angle, acquiring, by the imaging device, image information of the target placement area includes:
s1, determining the opening angle or the closing angle of the target equipment through an angle sensor, wherein the angle sensor is arranged in the target equipment;
s2, in a case where it is determined that the opening angle or the closing angle of the object device is at a predetermined angle, acquiring image information of the object placement area by the image pickup device.
Alternatively, in the present embodiment, the angle sensor may be provided in the image pickup apparatus. For example, an angle sensor is used to detect the angle at which the refrigerator is closed, and the angle calculation is performed in the controller unit.
In an alternative embodiment, before determining the opening angle or the closing angle of the target device through the angle sensor, the method includes:
and S1, under the condition that the target device is determined to be in the opening state or the closing state through the preset interface, triggering the angle sensor to detect the opening angle or the closing angle of the target device.
Optionally, in this embodiment, the preset interface includes, but is not limited to, a UART interface. For example, the UART interface acquires a door opening and closing signal of the refrigerator to determine whether the refrigerator is in an open state or a closed state, thereby triggering the angle sensor to detect an opening angle or a closing angle of the refrigerator.
In the embodiment, the opening or closing angle of the refrigerator is detected by processing the angle sensor through the preset interface, and shooting is not required to be performed when the refrigerator is opened or closed every time, so that resources are saved.
In an optional embodiment, in a case that it is determined that the target device is at the predetermined angle, acquiring, by the imaging device, image information of the target placement area includes:
and S1, under the condition that the target equipment is determined to be at the preset angle, adjusting the camera of the camera equipment to a preset position by controlling the program-controlled telescopic piece and the program-controlled rotating piece in the camera equipment to acquire the image information of the target placement area, wherein the preset position corresponds to the target placement area.
Alternatively, in this embodiment, for example, when the angle sensor detects that the door closing angle of the refrigerator is 45 degrees, the programmable expansion piece and the programmable rotation piece in the image pickup device are triggered to adjust the camera of the image pickup device to a position aligned with the egg area in the refrigerator. So that images in the region of the eggs can be taken.
According to the embodiment, the camera of the camera shooting device is adjusted to the preset position for shooting through the program control telescopic piece and the program control rotating piece in the camera shooting device, so that images in different areas can be acquired by arranging a single camera in the refrigerator, camera shooting resources are saved, and the image acquisition efficiency is improved.
In an optional embodiment, before the image information of the target placement area is acquired by the imaging device when it is determined that the target device is at the predetermined angle, the method further includes:
and S1, determining the corresponding relation between the target placement area and the target object through the client.
Optionally, in this embodiment, for example, the placement objects corresponding to the respective areas in the refrigerator are set through the mobile phone APP. As shown in fig. 4, the refrigerator has a region a corresponding to milk, a region b corresponding to beer, a region c corresponding to eggs, a region d corresponding to vegetables, a region e corresponding to fruits, and a region f corresponding to fresh food.
By determining the corresponding relation between the target placement area and the target object on the client, the camera device prints the name of the corresponding area in the image information after acquiring the image information. The image information and the corresponding name printed on the image information are displayed on the client, so that the user can clearly determine whether the target object placed in the position area is missing.
In an optional embodiment, after the image information of the target placement area is acquired by the image capturing device when it is determined that the target device is at the predetermined angle, the method further includes:
s1, the correspondence is set in the image information to display the correspondence on the client.
Alternatively, in the present embodiment, the correspondence may be set in the image information by printing, but is not limited thereto.
In an alternative embodiment, displaying image information comprises: the image information is displayed on the client.
Optionally, in this embodiment, for example, image information is displayed in the mobile phone APP, which is convenient for the user to view.
In an alternative embodiment, outputting the hint information includes at least one of: playing the target audio on the client, wherein the prompt message comprises the target audio; displaying target characters on a client, wherein the prompt message comprises the target characters; and displaying the target image on the client, wherein the prompt message comprises the target image.
Optionally, the prompt information is output in various ways, so that the user can know the state of the target object in the image information conveniently.
The invention is illustrated below with reference to specific examples:
in this embodiment, taking monitoring of food materials in a refrigerator as an example for explanation, the method mainly includes the following steps:
s1: the user opens the refrigerator door, and each function subregion name and the edible material that each subregion suitably was deposited are reported to pronunciation automatically. After the user is familiar with each functional area, the function can be closed through voice (for example, little excellent, and voice broadcasting is closed); the user can define the names of the functional partitions (for example, xiaoyou, where the a area is set as an egg area and the c area is set as a milk area) by self, or the default partitions are the a milk area, the b beer area, the c egg area, the d vegetable area, the e fruit area and the f fresh area, as shown in fig. 4;
s2: the refrigerator door is closed after food materials are put into the corresponding partitions, when the door is closed to a certain angle (the angle value is related to the size of the refrigerator), a camera shoots a picture of the refrigerator body, and names of all the functional partitions are printed and stored on the picture (as the food materials in the refrigerator body are usually wrapped by plastic bags, if the food materials in the refrigerator body are identified, the identification rate is low, but a user can identify the food materials through the self-defined functional partition and the matched image);
s3: sending the picture to a cloud server through WIFI;
s4: after the refrigerator door is closed, the program-controlled rotating part of the camera acts to enable the camera to downwards rotate to a certain angle, the pictures of the food materials in the areas a and b are shot, and the quantity of the food materials in the areas a and b (the food materials comprise beer, cup-packed/bottled beverages, cup-packed/bottled milk and eggs (placed on an egg rack)) is identified in the camera in an off-line mode;
s5: sending the number results of the food material pictures in the areas a and b and the food material identification of each area to a cloud server;
s6: the program-controlled telescopic part of the camera is matched with the program-controlled rotating part to adjust the camera to a proper position (avoiding the shielding of the middle-layer bottle seat) to shoot the food material pictures in the region c, and the quantity of the food materials in the region c (the food materials comprise beer, cup-packed/bottled beverages, cup-packed/bottled milk and eggs (placed on an egg rack)) is identified in the camera in an off-line manner;
s7: sending the number results of the food material pictures and the food material identification in the region c to a cloud server;
s8: the program control telescopic part of the camera is matched with the program control rotating part to enable the camera to return to the initial position angle;
s9: when the user leaves the home mode, the user can remotely check the food material condition in the refrigerator at the mobile phone app end, and can receive short message reminding (such as the milk quantity 1 in the area a) of the food material quantity, so that the user can conveniently and timely replenish the food.
In the implementation, the door body and the box body are shot through a single camera; the USB camera integrates a voice function and guides a user to store food material or define the name of a storage area by user definition; the USB camera integrates an angle sensor to realize angle calculation; the USB camera integrates the motor function and drives the program-controlled rotating part and the program-controlled telescopic part so as to realize the position angle adjustment of the camera; the USB camera simultaneously supports two interfaces of USB and UART; the quantity identification of food materials in a specific area of the door body is realized in an off-line manner; and printing an area name label on the shot picture according to the area name customized by the voice function of the user.
In conclusion, the single camera is adopted in the embodiment to realize the shooting of the box body and the shooting of the specific area of the door body at the same time, so that the cost is greatly saved. For food materials in the box body, most users can wrap the food materials by using plastic bags, and under the condition of serious shielding, the recognition rate of the food materials is very low, in the embodiment, the names of all functional areas are defined by voice assistance, the users are guided to place the food materials according to the names of the functional areas, the types of the food materials in the box body are distinguished by looking up pictures and combining the names of the functional areas marked on the pictures, and hardware resources and response time are saved; for food materials in a specific area on the door body, the number of the food materials is identified in an off-line mode at the camera head end, and the number of certain food materials is reminded to a user through a short message in a timing mode by combining the name tag of the specific area of the door body.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
In this embodiment, a device for prompting object information is further provided, where the device is used to implement the foregoing embodiments and preferred embodiments, and details are not repeated for what has been described. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 7 is a block diagram of a structure of an object information presentation apparatus according to an embodiment of the present invention, as shown in fig. 7, the apparatus including:
a first obtaining module 72, configured to obtain, by the image capturing device, image information of a target placement area when it is determined that the target device is at a predetermined angle, where object information of a target object placed in the target placement area is displayed in the image information, and the image capturing device is disposed in the target device;
a display module 74 for displaying image information;
and an output module 76, configured to output a prompt message when the number of the target objects is smaller than the preset value, where the prompt message is used to prompt that the target objects are in a missing state.
Optionally, the first obtaining module includes: the device comprises a first determining unit, a second determining unit and a control unit, wherein the first determining unit is used for determining the opening angle or the closing angle of the target device through an angle sensor, and the angle sensor is arranged in the target device; a first acquisition unit configured to acquire the image information of the target placement area by the image pickup apparatus, in a case where it is determined that an opening angle or a closing angle of the target apparatus is at a predetermined angle.
Optionally, the apparatus further comprises: the device comprises a first triggering module and a second triggering module, wherein the first triggering module is used for triggering an angle sensor to detect the opening angle or the closing angle of a target device under the condition that the target device is determined to be in the opening state or the closing state through a preset interface before the opening angle or the closing angle of the target device is determined through the angle sensor.
Optionally, the first obtaining module includes: the first adjusting unit is used for adjusting a camera of the camera device to a preset position by controlling a program-controlled telescopic piece and a program-controlled rotating piece in the camera device under the condition that the target device is determined to be at a preset angle, so as to acquire the image information of the target placement area, wherein the preset position corresponds to the target placement area.
Optionally, the apparatus further comprises: and the first determining module is used for determining the corresponding relation between the target placement area and the target object through a client before the image pickup device acquires the image information of the target placement area under the condition that the target device is determined to be at the preset angle.
Optionally, the apparatus further comprises: and the first setting module is used for setting the corresponding relation in the image information after the image information of the target placement area is acquired through the image pickup equipment under the condition that the target equipment is determined to be at the preset angle, so that the corresponding relation is displayed on a client.
Optionally, the display module includes: and the first display unit is used for displaying the image information on the client.
Optionally, the outputting the prompt information includes at least one of: playing a target audio on a client, wherein the prompt message includes the target audio; displaying target characters on a client, wherein the prompt message comprises the target characters; and displaying a target image on the client, wherein the prompt message comprises the target image.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Embodiments of the present invention also provide a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:
s1, acquiring image information of the target placement area through the camera device under the condition that the target device is determined to be at a preset angle, wherein the image information displays object information of a target object placed in the target placement area, and the camera device is arranged in the target device;
s2, displaying image information;
and S3, outputting prompt information when the number of the target objects is less than the preset value, wherein the prompt information is used for prompting that the target objects are in the missing state.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing computer programs, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to perform the steps of any of the above method embodiments by means of the computer program.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, acquiring image information of the target placement area through the camera device under the condition that the target device is determined to be at a preset angle, wherein the image information displays object information of a target object placed in the target placement area, and the camera device is arranged in the target device;
s2, displaying image information;
and S3, outputting prompt information when the number of the target objects is less than the preset value, wherein the prompt information is used for prompting that the target objects are in the missing state.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (11)
1. A method for prompting object information is characterized by comprising the following steps:
under the condition that it is determined that target equipment is at a preset angle, image information of a target placement area is obtained through image pickup equipment, wherein object information of a target object placed in the target placement area is displayed in the image information, and the image pickup equipment is arranged in the target equipment;
displaying the image information;
and outputting prompt information under the condition that the number of the target objects is smaller than a preset value, wherein the prompt information is used for prompting that the target objects are in a missing state.
2. The method according to claim 1, wherein in a case where it is determined that the target device is at the predetermined angle, acquiring image information of the target placement area by the image pickup device includes:
determining an opening angle or a closing angle of the target equipment through an angle sensor, wherein the angle sensor is arranged in the target equipment;
and acquiring the image information of the target placement area through the camera device under the condition that the opening angle or the closing angle of the target device is determined to be at a preset angle.
3. The method of claim 2, prior to determining the on angle or off angle of the target device via the angle sensor, comprising:
and under the condition that the target equipment is determined to be in an opening state or a closing state through a preset interface, triggering the angle sensor to detect the opening angle or the closing angle of the target equipment.
4. The method according to claim 1, wherein in a case where it is determined that the target device is at the predetermined angle, acquiring image information of the target placement area by the image pickup device includes:
under the condition that the target device is determined to be at the preset angle, adjusting a camera of the camera device to a preset position by controlling a program-controlled telescopic piece and a program-controlled rotating piece in the camera device so as to acquire the image information of the target placement area, wherein the preset position corresponds to the target placement area.
5. The method according to claim 1, wherein before the image information of the target placement area is acquired by the image pickup apparatus in a case where it is determined that the target apparatus is at the predetermined angle, the method further comprises:
and determining the corresponding relation between the target placement area and the target object through the client.
6. The method according to claim 5, wherein after acquiring the image information of the target placement area by the image pickup apparatus in a case where it is determined that the target apparatus is at the predetermined angle, the method further comprises:
and setting the corresponding relation in the image information so as to display the corresponding relation on the client.
7. The method of claim 1, wherein displaying the image information comprises:
and displaying the image information on the client.
8. The method of any one of claims 1 to 7, wherein outputting the prompt message comprises at least one of:
playing a target audio on a client, wherein the prompt message includes the target audio;
displaying target characters on a client, wherein the prompt message comprises the target characters;
and displaying a target image on the client, wherein the prompt message comprises the target image.
9. An apparatus for presenting object information, comprising:
the device comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring image information of a target placement area through a camera device under the condition that the target device is determined to be at a preset angle, the image information displays object information of a target object placed in the target placement area, and the camera device is arranged in the target device;
the display module is used for displaying the image information;
and the output module is used for outputting prompt information under the condition that the number of the target objects is smaller than a preset value, wherein the prompt information is used for prompting that the target objects are in a missing state.
10. A storage medium, in which a computer program is stored, wherein the computer program is arranged to perform the method of any of claims 1 to 8 when executed.
11. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method of any of claims 1 to 8 by means of the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010872741.4A CN112019743A (en) | 2020-08-26 | 2020-08-26 | Object information prompting method and device, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010872741.4A CN112019743A (en) | 2020-08-26 | 2020-08-26 | Object information prompting method and device, storage medium and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112019743A true CN112019743A (en) | 2020-12-01 |
Family
ID=73503223
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010872741.4A Pending CN112019743A (en) | 2020-08-26 | 2020-08-26 | Object information prompting method and device, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112019743A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113467299A (en) * | 2021-06-28 | 2021-10-01 | 青岛海尔科技有限公司 | Equipment door control method and device, storage medium and electronic device |
| CN113762191A (en) * | 2021-09-15 | 2021-12-07 | 珠海格力电器股份有限公司 | Device for prompting user based on image, method and device for prompting user operation |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105091499A (en) * | 2015-08-18 | 2015-11-25 | 小米科技有限责任公司 | Information generation method and device |
| JP2017106671A (en) * | 2015-12-10 | 2017-06-15 | 三菱電機株式会社 | Refrigerator, image management system in refrigerator and program |
| CN106855341A (en) * | 2016-12-21 | 2017-06-16 | 青岛海尔股份有限公司 | Refrigerator and the camera head for refrigerator |
| CN107388682A (en) * | 2017-09-08 | 2017-11-24 | 海信（山东）冰箱有限公司 | A kind of intelligent refrigerator and its temprature control method |
| CN110953838A (en) * | 2019-12-16 | 2020-04-03 | 珠海格力电器股份有限公司 | Food material buying prompting method in refrigerator, storage medium and refrigerator |
-
2020
- 2020-08-26 CN CN202010872741.4A patent/CN112019743A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105091499A (en) * | 2015-08-18 | 2015-11-25 | 小米科技有限责任公司 | Information generation method and device |
| JP2017106671A (en) * | 2015-12-10 | 2017-06-15 | 三菱電機株式会社 | Refrigerator, image management system in refrigerator and program |
| CN106855341A (en) * | 2016-12-21 | 2017-06-16 | 青岛海尔股份有限公司 | Refrigerator and the camera head for refrigerator |
| CN107388682A (en) * | 2017-09-08 | 2017-11-24 | 海信（山东）冰箱有限公司 | A kind of intelligent refrigerator and its temprature control method |
| CN110953838A (en) * | 2019-12-16 | 2020-04-03 | 珠海格力电器股份有限公司 | Food material buying prompting method in refrigerator, storage medium and refrigerator |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113467299A (en) * | 2021-06-28 | 2021-10-01 | 青岛海尔科技有限公司 | Equipment door control method and device, storage medium and electronic device |
| CN113467299B (en) * | 2021-06-28 | 2023-08-18 | 青岛海尔科技有限公司 | Equipment door control method and device, storage medium and electronic device |
| CN113762191A (en) * | 2021-09-15 | 2021-12-07 | 珠海格力电器股份有限公司 | Device for prompting user based on image, method and device for prompting user operation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108780505B (en) | Intelligent sales counter, article identification method, device, server and storage medium | |
| CN112019743A (en) | Object information prompting method and device, storage medium and electronic device | |
| US10602585B2 (en) | Devices having calibrated LEDs | |
| US10147288B2 (en) | Alarm method and device | |
| US9675049B2 (en) | Pet amusement device | |
| US20200037577A1 (en) | Pet-feeder device | |
| US20150373945A1 (en) | Smart Animal Feeder | |
| CN105184719A (en) | Foodstuff monitoring method and device | |
| TR201808190T4 (en) | Refrigerator and its control method. | |
| US11321588B2 (en) | System for identifying pests and monitoring information through image analysis, and monitoring method using same | |
| CN112585667A (en) | Intelligent platform counter display system and method | |
| CN108319996A (en) | Vegetable identification processing system and method, intelligent dining-table system | |
| CN111382660A (en) | Augmented reality feedback for appliance inventory | |
| CN110008829A (en) | The method of adjustment and device of food | |
| CN109870948A (en) | A kind of method adjusting out ice amount and self-service beverage dispenser | |
| US10647343B2 (en) | Shopping cart, prompting method, and electronic device for shopping cart | |
| CN111568242A (en) | Water dispenser control method, water dispenser and computer readable storage medium | |
| CN109308627A (en) | A kind of advertisement push system and method based on Identification of Images | |
| CN108401173A (en) | Interactive terminal, method and the computer readable storage medium of mobile live streaming | |
| CN110287824A (en) | Identify the method and device of food | |
| CN110191324A (en) | Image processing method, device, server and storage medium | |
| US20210318596A1 (en) | Projection system and projection operation method | |
| CN211832336U (en) | Pet feeding device and pet feeding system | |
| Murtadho et al. | Design and implementation of smart advertisement display board prototype | |
| WO2012045959A1 (en) | Communication-enabled multimedia bowl for domestic pets |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201201 |