CN109741519B

CN109741519B - Unmanned supermarket shelf monitoring system and control method thereof

Info

Publication number: CN109741519B
Application number: CN201811505699.1A
Authority: CN
Inventors: 唐吉斌
Original assignee: Shenzhen Citops Communication System Co ltd
Current assignee: Shenzhen Citops Communication System Co ltd
Priority date: 2018-12-10
Filing date: 2018-12-10
Publication date: 2021-01-19
Anticipated expiration: 2038-12-10
Also published as: CN109741519A

Abstract

The invention discloses an unmanned supermarket shelf monitoring system and a control method thereof, wherein the method comprises the following steps: after the shooting device is started, executing a preset shooting program, shooting a picture and uploading the shot picture to a background server in communication connection with the shooting device; the background server stores the pictures shot by the shooting device; the background server carries out image recognition on the latest stored photo, and sends replenishment reminding information to a management terminal in communication connection with the background server when the number of the articles on the shelf is less than the preset number; the shooting device is automatically shut down after the picture is successfully uploaded; awakening the shooting device again after an RTC alarm clock arranged in the shooting device is separated by a preset standby time interval, and repeating the steps of the method by the unmanned supermarket shelf monitoring system according to the sequence; the invention realizes the monitoring of the quantity of goods on the goods shelf with ultra-low power consumption, has the function of reminding replenishment, and has the advantages of low power consumption, accurate identification and convenient installation.

Description

Unmanned supermarket shelf monitoring system and control method thereof

Technical Field

The invention relates to the field of automatic vending, in particular to a shelf monitoring system of an unmanned supermarket and a control method thereof.

Background

With the technical innovation and the continuous upgrade of the people consumption mode, various unmanned selling modes are gradually generated in the market. For example, the unmanned shelf is that a shelf is used for placing some eaten drinks, two-dimensional codes are pasted, money is paid first and then goods are delivered, and the unmanned shelf is full of consciousness and sold by no one. The unmanned goods shelf is not a latest concept, and vending machines which are appeared in the early days are commonly found in subway stations, offices, schools and the like, and are sold by people. The supermarket without salesmen is also called as the unmanned supermarket. It is not the clerk who is responsible for collecting the money, but rather a safe or coin box. After the customer purchases the commodity, money is thrown into the safe box or the coin box according to the price marked on the commodity, and the business is finished.

An unmanned goods shelf with an alarm function is disclosed in Chinese patent with publication number CN207895532U, and comprises a goods shelf body and a control system; the control system comprises pressure sensors, an alarm device and a control center, wherein the front side of the goods shelf body is provided with at least one goods shelf row, the goods shelf row is provided with at least one goods placing area, a code to be scanned corresponding to related goods is arranged in front of each goods placing area, the bottom of each goods placing area is provided with a corresponding pressure sensor, the control center is provided with a wireless receiving end in communication connection with the mobile terminal, and the control center is respectively and electrically connected with the pressure sensors and the alarm device; when the goods are taken away directly without the payment of the code to be scanned by the mobile terminal, the pressure sensor detects the signal and transmits the signal to the control center, and the control center starts the alarm device to give an alarm. The utility model discloses a provide an unmanned goods shelves with alarming function can solve the problem of commodity loss rate basically to facilitate for the marketing of unmanned goods shelves. And to some extent, can also serve to monitor the quantity of remaining items. However, the bottom of each cargo placement area needs to be provided with corresponding pressure sensor layout, so that the cargo placement area is faced with the technical problems of complex circuit layout and high cost.

Disclosure of Invention

Aiming at the defects in the prior art, the invention aims to provide a control method of an unmanned supermarket shelf monitoring system, which can realize accurate quantity monitoring of the quantity of the remaining articles on a shelf, can timely initiate replenishment reminding to an administrator, and has the advantages of simple layout and low cost.

In order to achieve the first purpose, the invention provides the following technical scheme:

a control method of an unmanned supermarket shelf monitoring system comprises the following steps:

the shooting device executes a preset shooting program after being started up, shoots a picture and uploads the shot picture to a background server in communication connection with the shooting device, and the shooting device is automatically shut down after the picture is successfully uploaded through verification;

the background server stores the pictures shot by the shooting device;

the background server carries out image recognition on the latest stored photo, and sends replenishment reminding information to a management terminal in communication connection with the background server when the number of the articles on the goods shelf is less than the preset number;

and awakening the shooting device again after an RTC alarm clock arranged in the shooting device is separated by a preset standby time interval, and repeating the steps of the method by the unmanned supermarket shelf monitoring system according to the sequence.

By adopting the technical scheme, the monitoring of the number of goods on the goods shelf with ultra-low power consumption is realized, and the goods replenishment reminding function is realized; the shooting device is in a power-off state at ordinary times, no power is consumed, only the RTC alarm clock is powered by a single button cell to keep running, the power consumption is very low, the RTC alarm clock wakes up the shooting device to be started after a preset standby time interval is reached, the shooting device shoots and uploads according to a preset program, the quantity is recognized through the background server to generate a corresponding quantity report, and the quantity report is sent to the management terminal when the quantity of the corresponding type of articles is lower than a preset value to remind a manager to replenish goods in time, so that monitoring and accurate recognition of the Internet of things are realized; when laying the shooting device, only need with it install the opposite of goods shelves and towards the goods shelves can, do not need extra goods shelves wiring, very convenient and practice thrift the cost. The shell of the shooting device is only as large as a common mobile phone, and the shooting device is powered by a lithium battery and can be charged at regular time.

Further, when the starting setting is set for the shooting device, the method further comprises the following steps:

the shooting device sends out a hotspot, and after the user terminal is connected with the hotspot, the starting setting is set through a terminal interface of the user terminal;

the wifi account and the password input through a terminal interface of the user terminal and the starting setting of the preset standby time interval are transmitted to the shooting device through the hot spot connected with the user terminal;

the shooting device is connected with a wifi network in the area according to the received wifi account and the password, so that network connection with the background server is achieved;

the shooting device is set into the RTC alarm clock according to the received preset standby time interval, and the RTC alarm clock wakes up the shooting device to start up through the preset standby time interval.

Through adopting above-mentioned technical scheme, when shooting the device and using for the first time, or open after recovering factory setting, need set up the debugging to it, through user terminal rather than with the hot spot connection after, user terminal can set for the parameter of shooting the device through app, one is to select a reasonable interval time, the longer more energy-conserving more of time, but just can not in time update goods shelves article quantity, generally can select 20 minutes or 1 hour interval, just shut down after shooting the device and shooting, wait for the next start-up of awaking up of RTC alarm clock.

Further, before the photographing apparatus is turned on and then a preset photographing program is executed, the method further includes:

the shooting device is characterized in that an infrared sensor arranged on the shooting device senses whether a human body is sheltered in the front of the shooting device, when the infrared sensor detects that the human body is sheltered in the front, the shooting device suspends a picture shooting procedure, and when the infrared sensor detects that the human body is not sheltered in the front, the preset picture shooting procedure is continuously executed.

Through adopting above-mentioned technical scheme, avoided standing before the goods shelves someone can shelter from the camera lens of camera, the photo that leads to shooing is invalid, discerns invalid goods quantity, arouses report data's mistake, so through the setting of above-mentioned technique, as long as someone pauses earlier when being, shoots after walking again, can accurately shoot the complete original appearance of goods shelves for goods quantity discernment is more accurate. The problem of misinformation is avoided.

the method comprises the steps that an ultrasonic sensor arranged on the shooting device senses whether a human body is sheltered in the front of the shooting device, when the ultrasonic sensor detects that the human body is sheltered in the front, the shooting device suspends a picture shooting procedure, and when the ultrasonic sensor detects that the human body is not sheltered in the front, the preset picture shooting procedure is continuously executed.

Further, when the shooting device uploads the pictures shot by the shooting device to a background server in communication connection with the shooting device, the method further comprises the following steps:

the shooting device simultaneously binds the equipment number of the shooting device with the picture and sends the binding to the background server, and the equipment number is bound with the information of the geographic position where the shooting device is located and the shelf number;

the background server identifies the category of the stored latest photo image and the remaining quantity of the corresponding category of articles on the goods shelf, when the remaining quantity of one or more types of articles is less than the preset quantity, the type of articles is in a goods shortage state, the background server reads the equipment number of the shooting device bound with the photo, searches the geographical position and shelf number information of the shooting device bound with the equipment number and stored in the background server according to the equipment number, packs the geographical position and shelf number information of the shooting device, the category of the articles in the goods shortage state and the remaining quantity of the articles corresponding to the goods shortage category into the goods replenishment reminding information, and then sends the replenishment reminding information to the management terminal.

Through adopting above-mentioned technical scheme, the administrator sends through the packing shooting device place geographical position, goods shelves number information, be in the article category of out-of-stock state, and the replenishment reminding information who corresponds the surplus quantity of the article of out-of-stock category, can know the article and the quantity of out-of-stock fast, make preparation, and can accurately supply corresponding goods shelves when delivery, replenishment, make things convenient for the delivery, this replenishment is reminded just very conveniently, accurate to the business point of interlocking type, conveniently look over.

Further, an infrared sensor independently powered is arranged on the shooting device, and in a shutdown state of the shooting device, the method further comprises:

the shooting device is characterized in that an infrared sensor arranged on the shooting device monitors whether a human body is sheltered in front of the shooting device in real time, when the infrared sensor detects that the human body is sheltered in front, the shooting device is awakened to be started up when the infrared sensor detects that no human body is sheltered in front again, and a preset shooting program is executed.

By adopting the technical scheme, the goods on the goods are easily and quickly sold out in places with high use frequency or large sales volume of the goods shelf, and in addition, the situation that a certain time period concentrates consumption people comes, for example, a large number of people suddenly come within 1 hour of breakfast, lunch and dinner, whether the goods are lacked or not and how many goods are needed to be identified more quickly and accurately, a manager is reminded to complete replenishment in time, the subsequent sales are smoother, and the experience of consumers is improved, so that the replenishment reminding is sent when the remaining number of the goods is not 0 and is possibly 5 goods; in order to meet the demand, people can grasp a characteristic, goods are reduced, consumption before coming from a shelf is achieved, people generally leave after shielding an infrared sensor before coming from the shelf, consumption is achieved, goods are reduced, on one hand, a long-period preset standby time interval is set to take pictures regularly, for example, 3 hours, on the basis, when people come from the front of the shelf, shielding the infrared sensor and leave again, a shooting device is triggered and awakened to take pictures for the shelf in a snapping mode, and the remaining quantity of the goods can be known in time. The administrator can also know the remaining number of shelves more timely and also realize a greater degree of energy saving. When the number of people is small, people do not need to take pictures or take pictures at short intervals, so that a great energy-saving effect is achieved.

Aiming at the defects in the prior art, the second purpose of the invention is to provide an unmanned supermarket shelf monitoring system, which can realize accurate quantity monitoring of the quantity of the remaining articles on the shelf, can timely initiate replenishment reminding to an administrator, and has the advantages of simple layout and low cost.

In order to achieve the second purpose, the invention provides the following technical scheme:

an unmanned supermarket shelf monitoring system comprises a shooting device, a background server and a management terminal;

the shooting device comprises a first processing module, and a shooting unit, an RTC alarm clock and a first communication module which are coupled with the first processing module;

the background server comprises a second processing module, a second communication module, a storage module and an image recognition module, wherein the second communication module is coupled with the second processing module;

the management terminal comprises a third processing module, a display unit and a third communication module, wherein the display unit and the third communication module are coupled with the third processing module in a three-phase mode;

the communication module II is in three-phase communication connection with the communication module I and the communication module;

after the shooting device is started, the first processing module executes a preset shooting program to control the shooting unit to shoot pictures, sends the pictures shot by the shooting unit to the background server through the communication connection between the first communication module and the second communication module, and stores the pictures received by the second communication module in the storage module coupled with the second communication module through the second processing module;

the image recognition module carries out image recognition on the latest photo stored in the storage module, and when the number of the articles on the goods shelf is recognized to be less than the preset number, the processing module sends replenishment reminding information to the management terminal through the communication connection between the communication module II and the communication module III;

after the communication module III receives the replenishment reminding information, the processing module III of the management terminal transmits and displays the replenishment reminding information on the display unit;

the first processing module of the shooting device automatically shuts down after the picture uploading is verified to be successful;

By adopting the technical scheme, the monitoring of the number of goods on the goods shelf with ultra-low power consumption is realized, and the goods replenishment reminding function is realized; the background server stores the received photos in the storage module and then calls the mature image recognition function in the prior art to finish the quantity and type recognition, and the docking is easy.

Further, the conveying system also comprises a user terminal, and the first communication module is a wifi module coupled with the first processing module;

when the starting setting is set for the shooting device, a first processing module controls the wifi module to send out a hotspot, and after the user terminal is connected with the hotspot, the starting setting is set through a terminal interface of the user terminal;

the wifi module is used for starting the set of the preset standby time interval and transmitting the wifi account and the password which are input through a terminal interface of the user terminal to the wifi module through a hotspot connected with the user terminal;

the shooting device is connected with a wifi network in the area according to the wifi account and the password received by the wifi module, so that network connection with the background server is achieved;

and a processing module of the shooting device sets the preset standby time interval into the RTC alarm clock according to the received preset standby time interval by the wifi module, and the RTC alarm clock wakes up the shooting device to start up through the preset standby time interval.

By adopting the technical scheme, the mobile terminal used at present is the mobile phone at most, and WiFi module is needed to be passed by the mobile phone for receiving WiFi and using hot spots, which is equivalent to a wireless network card; through the way, the user terminal can inform the shooting device of the wifi account number and the password of the network to be connected, the connection of the network and the data surfing are completed, and meanwhile, the hot data transmission way is convenient and fast to complete the configuration of the starting setting on the terminal interface of the user terminal.

Further, the shooting device also comprises an infrared sensor which is right opposite to the front of the shooting unit,

after the shooting device is started, the first processing module senses whether a human body is sheltered in front of the first processing module before the preset shooting program is executed, and when the infrared sensor detects that the human body is sheltered in front, the first processing module suspends the program for shooting the picture, and when the infrared sensor detects that the human body is not sheltered in front, the preset shooting program is continuously executed.

Further, when the shooting device uploads the shot picture to a background server in communication connection with the shooting device, the processing module simultaneously binds the equipment number of the shooting device with the picture and sends the binding information to the background server, and the equipment number is bound with the information of the geographical position where the shooting device is located and the shelf number;

the method comprises the steps that a background server identifies the category of an article on a shelf and the residual quantity of the article corresponding to the category for a latest stored photo image, when the residual quantity of one or more types of articles is less than a preset quantity, the article is in a stock shortage state, a processing module II of the background server reads the equipment number of a shooting device bound with the photo, searches the geographical position and shelf number information of the shooting device bound with the equipment number stored in a storage module according to the equipment number, packs the geographical position and shelf number information of the shooting device, the article category in the stock shortage state and the residual quantity of the article corresponding to the stock shortage category into stock replenishment reminding information, and sends the stock replenishment reminding information to a management terminal.

Compared with the prior art, the invention has the advantages that:

(1) the shooting device is used for shooting, uploading, analyzing the background server and awakening the shooting device at regular time through the RTC alarm clock, so that the monitoring of the number of goods on a shelf with ultra-low power consumption is realized, the goods replenishing reminding function is realized, and the monitoring and accurate identification of the Internet of things are realized; when the shooting device is arranged, the shooting device only needs to be arranged opposite to the goods shelf and faces the goods shelf, so that the shooting device is very convenient and saves cost;

(2) when infrared sensor detects that the place ahead has the human body to shelter from, the procedure of taking the photo is suspended to the shooting device, waits to infrared sensor detects the place ahead and does not have the human body to shelter from when, and the procedure of shooing of continuing execution again of predetermineeing can accurately shoot the complete original appearance of goods frame for goods quantity discernment is more accurate, avoids the problem of misrepresentation.

Drawings

FIG. 1 is a schematic connection diagram of an unmanned supermarket shelf monitoring system of an embodiment;

FIG. 2 is a schematic circuit diagram of a first processing module according to an embodiment;

fig. 3 is a circuit diagram of connections among the toggle switch, the P-channel MOS transistor Q3, the P-channel MOS transistor Q2, and the NPN transistor Q1 according to the fourth embodiment;

FIG. 4 is a circuit diagram of an RTC alarm clock of the fourth embodiment;

FIG. 5 is a circuit diagram of a DC-DC synchronous buck converter according to a fourth embodiment;

FIG. 6 is a circuit diagram of a processor according to a fourth embodiment.

Reference numerals: 1. a photographing device; 11. a first processing module; 12. a shooting unit; 13. an RTC alarm clock; 14. a first communication module; 15. an infrared sensor; 2. a background server; 21. a second processing module; 22. a second communication module; 23. a storage module; 24. an image recognition module; 3. a management terminal; 31. a third processing module; 32. a display unit; 33. a third communication module; 4. a user terminal; 5. a processor; 6. a DC-DC synchronous buck converter; 7. a delay circuit.

Detailed Description

The invention is described in detail below with reference to the figures and examples.

It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware implementation, the processor may be implemented within: one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, other electronic units designed to perform the functions described herein, or a combination thereof.

When the embodiments are implemented in software, firmware, middleware or microcode, program code or code segments, they can be stored in a machine-readable medium, such as a storage component. A code segment may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or any combination of instructions, data structures, or program statements. A code segment may be coupled to another code segment or a hardware circuit by passing and/or receiving information, data, arguments, parameters, or memory contents. Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted using any suitable means including memory sharing, message passing, token passing, network transmission, etc.

For a software implementation, the techniques described herein may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described herein. The software codes may be stored in memory units and executed by processors. The memory unit may be implemented within the processor or external to the processor, in which case it can be communicatively coupled to the processor via various means as is known in the art.

In a first embodiment, as shown in fig. 1, a control method of an unmanned supermarket shelf monitoring system includes:

firstly, when the shooting device 1 is used for the first time or factory settings are restored, starting settings need to be set for the shooting device 1, a hotspot is automatically sent out after the shooting device 1 is started, and the starting settings are set through a terminal interface of the user terminal 4 after the user terminal 4 is connected with the hotspot;

the wifi account and the password input through the terminal interface of the user terminal 4 and the starting setting of the preset standby time interval are transmitted to the shooting device 1 through the hot spot connected with the user terminal 4;

the shooting device 1 is connected with a wifi network in the area where the wifi account and the password are received, and network connection with the background server 2 is achieved;

the shooting device 1 is set in an RTC alarm clock 13 according to the received preset standby time interval;

step two, the RTC alarm clock 13 runs continuously after the preset standby time interval is set, and wakes up the shooting device 1 to start at every preset standby time interval;

step three, after the starting setting of the shooting device 1 is set, a preset shooting program is automatically executed as long as the shooting device 1 is activated and started in the follow-up process;

before the shooting device 1 shoots, an infrared sensor 15 arranged on the shooting device 1 firstly senses whether a human body is shielded in front of the shooting device, when the infrared sensor 15 detects that the human body is shielded in front, the shooting device 1 suspends a photo shooting program, and when the infrared sensor 15 detects that no human body is shielded in front, the preset shooting program is continuously executed;

step five, after the shooting device 1 shoots a photo, the equipment number of the photo is bound with the photo, the photo bound with the equipment number is uploaded to a background server 2 in communication connection with the shooting device, the shooting device 1 is automatically turned off after the photo is successfully uploaded through verification, the RTC alarm clock 13 waits for the next time, and then the step two to the step five are repeated;

step six, the background server 2 stores the pictures shot by the shooting device 1 transmitted through the public network;

seventhly, carrying out image recognition on the latest stored photo at the background server 2, recognizing the type of the articles on the shelf in the photo and the residual quantity of the articles corresponding to the type, and when the residual quantity of one or more types of articles is less than the preset quantity, keeping the articles in the out-of-stock state;

step eight, for the article type in the out-of-stock state, the background server 2 reads the equipment number of the shooting device 1 bound with the photo, the geographical position and shelf number information of all the shooting devices 1 are stored in the background server 2 and correspond to the equipment number, the background server 2 searches out the geographical position and shelf number information of the corresponding shooting device 1 according to the out-of-stock equipment number, the background server 2 packs the geographical position and shelf number information of the shooting device 1, the article type in the out-of-stock state and the residual quantity of the articles corresponding to the out-of-stock type into the replenishment reminding information, and the background server 2 sends the replenishment reminding information to the management terminal 3;

and step nine, the administrator looks up the packed replenishment reminding information sent by the background server 2 through the management terminal 3, prepares the corresponding quantity of goods according to the residual quantity of the goods of the shortage type in the replenishment reminding information, and supplements the goods to the corresponding goods shelf in the replenishment reminding information in time.

The binding method of the device number and the photo can be as follows: the device number is named directly in the name of the photo.

By adopting the steps of the method, the monitoring of the quantity of goods on the goods shelf with ultra-low power consumption is realized, and the goods replenishment reminding function is realized. The shooting device 1 is in a power-off state at ordinary times, power consumption is avoided, only the RTC alarm clock 13 is powered by an independent button battery to keep running, and power consumption is low. When a preset standby time interval is reached, the RTC alarm clock 13 wakes up the shooting device 1 to start, the shooting device 1 shoots and uploads according to a preset program, the quantity is identified through the background server 2 to generate a corresponding quantity report, and when the quantity of the corresponding type of articles is lower than a preset value, the corresponding type of articles is sent to the management terminal 3 to remind a manager of timely replenishment, so that monitoring and accurate identification of the Internet of things are realized; when laying camera 1, only need with it install the opposite of goods shelves and towards the goods shelves can, do not need extra goods shelves wiring, very convenient and practice thrift the cost. The shell of the shooting device 1 is only as large as a common mobile phone, and the shooting device is powered by a lithium battery and can be charged at regular time.

When the shooting device 1 is used for the first time or is opened after factory setting is restored, the shooting device needs to be set and debugged, after the shooting device is connected with a hot spot used by the user terminal 4, the user terminal 4 can set parameters of the shooting device 1 through app, one is to select a reasonable interval time, the longer the time is, the more energy is saved, but the quantity of goods on a shelf cannot be updated in time, the interval of 20 minutes or 1 hour can be generally selected, the shooting device 1 is shut down after shooting is finished, and the next time of starting up the RTC alarm clock 13 is waited.

In order to avoid that someone stands before the goods shelves and can shelter from the camera lens of camera, the photo that leads to shooing is invalid, discerns invalid goods quantity, arouses the mistake of report data, so through the setting of above-mentioned infrared sensor 15's induction technology, as long as someone pauses earlier when, shoots after walking again, can accurately shoot the complete original appearance of goods shelves for goods quantity discernment is more accurate. The problem of misinformation is avoided.

The second embodiment is a control method of an unmanned supermarket shelf monitoring system, which is different from the first embodiment in that: the ultrasonic sensor is used for sensing the approach of a human body to the goods shelf instead of the infrared sensor 15. The fourth step is that: before the shooting device 1 shoots, an ultrasonic sensor arranged on the shooting device 1 firstly senses whether a human body is sheltered in the front of the ultrasonic sensor, when the ultrasonic sensor detects that the human body is sheltered in the front, the shooting device 1 suspends a picture shooting procedure, and when the ultrasonic sensor detects that the human body is not sheltered in the front, the preset shooting procedure is continuously executed.

In a third embodiment, as shown in fig. 1, a control method of an unmanned supermarket shelf monitoring system includes:

meanwhile, the shooting device 1 is provided with an infrared sensor 15 independently powered, the infrared sensor 15 monitors whether a human body is shielded in front of the shooting device 1 in real time in a power-off state of the shooting device 1, and when the infrared sensor 15 detects that the human body is shielded in front, and when the infrared sensor 15 detects that the human body is not shielded in front again, the infrared sensor 15 wakes up the shooting device 1 to start up through a precise wake-up circuit coupled with the infrared sensor 15;

before the shooting device 1 shoots, the infrared sensor 15 coupled with the shooting device 1 senses whether a human body is shielded in front of the infrared sensor 15, when the infrared sensor 15 detects that the human body is shielded in front, the shooting device 1 suspends a photo shooting program, and when the infrared sensor 15 detects that no human body is shielded in front, the preset shooting program is continuously executed;

step five, after the shooting device 1 shoots a photo, the equipment number of the photo is bound with the photo, the photo bound with the equipment number is uploaded to a background server 2 in communication connection with the shooting device, the shooting device 1 is automatically turned off after the photo is successfully uploaded through verification, the shooting device waits for being awakened by an accurate awakening circuit coupled with an RTC alarm clock 13 or an infrared sensor 15 next time, and then the step two to the step five are repeated;

In the above scheme, the method of waking up the shooting device 1 by the accurate wake-up circuit coupled with the infrared sensor 15 is to deal with a place where the frequency of use of the goods shelf is high or the sales volume is large, the goods on the goods are easily sold out quickly, and in addition, the situation that a large number of consumers are concentrated in a certain time period is provided, for example, within 1 hour of breakfast, lunch and dinner, a large number of people suddenly come to consume, so that whether the goods are lacked or not and how many goods are needed to be identified more quickly and accurately, a manager is reminded to complete replenishment in time, the subsequent sales are smoother, and the experience of the consumers is improved, so that replenishment reminding is sent when the remaining quantity of the goods is not 0, and 5 goods are possibly preset; in order to meet the demand, people can grasp a characteristic, goods are reduced, consumption before coming from a shelf is achieved, people generally leave after shielding the infrared sensor 15 before coming from the shelf, consumption is achieved, goods are reduced, on one hand, a long-period preset standby time interval is set to take pictures regularly, for example, 3 hours, on the basis, when people come from the shelf and shield the infrared sensor 15, and then leave, the shooting device 1 is triggered and awakened to take pictures of the shelf, and the remaining quantity of the goods is known in time. The administrator can also know the remaining number of shelves more timely and also realize a greater degree of energy saving. When the number of people is small, people do not need to take pictures or take pictures at short intervals, so that a great energy-saving effect is achieved.

In a fourth embodiment, as shown in fig. 1, a shelf monitoring system for an unmanned supermarket includes a user terminal 4, a shooting device 1, a background server 2 and a management terminal 3;

the shooting device 1 comprises a processing module I11, a shooting unit 12 coupled with the processing module I11, an RTC alarm clock 13 and a communication module I14;

the background server 2 comprises a second processing module 21, a second communication module 22, a storage module 23 and an image recognition module 24, wherein the second communication module 22 is coupled with the second processing module 21;

the management terminal 3 comprises a third processing module 31, a display unit 32 and a third communication module 33, wherein the display unit 32 and the third communication module are coupled with the third processing module 31;

the second communication module 22 is in communication connection with the first communication module 14 and the third communication module 33;

after the shooting device 1 is started, the processing module I11 executes a preset shooting program to control the shooting unit 12 to shoot a picture, the processing module I11 sends the picture shot by the shooting unit 12 to the background server 2 through the communication connection between the communication module I14 and the communication module II 22, and the processing module I11 of the shooting device 1 is automatically shut down after the picture uploading is verified to be successful;

the second processing module 21 stores the photos received by the second communication module 22 in the storage module 23 coupled with the second processing module;

the image recognition module 24 performs image recognition on the latest photo stored in the storage module 23, and when the number of the articles on the shelf is recognized to be less than the preset number, the second processing module 21 sends replenishment reminding information to the management terminal 3 through the communication connection between the second communication module 22 and the third communication module 33;

after the communication module III 33 receives the replenishment reminding information, the processing module III 31 of the management terminal 3 transmits and displays the replenishment reminding information on the display unit 32;

the RTC alarm clock 13 arranged in the shooting device 1 wakes up the shooting device 1 again after a preset standby time interval, and the unmanned supermarket shelf monitoring system repeats the steps of the method according to the sequence.

The management terminal 3 may be a smartphone or a PC terminal. The management terminal 3 can be a PC end connected with the Internet, so that a large amount of information can be conveniently checked, the replenishment reminding information can be checked on the display unit 32, namely, the replenishment reminding information is popped up from a pop-up window at the lower right corner of the computer, and a reminding effect is achieved. The replenishment reminding information can be used as a smart phone which is widely used at present, and the replenishment reminding information can be reminded and checked in an APP of the smart phone. The replenishment reminding information can be used as the notification information in the notification bar to pop up and remind the manager to replenish the replenishment in time. The smart phone form also has the advantage of facilitating timely viewing by maintenance personnel outside. After the management terminal 3 is electrically operated, the communication module III 33 is registered to the Internet, and then the SOCKET connection is established with the background server 2 through the Internet, the background server 2 serves as a service end of the SOCKET, the management terminal 3 serves as a client end connected with the SOCKET, and after the connection is established, the background server 2 and the management terminal 3 can perform bidirectional data transmission through the Internet. The shooting device 1 is used as a client connected with the SOCKET of the background server 2, and is registered to the Internet after the first communication module 14 is electrically operated, and establishes SOCKET connection with the background server 2, so that bidirectional data transmission is realized through the Internet. And the background server 2, the management terminal 3 and the shooting device 1 carry out data transmission through a TCP/IP protocol. TCP/IP defines a standard for how electronic devices connect to the internet and how data is transferred between them. The protocol employs a 4-layer hierarchy, each layer calling the protocol provided by its next layer to fulfill its own requirements.

The memory module 23 may be a non-volatile memory (nonvolatile memory), and the content of the memory module may be maintained after power-off without periodically refreshing the content of the memory module.

The edges of the image can directly reflect the contour and topology information of the object. The image recognition module 24 may use existing edge detection techniques to perform object recognition, classification, and counting. The edge detection technique is one of the important bases of digital image processing, pattern recognition and computer vision, and can be implemented according to the embodiment.

By adopting the steps of the method, the monitoring of the number of goods on the goods shelf with ultra-low power consumption is realized, and the goods replenishment reminding function is realized; the background server 2 stores the received photos in the storage module 23, and then calls the mature image recognition function in the prior art to complete the quantity and type recognition, so that the docking is easy.

The system also comprises a user terminal 4, wherein the first communication module 14 is a wifi module which is coupled with the first processing module 11;

when the starting setting is set for the shooting device 1, the first processing module 11 controls the wifi module to send out a hot spot, and after the user terminal 4 is connected with the hot spot, the starting setting is set through a terminal interface of the user terminal 4;

the method comprises the steps that a wifi account, a password and a preset standby time interval starting setting are input through a terminal interface of a user terminal 4, and are transmitted to a wifi module through a hot spot connected with the user terminal 4;

the shooting device 1 is connected with a wifi network in the area according to the wifi account and the password received by the wifi module, so that network connection with the background server 2 is achieved;

the processing module I11 of the shooting device 1 is set in the RTC alarm clock 13 according to the preset standby time interval received by the wifi module, and the RTC alarm clock 13 wakes up the shooting device 1 to start up through the preset standby time interval at each interval.

The user terminal 4 can be a smart phone, and the smart phone receives WiFi and uses the hot spot and needs to pass through a WiFi module, which is equivalent to a wireless network card, and can be coupled to the interface end of the processing module I11 to generate the hot spot and connect with WiFi. Through the way, the user terminal 4 can inform the shooting device 1 of the wifi account number and the password of the network to be connected, the connection of the network and the data networking are completed, and meanwhile, the convenient transmission way of the hotspot data transmission can conveniently and quickly complete the configuration of the starting setting on the terminal interface of the user terminal 4.

The camera 1 further comprises an infrared sensor 15 facing the front of the camera unit 12,

after the shooting device 1 is started, the first processing module 11 senses whether a human body is sheltered in front of the first processing module before executing a preset shooting program, when the infrared sensor 15 detects that the human body is sheltered in front, the first processing module 11 suspends the shooting program, and when the infrared sensor 15 detects that the human body is not sheltered in front, the preset shooting program is continuously executed. The complete original appearance of the goods shelf can be accurately shot, so that the quantity of goods is more accurately identified. The problem of misinformation is avoided.

The infrared sensor 15 independently supplies power, and under the state that the shooting device 1 is shut down, the infrared sensor 15 arranged on the shooting device 1 monitors whether a human body is sheltered in the front of the infrared sensor 15 in real time, and when the infrared sensor 15 detects that the human body is sheltered in the front, the shooting device 1 is waken up to be started up when the infrared sensor 15 detects that no human body is sheltered in the front again, and a preset shooting program is executed.

When the shooting device 1 uploads the shot picture to a background server 2 in communication connection with the shooting device, a processing module I11 simultaneously binds the equipment number and the picture and sends the binding together to the background server 2, and the equipment number is bound with the information of the geographical position where the shooting device 1 is located and the shelf number;

the background server 2 identifies the category of the stored latest photo image and the remaining quantity of the corresponding category of articles on the shelf, when the remaining quantity of one or more types of articles is less than the preset quantity, the type of articles is in a stock shortage state, the second processing module 21 of the background server 2 reads the equipment number of the shooting device 1 bound with the photo, searches the geographical position and shelf number information of the shooting device 1 bound with the equipment number and stored in the storage module 23 according to the equipment number, the second processing module 21 packs the geographical position and shelf number information of the shooting device 1, the category of the articles in the stock shortage state and the remaining quantity of the articles corresponding to the stock shortage category into stock replenishment reminding information, and the second communication module 22 of the background server 2 sends the stock replenishment reminding information to the management terminal 3.

The manager sends through the packing shooting device 1 geographical position, goods shelves number information, be in the article classification of out-of-stock state, and the replenishment reminding information of the surplus quantity of the article that corresponds out-of-stock classification, can know the article and the quantity of out-of-stock fast, make preparation, and can accurately supply corresponding goods shelves when delivery, replenishment, make things convenient for delivery, this replenishment is reminded just very conveniently, accurately to the business office of interlocking type, conveniently look over.

The shooting unit 12 is a camera for shooting an image of a shelf in front of the supermarket shelf monitoring device.

As shown in fig. 2 and 3, the processing module 11 is further disclosed in detail, and the processing module 11 includes:

the processor 5 is coupled with the camera to realize signal connection of the camera and the camera, and is used for controlling the camera to shoot and uploading the image to the background server 2 in communication connection with the camera after the camera shoots the image;

the first communication module 14 is coupled to the processor 5 and configured to establish an external communication connection of the processor 5;

the dial switch K2 has an input end and an output end, the input end is coupled to the direct current VIN, and the output end is connected in series with an inductor R19 and a capacitor C6 in sequence and then grounded;

a P-channel MOS transistor Q2, having a gate G coupled between the inductor R19 and the capacitor C6, and a source S coupled to the direct current VIN;

as shown in fig. 2 and 5, the DC-DC synchronous buck converter 6 has a control terminal EN1, a power input terminal U18, a power output terminal SW1, and a power output terminal SW2, wherein the control terminal EN1 is coupled to the output terminal of the dial switch K2, the power input terminal U18 is coupled to the drain D of the P-channel MOS transistor Q2, and the power output terminal SW1 and the power output terminal SW2 are used for outputting different power supplies after voltage reduction and are coupled to the processor 5;

as shown in fig. 2 and 3, an NPN transistor Q1 having an emitter E grounded, a collector C coupled to the gate G of the P-channel MOS transistor Q2, a base B connected in series with a resistor R1 and coupled to the power control terminal PWR _ HOLD of the processor 5, the base B being turned on after the processor 5 is turned on, for keeping the P-channel MOS transistor Q2 turned on when the processor 5 turns on the base B;

as shown in fig. 2 and 4, the RTC alarm clock 13 chip has a wake-up output FOUT coupled to the gate G of the P-channel MOS transistor Q2, a serial clock terminal I2C1_ SCL, a serial data terminal I2C1_ SDA, a serial clock terminal I2C1_ SCL, and a serial data terminal I2C1_ SDA for setting an alarm clock and transmitting data in both directions, and is coupled to the processor 5.

As shown in fig. 1 and fig. 2, the processor 5 is coupled to the infrared sensor 15, and outputs a high level signal to the processor 5 when the infrared sensor 15 detects that there is a human body blocking in front;

after the unmanned supermarket shelf monitoring device is started, the infrared sensor 15 firstly senses whether a human body is sheltered in front of the processor 5 before the processor 5 executes a preset photographing program, when the infrared sensor 15 detects that the human body is sheltered in front, the processor 5 suspends the program of photographing the picture, and when the infrared sensor 15 detects that the human body is not sheltered in front, the preset photographing program is continuously executed.

As shown in fig. 3, the input terminal of the dial switch K2 is connected in series with a TVS transistor R13 and then grounded. When the two ends of the TVS tube are subjected to instantaneous high-energy impact, the TVS tube can cause the impedance thereof to be suddenly reduced at a very high speed (up to 1 x 10-12 seconds), and simultaneously absorb a large current to clamp the voltage between the two ends thereof at a predetermined value, thereby ensuring that the following circuit elements are protected from the instantaneous high-energy impact.

As shown in fig. 4, the RTC alarm clock 13 chip further has a power input terminal VDD, the power input terminal VDD is connected in series with a resistor R26 and a button battery B2 and then grounded, and the power input terminal VDD is connected in series with a capacitor C2 and then grounded. The button battery B2 is used as an independent power supply, so that the reliability is high, the separation from the lithium battery power supply borrowed by the processor 5 is realized, the energy is saved, and the processor 5 can be accurately activated to wake up.

As shown in fig. 1 and fig. 2, the circuit principle of the first power-on and factory setting of the processing module one 11 is as follows:

when the electronic ballast is used for the first time, after the dial switch K2 is dialed to be in a conducting state, the output end of the dial switch K2 outputs a high level, the control end EN1 of the DC-DC synchronous buck converter 6 inputs the high level, and simultaneously, under the action of an oscillation circuit formed by an inductor R19 and a capacitor C6, a high voltage exceeding the starting voltage of a P-channel MOS transistor Q2 is generated for 1s, the P-channel MOS transistor Q2 is conducted, the power input end U18 of the DC-DC synchronous buck converter 6 inputs the high level, the DC-DC synchronous buck converter 6 conducts and works, a CPU of the processor 5 is powered on to operate, and meanwhile, a power control end PWR _ HOLD of the processor 5 is conducted to maintain the starting state of an NPN transistor Q1 coupled with the processor, so that the P-channel MOS transistor Q2 keeps in a conducting state;

after the processor 5 is conducted, setting starting settings for the processor 5 and the RTC alarm clock 13, controlling the wifi module to send out a hot spot by the processor 5, and setting the starting settings through a terminal interface of the user terminal 4 after the user terminal 4 is connected with the hot spot; the method comprises the steps that a wifi account, a password and a preset standby time interval starting setting are input through a terminal interface of a user terminal 4, and are transmitted to a wifi module through a hot spot connected with the user terminal 4; the processor 5 is connected with a wifi network in the area according to the wifi account and the password received by the wifi module, so as to realize network connection with the background server 2; the processor 5 is set into the RTC alarm clock 13 according to the preset standby time interval received by the wifi module, and the RTC alarm clock 13 wakes up the processor 5 to start up every preset standby time interval; then the processor 5 executes a preset photographing program;

before the processor 5 executes the photographing program, the infrared sensor 15 coupled with the photographing device 1 senses whether a human body is shielded in front of the infrared sensor 15, when the infrared sensor 15 detects that the human body is shielded in front, the processor 5 suspends the photographing program, and when the infrared sensor 15 detects that no human body is shielded in front, the preset photographing program is continuously executed;

the processor 5 binds the device number with the photo after taking the photo, and uploads the photo bound with the device number to the background server 2 in communication connection with the processor, after the processor 5 verifies that the photo is uploaded successfully, the processor 5 disconnects the power control gate terminal PWR _ HOLD of the processor, the gate G of the P-channel MOS tube Q2 coupled with the power control gate terminal PWR _ HOLD is disconnected, the P-channel MOS tube is disconnected, then the DC-DC synchronous buck converter 6 is disconnected, the processor 5 is further powered off and shut down, and waits to be awakened by the RTC alarm clock 13 next time.

Awaken processing module 11 through the follow-up timing of RTC alarm clock 13 chip, the circuit principle of shooting of starting up through processing module 11 is:

after the RTC alarm clock 13 reaches the timed interval time, the wake-up output end FOUT of the RTC alarm clock 13 is conducted, 1s of high voltage exceeding the starting voltage of a P-channel MOS tube Q2 is generated under the action of an oscillating circuit formed by an inductor R19 and a capacitor C6, the P-channel MOS tube Q2 is conducted, the power input end U18 of the DC-DC synchronous buck converter 6 inputs high level, the DC-DC synchronous buck converter 6 is conducted to work, a CPU of the processor 5 is powered to operate, meanwhile, a power control end PWR _ HOLD of the processor 5 is conducted, the starting state of an NPN triode Q1 coupled with the processor is maintained, and the P-channel MOS tube Q2 is kept in a conducting state;

As shown in fig. 6, the processing chip of the processor 5 is a haisi chip of a Hi3516EV100 model.

As shown in fig. 4, the RTC alarm clock 13 chip is a clock chip of ISL1208 model. The clock chip of the ISL1208 model can be well matched with the Haesi chip of the Hi3516EV100 model, and alarm clock setting is achieved.

As shown in FIG. 2, processor 5 may be coupled to RTC alarm clock 13 chip, infrared sensor 15 via I2C bus. The I2C bus is a simple, bi-directional two-wire synchronous serial bus developed by Philips. It requires only two wires to transfer information between devices connected to the bus.

The SDA (serial data line) and the SCL (serial clock line) are both bidirectional I/O lines, and the interface circuit is an open-drain output. The power source VCC is connected through a pull-up resistor. When the bus is idle. Both lines are high level, the same devices connected with the bus are CMOS devices, and the output stage is also an open drain circuit. The current consumed on the bus is small and therefore the number of devices that extend on the bus is determined primarily by the capacitive load, since each device has a bus interface with a certain equivalent capacitance.

As shown in fig. 5, the DC-DC synchronous buck converter 6 is a synchronous DC-DC buck converter of the MP2122 type.

The MP2122 type synchronous DC-DC buck converter can provide the lowest adjustable output voltage of 0.608V and the maximum current output of 2A within the input voltage range of 2.7V to 6V, and the internal synchronous low-on-resistance power switch can improve the performance and eliminate the external components of T-base diode. And the product characteristics of 180 DEG Phase-shift Operation (180 DEG Phase-Shifted Operation), 100% Duty Cycle Operation (100% Duty-Cycle Operation), Cycle-by-Cycle overcurrent protection, short-circuit protection and over-temperature protection.

As shown in fig. 2 and 3, when the infrared sensor 15 detects that there is a human body blocking in front, its signal output terminal S _ out outputs a high level signal;

a delay circuit 7, the input end of which is coupled to the signal output end S _ out of the infrared sensor 15, for delaying the signal output by the signal output end S _ out of the infrared sensor 15 and outputting a delayed signal at the output end thereof;

an input end of the NOT gate NOT is coupled to the signal output end S _ out of the infrared sensor 15;

an AND gate AND having two input terminals coupled to the output terminals of the delay circuit 7 AND the NOT gate NOT, respectively, AND an output terminal;

the gate G of the P-channel MOS transistor Q3 is coupled to the output terminal of the AND gate AND, the source S thereof is coupled to the direct current VIN, AND the drain D thereof is coupled to the power input terminal U18 of the DC-DC synchronous buck converter 6. The gate-on voltage of the P-channel MOS transistor Q3 is lower than that of the P-channel MOS transistor Q2, AND the P-channel MOS transistor Q3 can be turned on by a high level from the AND gate AND.

Awaken processing module 11 through infrared sensor 15 follow-up timing, the circuit principle of taking a picture of starting up through processing module 11 does:

the infrared sensor 15 is powered by a separate power supply and can be directly coupled with direct current VIN, namely, a built-in lithium battery supplies power; when the infrared sensor 15 detects that a person is in front, the output end of the infrared sensor 15 outputs a high level, AND due to the function of the delay signal of the delay circuit 7, the output end of the delay circuit 7 also outputs a low level, AND the output end of the AND gate keeps outputting the low level; when a person walks in front of the shelf, the output end of the infrared sensor 15 is converted into a low level output, the output end of the NOT outputs a high level, after the time of the delay signal of the delay circuit 7 reaches one cycle, the output terminal of the delay circuit 7 outputs a high level, the output terminal of the AND gate AND is turned to output a high level, the P-channel MOS transistor Q3 is turned on, thereby supplying power to the DC-DC synchronous buck converter 6 through the P-channel MOS tube Q3, the processor 5 is conducted to execute the preset photographing program, after the signal delay time of the delay circuit 7 is reached, the delay circuit 7 recovers the low level output, the AND gate AND disconnects the P-channel MOS transistor Q3, before that, the processor 5 turns on its power control terminal PWR _ HOLD, maintains the on state of the NPN transistor Q1 coupled thereto, so that the P-channel MOS transistor Q2 keeps the conducting state, and the DC-DC synchronous buck converter 6 and the processor 5 are continuously conducted;

then the processor 5 executes a preset photographing program; before the processor 5 executes the photographing program, the infrared sensor 15 coupled with the photographing device 1 senses whether a human body is shielded in front of the infrared sensor 15, when the infrared sensor 15 detects that the human body is shielded in front, the processor 5 suspends the photographing program, and when the infrared sensor 15 detects that no human body is shielded in front, the preset photographing program is continuously executed;

the processor 5 binds the device number with the picture after taking the picture, uploads the picture bound with the device number to the background server 2 in communication connection with the processor, after the processor 5 verifies that the picture uploading is successful, the processor 5 disconnects the power control gate terminal PWR _ HOLD of the processor, the grid G of the P-channel MOS tube Q2 coupled with the power control gate terminal PWR _ HOLD is disconnected, the P-channel MOS tube is disconnected, then the DC-DC synchronous buck converter 6 is disconnected, the processor 5 is further disconnected and powered off, and waits for being awakened by the infrared sensor 15 next time.

Those of skill would further appreciate that the various illustrative logical blocks, configurations, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, configurations, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The various illustrative logics, logical blocks, modules, and circuits described in connection with the embodiments disclosed herein may be implemented or performed with: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. Additionally, at least one processor may comprise one or more modules operable to perform one or more of the steps and/or actions described above.

Additionally, the steps and/or actions of a method or algorithm described in connection with the aspects disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium may be coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. In addition, in some aspects, the processor and the storage medium may reside in an ASIC. Additionally, the ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal. Additionally, in some aspects, the steps and/or actions of a method or algorithm may reside as one or any combination or set of codes and/or instructions on a machine readable medium and/or computer readable medium, which may be incorporated into a computer program product.

The above description is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments, and all technical solutions belonging to the idea of the present invention belong to the protection scope of the present invention. It should be noted that modifications and embellishments within the scope of the invention may occur to those skilled in the art without departing from the principle of the invention, and are considered to be within the scope of the invention. Furthermore, to the extent that the term "includes" is used in either the detailed description or the claims, such term is intended to be inclusive in a manner similar to the term "comprising" as "comprising" is interpreted when employed as a transitional word in a claim. Furthermore, although elements of the described aspects and/or embodiments may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated. Additionally, all or a portion of any aspect and/or embodiment may be utilized with all or a portion of any other aspect and/or embodiment, unless stated otherwise.

Claims

1. An unmanned supermarket shelf monitoring system is characterized by comprising a shooting device (1), a background server (2) and a management terminal (3);

the shooting device (1) comprises a processing module I (11), a shooting unit (12) coupled with the processing module I (11), an RTC alarm clock (13) and a communication module I (14), and is used for shooting and uploading a photo image to the background server (2), wherein the photo image can display the types of articles on a shelf of the unmanned supermarket and the residual quantity of the articles in the corresponding types;

the background server (2) comprises a second processing module (21), a second communication module (22), a storage module (23) and an image recognition module (24), wherein the second communication module is coupled with the second processing module (21), and the image recognition module is used for recognizing the types of the articles on the shelves of the unmanned supermarket and the residual quantity of the articles corresponding to the types by the photo images and sending the packaged replenishment reminding information to the management terminal (3);

the management terminal (3) comprises a third processing module (31), a display unit (32) and a third communication module (33), wherein the display unit (32) and the third communication module (33) are coupled with the third processing module (31) and are used for displaying the packed replenishment reminding information sent by the background server (2) and preparing goods with corresponding quantities according to the residual quantity of the goods in the stock shortage category in the replenishment reminding information;

the second communication module (22) is in communication connection with the first communication module (14) and the third communication module (33);

after the shooting device (1) is started, the processing module I (11) executes a preset shooting program to control the shooting unit (12) to shoot photos, the processing module I (11) sends photo images shot by the shooting unit (12) to the background server (2) through the communication connection between the communication module I (14) and the communication module II (22), and the photo images received by the communication module II (22) are stored in a storage module (23) coupled with the processing module II (21);

the image recognition module (24) performs image recognition on the latest photo image stored in the storage module (23), and when the number of the articles on the shelf is recognized to be less than the preset number, the second processing module (21) sends the replenishment reminding information to the management terminal (3) through the communication connection between the second communication module (22) and the third communication module (33);

after the communication module III (33) receives the replenishment reminding information, the processing module III (31) of the management terminal (3) transmits and displays the replenishment reminding information on the display unit (32);

the processing module I (11) of the shooting device (1) is automatically shut down after the photo image is successfully uploaded;

the RTC alarm clock (13) arranged in the shooting device (1) wakes up the shooting device (1) again after a preset standby time interval;

the shooting device (1) further comprises an infrared sensor (15) which is right opposite to the front of the shooting unit (12);

the shooting device (1) is in a starting state, the first processing module (11) senses whether a human body is shielded in front of the first processing module before executing a preset shooting program, when the infrared sensor (15) detects that the human body is shielded in front, the first processing module (11) suspends the program for shooting the picture, and when the infrared sensor (15) detects that the human body is not shielded in front, the preset shooting program is continuously executed;

the infrared sensor (15) arranged on the shooting device (1) is independently powered, in the shutdown state of the shooting device (1), the infrared sensor (15) arranged on the shooting device (1) monitors whether a human body is shielded in front of the infrared sensor in real time, when the infrared sensor (15) detects that the human body is shielded in front, the shooting device (1) is waken up to be started up when the infrared sensor (15) detects that the human body is not shielded in front again, and a preset shooting program is executed;

when the shooting device (1) uploads the shot pictures to the background server (2) in communication connection with the shooting device, the processing module I (11) simultaneously binds the equipment number of the shooting device with the pictures and sends the binding information to the background server (2), and the equipment number is bound with the information of the geographical position where the shooting device (1) is located and the shelf number;

the method comprises the steps that the background server (2) identifies the type of articles on a goods shelf and the residual quantity of the corresponding type of articles according to a stored latest photo image, when the residual quantity of one or more types of articles is less than the preset quantity, the type of articles is in a goods shortage state, a second processing module (21) of the background server (2) reads the equipment number of the shooting device (1) bound with the photo, searches the geographical position and the goods shelf number information of the shooting device (1) bound with the equipment number and stored in a storage module (23) according to the equipment number, the second processing module (21) packs the geographical position, the goods shelf number information, the type of the articles in the goods shortage state and the residual quantity of the articles corresponding to the goods shortage type into the goods replenishment reminding information, and the second communication module (22) of the background server (2) sends the replenishment reminding information To the management terminal (3);

the first processing module (11) comprises:

the processor (5) is coupled with the shooting unit (12) to realize signal connection between the shooting unit and the shooting unit;

a DC-DC synchronous buck converter (6) having a control terminal EN1, a power input terminal U18, a power output terminal SW1, a power output terminal SW2, a control terminal EN1 coupled to the output terminal of the dial switch K2, a power input terminal U18 coupled to the drain D of the P-channel MOS transistor Q2, a power output terminal SW1, a power output terminal SW2 for outputting different power supplies after voltage reduction and coupled to the processor (5);

an NPN transistor Q1 having an emitter E grounded, a collector C coupled to the gate G of the P-channel MOS transistor Q2, a base B connected in series with a resistor R1 and coupled to the power control terminal PWR _ HOLD of the processor (5), the base B being turned on after the processor (5) is turned on, for keeping the P-channel MOS transistor Q2 turned on when the processor (5) turns on the base B;

when the DC-DC synchronous buck converter (6) is powered off, the processor (5) is further powered off and shut down to wait for being awakened by the infrared sensor (15) next time;

when the infrared sensor (15) detects that a human body is blocked in front, the signal output end S _ out outputs a high-level signal;

the first processing module (11) further comprises:

a delay circuit (7), the input end of which is coupled to the signal output end S _ out of the infrared sensor (15), for delaying the signal output by the signal output end S _ out of the infrared sensor (15) and outputting a delayed signal at the output end thereof;

an NOT with an input end coupled to the signal output end S _ out of the infrared sensor (15);

an AND gate AND having two inputs coupled to the delay circuit (7) AND the output of the NOT gate respectively, AND an output;

a P-channel MOS transistor Q3, a gate G of which is coupled to the output terminal of the AND gate AND, a source S of which is coupled to the direct current VIN, a drain D of which is coupled to the power input terminal U18 of the DC-DC synchronous buck converter (6), a gate turn-on voltage of the P-channel MOS transistor Q3 being lower than the P-channel MOS transistor Q2 AND being turned on by a high level from the AND gate AND;

when the infrared sensor (15) detects that a person is in front, the output end of the infrared sensor (15) outputs a high level, due to the function of a delay signal of the delay circuit (7), the output end of the delay circuit (7) also outputs a low level, AND the output end of the AND gate keeps outputting the low level; when a person walks in front of a shelf, the output end of the infrared sensor (15) is switched to output a low level, the output end of the NOT is switched to output a high level, after the time of a delay signal of the delay circuit (7) reaches a period, the output end of the delay circuit (7) outputs a high level, the output end of the AND gate AND is switched to output a high level, the P-channel MOS tube Q3 is conducted, the DC-DC synchronous buck converter (6) is powered AND conducted through the P-channel MOS tube Q3, AND the processor (5) is conducted to execute a preset photographing program;

the device number of the processor (5) is bound with the photo after the photo is shot by the processor (5), the photo bound with the device number is uploaded to a background server (2) in communication connection with the processor, after the processor (5) verifies that the photo is uploaded successfully, the processor (5) disconnects a power control switch end PWR _ HOLD, a grid G of a P-channel MOS tube Q2 coupled with the power control switch end PWR _ HOLD is broken, the P-channel MOS tube is turned off, then the DC-DC synchronous buck converter (6) is powered off, and the processor (5) is further powered off and shut down to wait for being awakened by an infrared sensor (15) next time.

2. An unmanned supermarket shelf monitoring system according to claim 1, characterized in that the system further comprises a user terminal (4), the first communication module (14) is a wifi module coupled with the first processing module (11);

when the starting setting is set for the shooting device (1), the processing module I (11) controls the wifi module to send out a hot spot, and after the user terminal (4) is connected with the hot spot, the starting setting is set through a terminal interface of the user terminal (4);

the wifi account and the password input through the terminal interface of the user terminal (4) and the starting setting of the preset standby time interval are transmitted to the wifi module through the hot spot connected with the user terminal (4);

the shooting device (1) is connected with a wifi network in the area according to the wifi account and the password received by the wifi module, so that network connection with the background server (2) is achieved;

the processing module I (11) of the shooting device (1) sets the preset standby time interval received by the wifi module into the RTC alarm clock (13), and the RTC alarm clock (13) wakes up the shooting device (1) to be started through the preset standby time interval at each interval.

3. A control method of an unmanned supermarket shelf monitoring system, characterized by being implemented based on an unmanned supermarket shelf monitoring system according to any one of claims 1-2.