CN113627418A

CN113627418A - Data management method, computer device, and computer-readable storage medium

Info

Publication number: CN113627418A
Application number: CN202010377338.4A
Authority: CN
Inventors: 李昂阳
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2020-05-07
Filing date: 2020-05-07
Publication date: 2021-11-09
Anticipated expiration: 2040-05-07
Also published as: CN113627418B

Abstract

The application discloses a data management method, computer equipment and a computer readable storage medium, relates to the technical field of image processing, and is beneficial to improving the accuracy of acquired goods data. The data management method disclosed by the application comprises the following steps: after an image shot by a camera in the mobile equipment is acquired, the image is preliminarily recognized, when the image is determined to include a target identifier of a shelf (used for representing the integrity of the shelf), goods in the shelf represented by the target identifier are recognized according to a preset recognition algorithm to acquire goods data of the shelf, and the method is beneficial to improving the accuracy of the acquired goods data.

Description

Data management method, computer device, and computer-readable storage medium

Technical Field

The present application relates to the field of data processing technologies, and in particular, to a data management method, a computer device, and a computer-readable storage medium.

Background

Stores, supermarkets, factories or storehouses are usually provided with shelves for placing goods. The manager needs to collect information of the goods on each shelf to know the conditions (such as the quantity of the goods, the arrangement of the goods, etc.) on each shelf.

At present, the method for collecting information of goods on a shelf comprises the following steps: installing a camera (such as a spherical monitoring camera) on the goods shelf, regularly shooting images of goods on the goods shelf by the camera, and sending the images to a server; subsequently, the server identifies the item in the image. However, due to the influence of factors such as the installation angle, the camera may not be able to photograph all the goods on the shelf, and thus, the information accuracy of the server for identifying the goods is low.

Disclosure of Invention

The application provides a data management method, computer equipment and a computer readable storage medium, which solve the problem that the information accuracy of a server for identifying goods according to images is low.

In a first aspect, a data management method is provided, the method including: and acquiring an image, wherein the image is shot by a camera arranged in the mobile equipment. Determining that the image includes the target identification of the shelf. The target mark is used for representing the integrity of the goods shelf and identifying the goods on the goods shelf in the image according to a preset identification algorithm.

It can be seen that, in the data management method provided by the application, after determining that the image includes the target identifier of the shelf, the goods on the shelf in the image are identified. That is, only in the case where the image includes a complete shelf, the item of the shelf in the image is identified, effectively improving the accuracy of the information of the identified item.

Further, since the image capturing device in the embodiment of the present application is movable, even if the position of the shelf is changed, the image capturing device is not affected. The image acquisition device is not arranged on the goods shelf, so that the image acquisition device is not influenced by the mounting/dismounting of the goods shelf. Compared with the mode of installing a camera on a goods shelf in the prior art, the installation mode provided by the embodiment of the application is more convenient.

According to a first aspect, in a first possible implementation manner of the first aspect, the determined image comprises at least two identifications, each of the at least two identifications being used for uniquely identifying the shelf.

According to the first aspect to the first implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the shelf is a rectangular shelf, and the method for determining that the image includes the target identifier includes: determining that the image comprises n (n is an integer greater than or equal to 2) identifiers, and at least two identifiers in the n identifiers are respectively positioned at a first position and a second position of the rectangular shelf. An included angle between a connecting line of the first position and the second position and a horizontal line is within a preset angle range, and the distance between the first position and the second position is smaller than a preset distance. Each of the n identifiers uniquely identifies the rectangular shelf.

Thus, for a rectangular shelf, two identifiers are used, the two identifiers are respectively arranged near the vertex of the same diagonal line of the rectangular shelf (that is, the included angle between the connecting line of the first position and the second position and the horizontal line is within the preset angle range, and the distance between the first position and the second position is greater than or equal to the preset distance), when the acquired image simultaneously includes the two identifiers, it is indicated that the length of the acquired image of the rectangular shelf and the length in the complete image of the shelf are less than or equal to a first threshold, and the width of the acquired image of the rectangular shelf and the width in the complete image of the shelf are less than or equal to a second threshold. Thus, the image capture device may determine that the captured image includes a complete image of the shelf.

According to a fourth possible implementation form of the second aspect as such or according to any of the preceding implementation forms of the first aspect, the first position and the second position are located on a same diagonal of the rectangular shelf, and the distance between the first position and the second position is equal to the length of the diagonal.

According to the first aspect to the third implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, the data management method further includes: and when the quantity of the goods is less than the preset threshold value, sending out alarm information.

According to the first aspect to the fourth implementation manner of the first aspect, in a fifth possible implementation manner of the first aspect, the data management method further includes: the method comprises the steps of obtaining a historical movement track of the camera, wherein the historical movement track comprises a plurality of track points and the time corresponding to each track point in the plurality of track points. And determining the hot spot moving track of the camera according to the time corresponding to each track point in the plurality of track points. Therefore, the manager can identify the user preference according to the determined hot spot moving track and arrange the sales promotion commodities on the shelves near the hot spot moving track or the hot spot area according to the user preference.

In a second aspect, a data management method is provided, which is applied to a data management system including a mobile image acquisition device and a processing device. Specifically, the mobile image capturing device acquires an image and, upon determining that the acquired image includes a target identifier of the shelf (for characterizing the integrity of the shelf), sends the image to the processing device for recognition by the processing device.

According to a second aspect, in a first possible implementation of the second aspect, the determined image comprises at least two identifications, each of the at least two identifications being used to uniquely identify the shelf.

In a second possible implementation manner of the second aspect, the shelf is a rectangular shelf, and the determining that the image includes the target identifier includes: the image is determined to comprise n marks, and at least two marks in the n marks are respectively positioned at the first position and the second position of the rectangular shelf. An included angle between a connecting line of the first position and the second position and a horizontal line is within a preset angle range, and the distance between the first position and the second position is smaller than a preset distance. Each of the n identifiers uniquely identifies the rectangular shelf, and n is an integer greater than or equal to 2.

In a third possible implementation form of the second aspect according to the second implementation form of the second aspect, the first position and the second position are located on a same diagonal of the rectangular shelf, and the distance between the first position and the second position is equal to the length of the diagonal.

In a third aspect, a processing device is provided, which is operable to perform any of the methods provided in any of the possible implementations of the first aspect. The present application may divide the functional modules of the processing apparatus according to any one of the methods provided by the first aspect. For example, each functional unit may be divided for each function, or two or more functions may be integrated into one processing unit.

In a fourth aspect, an image capture device is provided that is operable to perform any of the methods provided in any of the possible implementations of the second aspect through the second aspect described above. The present application may perform functional module division on the image capturing apparatus according to any one of the methods provided by the first aspect. For example, each functional unit may be divided for each function, or two or more functions may be integrated into one processing unit.

In a fifth aspect, the present application provides a computer device comprising a memory and a processor. The memory is coupled to the processor. The memory is for storing computer program code comprising computer instructions. When executed by a processor, the computer device performs the method according to any one of the possible implementations of the first aspect to the second aspect.

In a sixth aspect, the present application provides a chip system applied to a computer device, the chip system including one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected through a line; the interface circuit is to receive signals from a memory of the computer device and to send the signals to the processor, the signals including computer instructions stored in the memory. When the processor executes the computer instructions, the computer device performs the method according to any one of the possible implementations of the first aspect to the second aspect.

In a seventh aspect, the present application provides a computer-readable storage medium comprising computer instructions that, when executed on a computer device, cause the computer device to perform the method according to any one of the possible implementation manners of the first aspect to the second aspect.

In an eighth aspect, the present application provides a computer program product comprising computer instructions that, when run on a computer device, cause the computer device to perform the method according to any one of the possible implementations of the first aspect to the second aspect.

It is understood that any one of the processing devices, the image capturing device, the computer readable storage medium, the computer program product or the chip provided above may be applied to the corresponding method provided above, and therefore, the beneficial effects achieved by the method may refer to the beneficial effects in the corresponding method, and are not described herein again.

These and other aspects of the present application will be more readily apparent from the following description.

Drawings

Fig. 1 is a schematic structural diagram of a data management system to which the technical solution provided in the embodiment of the present application is applied;

fig. 2 is a schematic structural diagram of a computer device to which the technical solution provided by the embodiment of the present application is applied;

fig. 3 is a schematic flowchart of a data management method according to an embodiment of the present application;

FIG. 4 is a schematic diagram illustrating a positional relationship between a shopping cart and a camera according to an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of a location relationship between a shelf and a sign provided in an embodiment of the present application;

FIG. 6 is a schematic diagram of two rectangular shelf images provided by an embodiment of the present application;

FIG. 7 is a schematic view of an image provided by an embodiment of the present application;

FIG. 8 is a schematic view of a shelf image;

fig. 9 is a schematic flowchart of another data management method according to an embodiment of the present application;

FIG. 10 is a schematic diagram showing a track recorded by the image acquisition device in the supermarket plan;

fig. 11 is a schematic structural diagram of a processing apparatus according to an embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of an image capturing device according to an embodiment of the present application.

Detailed Description

In the embodiments of the present application, words such as "exemplary" or "for example" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.

In the embodiments of the present application, "at least one" means one or more. "plurality" means two or more.

In the embodiment of the present application, "and/or" is only one kind of association relationship describing an association object, and indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.

In an embodiment of the application, a combination comprises one or more objects.

The data management method provided by the embodiment of the application can be suitable for a data management system. Fig. 1 is a schematic structural diagram of a data management system to which the technical solution provided in the embodiment of the present application is applied. The data management system includes a processing device 10-1 and a plurality of mobile image acquisition devices 10-2. Fig. 1 illustrates an example of two moving image capturing devices. Wherein, the processing device 10-1 is connected with each mobile image acquisition device 10-2 through a network.

The mobile image capturing device 10-2 may be any device for capturing images. For example: cameras, snap-shots, video cameras, and the like.

Alternatively, the mobile image capturing device 10-2 may send the captured image to the processing device 10-1, or may recognize the captured image to determine whether the image includes the target identifier of the shelf. Upon determining that the image includes the target identification of the shelf, the image is sent to the processing device 10-1.

The processing device 10-1 may be configured to identify an image captured by the moving image capturing device 10-2 and identify items on the shelf when it is determined that the image includes a target identifier of the shelf; it is also possible to receive an image including the target identifier transmitted from the moving image pickup device 10-2 and identify the goods on the shelf after receiving the image.

The processing device 10-1 may be a terminal device or a server. The terminal device may be a palm computer, a notebook computer, a smart phone, a tablet computer, a desktop computer or other computing devices. The server may be one server, a server cluster composed of a plurality of servers, or a cloud computing service center.

In practical applications, the processing device 10-1 and the mobile image capturing device 10-2 may be integrated into a computer device, or may be two devices independent from each other, and the embodiment of the present application does not limit the positional relationship between the processing device 10-1 and the mobile image capturing device 10-2. The following description of the embodiment of the present application will be made by taking as an example a case where the processing device 10-1 and the moving image capturing device 10-2 are independent devices.

The basic hardware structure of the processing means 10-1 and the mobile image acquisition means 10-2 are similar and comprise the components comprised by the computer device 10 shown in fig. 2. The hardware configuration of the processing means 10-1 and the moving image capturing means 10-2 will be described below by taking the computer device 10 shown in fig. 2 as an example.

Fig. 2 is a schematic structural diagram of a computer device to which the technical solution provided in the embodiment of the present application is applied. The computer device 10 in fig. 2 includes, but is not limited to: a processor 101, a memory 102, an input unit 104, an interface unit 105, a power supply 106, and the like. Optionally, the computer device 10 further includes a camera 100, a display 104, and a positioning device 107.

The camera 100 is configured to capture an image and send the image to the processor 101. The processor 101 is a control center of the computer device, connects various parts of the entire computer device using various interfaces and lines, and performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 102 and calling data stored in the memory 102, thereby monitoring the computer device as a whole. Processor 101 may include one or more processing units; optionally, the processor 101 may integrate an application processor and a modem processor, wherein the application processor mainly handles operating systems, user interfaces, application programs, and the like, and the modem processor mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 101. If the computer apparatus 10 is a mobile image acquisition device 10-2, then the computer apparatus 10 further comprises a camera 100.

The memory 102 may be used to store software programs as well as various data. The memory 102 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one functional unit, and the like. Further, the memory 102 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Alternatively, the memory 102 may be a non-transitory computer readable storage medium, for example, a read-only memory (ROM), a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

The display 103 is used to display information input by the user or information provided to the user. The display 103 may include a display panel, which may be configured in the form of a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), or the like. If the computer device 10 is a processing apparatus 10-1, the computer device 10 may further comprise a display 103.

The input unit 104 may include a Graphics Processing Unit (GPU) that processes image data of still images or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display 103. The image frames processed by the graphics processor may be stored in the memory 102 (or other storage medium).

The interface unit 105 is an interface for connecting an external device to the computer apparatus 10. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 105 may be used to receive input (e.g., data information, etc.) from an external device and transmit the received input to one or more elements within the computer apparatus 10 or may be used to transmit data between the computer apparatus 10 and an external device.

A power supply 106 (e.g., a battery) may be used to supply power to the various components, and optionally, the power supply 106 may be logically connected to the processor 101 through a power management system, so that functions such as managing charging, discharging, and power consumption are implemented through the power management system.

The positioning device 107 may be used to record the trajectory of the moving image acquisition device 10-2. The positioning device may include: a Global Positioning System (GPS) device, and the like. If the computer device 10 is a mobile image acquisition apparatus 10-2, the computer device 10 further comprises a positioning apparatus 107.

Optionally, the computer instructions in the embodiments of the present application may also be referred to as application program code or system, which is not specifically limited in the embodiments of the present application.

It should be noted that the computer device shown in fig. 2 is only an example, and does not limit the computer device to which the embodiments of the present application are applicable. In actual implementation, the computer device may include more or fewer devices or components than those shown in FIG. 2.

Before describing the data management method provided by the embodiment of the present application in detail, an application scenario related to the embodiment of the present application is described first. The embodiment of the application can be applied to the following scenes:

market or supermarket application scenario: the shopping malls or supermarkets and the like are provided with goods shelves for placing goods. The manager needs to replenish the goods on the shelves or rearrange the goods on the shelves according to the information of the goods on each shelf.

The application scenario of the storehouse is as follows: goods shelves are arranged in the storeroom for placing goods. The manager needs to update the inventory information according to the goods information on each shelf, so that the purchasing is managed according to the inventory information subsequently.

Illustratively, in conjunction with FIG. 1, after the moving image capture device 10-2 captures an image, the image is sent to the processing device 10-1. The processing device 10-1 identifies the information of the goods placed on the shelves in the image according to a preset identification algorithm. Subsequently, the processing device 10-1 sends out alarm information based on the goods information of the shelf, and/or the processing device 10-1 updates the stock information based on the goods information of the shelf.

Factory application scenarios: goods shelves are placed in factories for placing goods. The manager needs to collect the goods information on each shelf and replenish the goods on the shelf according to the goods information.

Illustratively, in conjunction with fig. 1, in a production line of a factory, after an image is acquired by a moving image acquisition device 10-2, the acquired image is transmitted to a processing device 10-1. The processing device 10-1 identifies the information of the goods placed on the shelves in the image according to a preset identification algorithm. If the number of the goods in the goods information is smaller than the preset threshold value, the processing device 10-1 sends out alarm information for notifying a manager to replenish the goods on the shelf. Alternatively, the processing device 10-1 issues a replenishment instruction for instructing the automatic replenishment device to replenish the goods on the rack shown in the image. The automatic replenishment device can receive the replenishment instruction and replenish goods on the corresponding shelf according to the replenishment instruction.

The following description of the embodiments of the present application mainly takes supermarket application scenarios as examples.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The data management method provided by the embodiment of the application comprises the following two implementation modes:

the implementation mode I: the moving image pickup device 10-2 acquires (i.e., takes) an image and transmits the image to the processing device 10-1. The processing device 10-1, upon receiving the image, performs a preliminary identification of the image. When it is determined that the image includes a target identifier of the shelf (for characterizing the integrity of the shelf), the item in the shelf characterized by the target identifier is identified according to a preset identification algorithm.

Implementation mode II: the moving image pickup device 10-2 acquires (i.e., takes) an image and performs preliminary recognition on the image. When it is determined that the image includes the target identification of the shelf, the image is sent to the processing device 10-1. Subsequently, the processing device 10-1 identifies the goods in the shelf characterized by the target identifier according to a preset identification algorithm. The target identification is used to characterize the integrity of the shelf.

The above-described implementation I will now be explained.

Fig. 3 shows a flowchart of a data management method provided in an embodiment of the present application. As shown in fig. 3, the method may include the steps of:

s100: the moving image pickup device 10-2 acquires an image.

Wherein the mobile image capturing apparatus 10-2 may be mounted on a mobile device. Alternatively, the mobile image capturing device 10-2 itself is a mobile device capable of capturing images or video. That is, the moving image pickup device 10-2 in the embodiment of the present application is movable.

The mobile image capturing device 10-2 may be a combination of a mobile device and a camera, wherein the camera is a device that can acquire images. The embodiment of the present application does not limit the type of the camera. For example: the camera may be at least one of a gun type camera, a dome camera, a high definition smart dome camera, a pen container type camera, a single board camera, a flying saucer type camera, a key type camera, or a mobile phone type camera. The mobile device can be any one of a supermarket shopping cart, a supermarket cleaning cart, a supermarket shopping basket or a supermarket patrol car.

It should be noted that, in the embodiments of the present application, the position and the number of the cameras mounted on the mobile device are not limited.

The mobile device is exemplified as a shopping cart. As shown in fig. 4, which is a schematic diagram of a positional relationship between a shopping cart and a camera provided in an embodiment of the present application, in fig. 4, the camera 1 in the shopping cart 1 is installed on one side of the shopping cart 1, and the camera 2 is installed on the other side of the shopping cart 1. Thus, during the movement of the shopping cart 1, the camera 1 and the camera 2 can respectively shoot images of both sides of the shopping cart 1.

Because the image acquisition device in the embodiment of the application is movable, even if the position of the shelf is changed, the image acquisition device is not influenced to acquire images. The image acquisition device is not arranged on the goods shelf, so that the image acquisition device is not influenced by the mounting/dismounting of the goods shelf. Compared with the mode of installing a camera on a goods shelf in the prior art, the installation mode provided by the embodiment of the application is more convenient.

The shooting function of the moving image acquisition device 10-2 in the embodiment of the present application may be always in an on state, or may be switched between the on state and the off state according to actual requirements, which is not limited in the embodiment of the present application.

Optionally, the shooting function of the image capturing device 10-2 that moves when the first preset condition is met is switched from the off state to the on state, and starts to acquire an image. The preset condition may be at least one of a preset time, a preset location, or a preset signal.

When the first preset condition is that the time is the first preset time, if the current time is the first preset time, the processing device 10-1 sends an opening instruction to the moving image capturing device 10-2, so as to instruct to open the shooting function of the moving image capturing device 10-2, and start to acquire an image. Or when the current time is the preset time, the shooting function of the moving image acquisition device 10-2 is automatically started, and the image acquisition is started.

When the first preset condition is that the position of the mobile image capturing device 10-2 is the first preset position, the mobile image capturing device 10-2 further comprises a positioning device, and the positioning device can periodically and actively send the position of the mobile image capturing device 10-2 to the processing device 10-1. Alternatively, the processing device 10-1 periodically transmits a request message to the mobile image capturing device 10-2, the request message being used to acquire the position of the mobile image capturing device 10-2. The moving image pickup device 10-2 transmits the current position of the moving image pickup device 10-2 to the processing device 10-1 according to the request message. If the processing device 10-1 determines that the current position of the moving image capturing device 10-2 is the first preset position, it sends an opening instruction to the moving image capturing device 10-2 to instruct to open the shooting function of the moving image capturing device 10-2 and start to acquire an image. Or, if the current position of the moving image capturing device 10-2 is the first preset position, the shooting function of the moving image capturing device 10-2 is automatically turned on, and the image capturing is started.

When the first preset condition is that the acquired signal is a first preset signal, if the signal acquired by the moving image acquisition device 10-2 is the first preset signal, the shooting function of the moving image acquisition device 10-2 is automatically started. Illustratively, the first preset signal determines that the moving image capturing device 10-2 has moved itself, or the moving image capturing device 10-2 receives a start instruction sent by the processor. The mobile image capturing device 10-2 may further include a sensing device, and if the sensing device senses the movement, the photographing function of the mobile image capturing device 10-2 is automatically turned on and starts to capture an image. Alternatively, the moving image capture device 10-2 transmits the position to the processing device 10-1. If the processing device 10-1 determines that the moving image capturing device 10-2 has moved according to the position sent by the moving image capturing device 10-2, it sends an opening instruction to the moving image capturing device 10-2 to instruct to open the shooting function of the moving image capturing device 10-2 and start to acquire an image.

Optionally, the shooting function of the mobile image capturing device 10-2 is turned off when a second preset condition is met, and the capturing of the image is stopped. Specifically, the method comprises the following steps:

when the second preset condition is that the current time is the second preset time, if the current time is the second preset time, the shooting function of the mobile image capturing device 10-2 is turned off.

When the second preset condition is that the position of the moving image capturing device 10-2 is the second preset position, if the current position of the moving image capturing device 10-2 is the second preset position, the shooting function of the moving image capturing device 10-2 is turned off.

When the second preset condition is a second preset signal, if the second preset signal acquired by the moving image acquisition device 10-2 is the second preset signal, the shooting function of the moving image acquisition device 10-2 is turned off.

The moving image capturing device 10-2 may actively turn off the shooting function when the second preset condition is satisfied, or the processing device 10-1 may send an instruction to instruct the moving image capturing device 10-2 to turn off the shooting function. Specifically, with reference to the specific method for starting the shooting function of the mobile image capturing device 10-2 when the first preset condition is met, details are not repeated.

In this way, the moving image capturing device 10-2 turns on the photographing function when the first preset condition is satisfied, and turns off the photographing function when the second preset condition is satisfied. On the one hand, the energy consumption of the mobile image acquisition device 10-2 can be saved; on the other hand, redundant images acquired by the mobile image acquisition device 10-2 can be reduced.

In an application scene of a supermarket, the number of goods on a shelf cannot be changed in a non-working time period of the supermarket, and at the moment, if shelf images are still continuously shot, the obtained shelf images are redundant images. Therefore, turning off the photographing function of the moving image pickup device 10-2 during the non-operation period may save power consumption of the moving image pickup device 10-2 and reduce redundant images to be acquired.

S101: the moving image capturing device 10-2 sends an image to the processing device 10-1.

Specifically, the mobile image capturing apparatus 10-2 may periodically transmit an image to the processing apparatus 10-1, or the mobile image capturing apparatus 10-2 may transmit an image to the processing apparatus 10-1 after receiving a request message transmitted by the processing apparatus 10-1.

Alternatively, the mobile image capturing device 10-2 may filter the images according to the time of image capturing and the content included in the images, and only send the latest captured image to the processing device 10-1 for the images including the same shelf. Therefore, for the same shelf, the latest acquired image of the shelf can reflect the real condition of the goods in the current shelf more, and redundant images can be reduced.

S102: the processing device 10-1 determines that the image includes the target identification of the shelf.

After the image is acquired, the moving image capturing device 10-2 recognizes the image and determines whether the image includes the target identifier of the shelf. The target identifier is used to characterize the integrity of a shelf.

The target marks of different shelves are different in the embodiment of the application.

Optionally, the target identifier includes at least two identifiers, each identifier being used to uniquely identify one shelf. The two identifiers may be the same or different. The mark can be any one of a bar code, a two-dimensional code, a three-dimensional code (also called a three-dimensional code) digital mark, a character mark or a character string mark.

Specifically, the step of recognizing the image by the mobile image capturing device 10-2 and determining whether the image includes the target identifier of the shelf includes the following steps:

the method comprises the following steps: the moving image capture device 10-2 recognizes the markers in the image. Wherein the recognized mark comprises a first mark.

Step two: the mobile image acquisition device 10-2 obtains the target identifier of the shelf represented by the first identifier according to the corresponding relationship between each shelf identifier and the target identifier in the plurality of pre-stored shelf identifiers.

In one case, when the identifier on the shelf is a shelf identifier, the corresponding relationship between each shelf identifier in the shelf identifiers and the target identifier may be as shown in table 1 below:

TABLE 1

Shelf label	Object identification
		Identification of the goods shelf 1	2
Identification of the goods shelf 3	3

In table 1, the shelf identifier is 2, and the target identifier corresponding to the identifier of the shelf 1 represents that when the acquired image includes the identifiers of 2 shelves 1, the acquired image includes a complete image of the shelf 1. Other explanations are similar and will not be described again.

In another case, when the identifier on the shelf is a different identifier from the shelf identifier, the corresponding relationship between each shelf identifier of the shelf identifiers and the target identifier may be as shown in table 2 below:

TABLE 2

Shelf label	Object identification
		Identification of the goods shelf 1	Identification 1
Identification of the goods shelf 1	Identification 1
		Identification of the goods shelf 2	Identification A
Identification of the goods shelf 2	Identification B
		Identification of the goods shelf 2	Identification C

In table 2, the identifier of the shelf 1 represents the shelf 1, the target identifiers corresponding to the shelf 1 are two identifiers 1, and the target identifier represents that when the moving image capturing device 10-2 recognizes that the number of the identifiers 1 included in the image is greater than or equal to 2, the moving image capturing device 10-2 determines that the image includes a complete image of the shelf 1. The identifier of the shelf 2 in table 2 represents the shelf 2, and the target identifiers corresponding to the shelf 2 are identifier a, identifier B and identifier C, and the target identifier represents that when the moving image capturing device 10-2 recognizes that the image includes identifier a, identifier B and identifier C, the moving image capturing device 10-2 determines that the image includes a complete image of the shelf 2.

In another case, when the identifier on the shelf is a different identifier from the shelf identifier, the corresponding relationship between each shelf identifier of the shelf identifiers and the target identifier may be further as shown in the following table 3:

TABLE 3

In table 3, the identifier of the shelf 1 represents the shelf 1, the target identifiers corresponding to the shelf 1 are 2 identifiers 1, and the target identifier represents that when the moving image capturing device 10-2 recognizes that the number of the identifiers 1 included in the image is greater than or equal to 2, the moving image capturing device 10-2 determines that the image includes a complete image of the shelf 1. The identifier of the shelf 3 in table 3 represents the shelf 3, the target identifier corresponding to the shelf 3 is 3 identifiers 2, and the target identifier represents that when the moving image capturing device 10-2 recognizes that the image includes 3 identifiers 2, the moving image capturing device 10-2 determines that the image includes a complete image of the shelf 2.

Of course, the corresponding relationship between each shelf identifier in the shelf identifiers and the target identifier may also be in other storage forms, and it is within the scope of the present application that the integrity of the shelf represented by the identifier can be determined by the identifier and the number of the identifiers.

Step three: the image acquisition device 10-2 determines whether the integrity of the shelf represented by the first identifier is included in the image according to the identifier in the identified image and the target identifier of the shelf represented by the first identifier.

For example, a schematic diagram of the positional relationship between the shelf and the label is shown in fig. 5. Fig. 5 shows a pallet 1 and a pallet 3. Wherein the shelf 1 comprises two signs 1. The two identifiers 1 are target identifiers of the shelf 1. The shelf 3 comprises five labels 2. Five labels 2 are target labels of the shelves 3.

The shape of the shelf is not limited in the embodiments of the present application. Illustratively, the shelf may be any one of circular, rectangular, triangular, rectangular, or other polygonal shape.

Optionally, when the shelf is rectangular and at least two markers in the image including the shelf are located at the first position and the second position of the shelf, respectively, the mobile image capturing device 10-2 determines that the image includes a complete image of the shelf. An included angle between a connecting line of the first position and the second position and a horizontal line is within a preset angle range, and the distance between the first position and the second position is larger than or equal to a preset distance.

Optionally, the first position and the second position are located on the same diagonal of the rectangular shelf, and the first position and the second position are the vertices of the diagonal.

Thus, for a rectangular shelf, two identifiers are used, the two identifiers are respectively arranged near the vertex of the same diagonal line of the rectangular shelf (that is, the included angle between the connecting line of the first position and the second position and the horizontal line is within the preset angle range, and the distance between the first position and the second position is greater than or equal to the preset distance), when the acquired image simultaneously includes the two identifiers, it is indicated that the length of the acquired image of the rectangular shelf and the length in the complete image of the shelf are less than or equal to a first threshold, and the width of the acquired image of the rectangular shelf and the width in the complete image of the shelf are less than or equal to a second threshold. Thus, the moving image capture device 10-2 may determine that the captured image includes a complete image of the shelf.

Illustratively, fig. 6 is a schematic diagram of two rectangular shelf images provided by the embodiment of the present application: in fig. 6, the shelf 1 includes two marks 1, the two marks 1 are respectively located at a first position and a second position of the shelf 1, and an included angle between a connecting line of the first position and the second position and a horizontal line is less than or equal to α and greater than or equal to β. When the first position and the second position are within the dashed line frame shown in fig. 6, it is ensured that the distance between the first position and the second position is equal to or greater than the preset distance, and the moving image capturing device 10-2 determines that the image includes a complete image of the shelf 1. In fig. 6, the shelf 4 includes two marks 3, the two marks 3 are respectively located at a first position and a second position of the shelf 4, and an included angle between a connecting line of the first position and the second position and a horizontal line is less than or equal to α and greater than or equal to β. When the first position and the second position are within the dashed line frame shown in fig. 6, it is ensured that the distance between the first position and the second position is equal to or greater than the preset distance, and the moving image capturing device 10-2 determines that the image includes a complete image of the shelf 4.

S103: the processing device 10-1 identifies the items on the shelves in the image from the received image using a predetermined algorithm.

In one possible implementation manner, the preset identification algorithm is an algorithm for acquiring the type and the quantity of the goods based on the identification of the goods. The goods mark can be any one of a two-dimensional code, a bar code, a three-dimensional code, a number mark, a character mark or a character string mark and the like.

Illustratively, the processing device 10-1 identifying the items of the shelf 1 in the image by the identification of the items included in the image includes: the identity of 1 item a, the identity of 3 items B and the identity of 10 items C. The processing device 10-1 recognizing the goods of the shelf 1 in the image includes: 1 item a, 3 items B, and 10 items C.

In another possible implementation manner, the preset identification algorithm is an algorithm for acquiring the type and the quantity of the goods based on the image features.

Illustratively, the processing device 10-1 is pre-stored with a model for identifying the goods based on the image features, and the model can obtain the quantity of the goods and the identification of the goods in the image, i.e. the model is the above-mentioned preset identification algorithm. If the processing device 10-1 receives the image as shown in fig. 7, the processing device 10-1 may recognize that the image includes 2 items a, 4 items B, and 8 items C according to the pre-stored model for identifying the items.

In another possible implementation manner, the preset recognition algorithm is used for acquiring the type of the goods and the "ratio of the area of the goods to the area of the goods" based on the target identifier and the goods identifier. The area of the goods is the area of the area used for storing certain goods in the image, and the area of the goods is the area occupied by the goods in the image.

Specifically, the possible implementation manner includes the following steps:

the method comprises the following steps: the processing device 10-1 identifies the target identifier and the item identifier in the image, and obtains the area of each item in the image and the boundary coordinates of the item area of each item according to the target identifier and/or the item identifier.

Illustratively, the processing device 10-1 obtains the area of the article a by: the processing device 10-1 acquires coordinates of the article identification of the article a in an image coordinate system, which is a schematic view of a shelf image as shown in fig. 8, and the processing device 10-1 acquires the coordinates of the article identification of the article a in the image coordinate system as target coordinates including a target abscissa and a target ordinate. The processing device 10-1 acquires the coordinates of the identifier of the article C in the image coordinate system as second coordinates, and acquires the coordinates of the identifier 4 located near the y-axis in the image coordinate system as third coordinates. And the absolute value of the difference between the abscissa of the second coordinate and the target abscissa is greater than or equal to a first threshold value and less than or equal to a second threshold value. The absolute value of the difference between the ordinate of the second coordinate and the target ordinate is equal to or less than a third threshold value. The absolute value of the difference between the abscissa of the third coordinate and the target abscissa is equal to or less than a third threshold, and the absolute value of the difference between the ordinate of the third coordinate and the target ordinate is equal to or greater than a first threshold and equal to or less than a second threshold. And the second coordinate and the third coordinate are both coordinates of the target identifier or the goods identifier in the image coordinate system. The product of the absolute value of the difference between the abscissa of the second coordinate and the target abscissa and the absolute value of the difference between the ordinate of the third coordinate and the target ordinate is the area of the article a. The processing device 10-1 acquires the coordinates of the pixel point of the connection line of the target coordinates and the second coordinates.

Step two: the processing device 10-1 obtains the coordinates of the pixel points of each article in the image and the area of the article in the image according to the pre-stored model for identifying the article. According to the coordinates of the pixel points of the goods and the boundary coordinates of the goods area where the goods are located, the ratio of the area of the goods to the area of the goods area of the overlapping part of the area of the goods area where the goods are located and the goods area of the goods is obtained, and if the ratio is larger than or equal to a threshold value, the goods are determined to be located in the area.

Step three: the processing device 10-1 obtains the ratio of the total article area of the articles in the article area to the area of such articles.

Based on the example in step one, the shelf characterized by label 4 in FIG. 8 includes four item regions. The item region for item a, the item region for item B, the item region for item C, and the item region for item D. The area of the article a accounts for 13% of the area of the article region of the article a, the area of the article C accounts for 80% of the area of the article region of the article C, the area of the article B accounts for 50% of the area of the article region of the article B, and the area of the article D accounts for 0% of the area of the article region of the article D.

According to the data management method, the image is acquired through the mobile image acquisition device 10-2, the integrity of the image is judged by using the identification, then the goods on the goods shelf indicated by the target identification in the image including the target identification are identified, the accuracy of the information of the identified goods is improved, and the problem that the accuracy of the information of the identified goods is low due to the fact that the goods shelf is incomplete in the goods shelf image acquired by the mobile image acquisition device 10-2 for acquiring the goods shelf image due to the influence of factors such as installation angle at present is solved.

Further optionally, as shown in fig. 3, the method provided in the embodiment of the present application further includes S104.

S104: when the processing device 10-1 determines that the quantity of at least one type of goods in the shelf represented by the target identifier is smaller than a preset threshold value, or when the processing device 10-1 determines that the ratio of the total goods area of at least one type of goods in the shelf represented by the target identifier to the area of the kind of goods is smaller than or equal to a threshold value, alarm information is sent out. The alarm information may include the identification of the shelf, the type of the goods whose number is less than the preset threshold, and other out-of-stock information.

Optionally, the out-of-stock information includes at least one of a current quantity of the item or a quantity of the item requiring replenishment.

It should be noted that, in the embodiment of the present application, the alarm information may be shortage information on one shelf, shortage information on a shelf in one frame of image, or shortage information on multiple shelves.

Based on the example in S103, assuming that the preset threshold is 5, the processing device 10-1 issues warning information. The out-of-stock information in the alarm information includes the goods shelf 1, the goods A and the goods B.

The following describes the above embodiment II.

Fig. 9 is a schematic flow chart of another data management method according to an embodiment of the present application. The present embodiment can be applied to the data management system shown in fig. 1. The method shown in fig. 9 may include the steps of:

s200: the moving image pickup device 10-2 acquires an image.

Specifically, reference is made to the description in S100 above, and details are not repeated here.

S201: the moving image capture device 10-2 determines that the image includes the target identification of the shelf.

Upon receiving the image, the mobile image capturing device 10-2 recognizes the image and determines whether the image includes the target identifier of the shelf. The target identifier is used to characterize the integrity of a shelf.

Specifically, the moving image capturing device 10-2 determines whether the image of the shelf corresponding to the identifier in the image includes the target identifier according to the correspondence between each shelf identifier in the plurality of pre-stored shelf identifiers and the target identifier, so as to determine the integrity of the shelf in the image.

The target identifier, the shelf, and the corresponding relationship between each shelf identifier and the target identifier in the shelf identifiers may refer to the description in the step S102, and are not described again.

S202: the moving image capturing device 10-2 sends an image including the target identification of the shelf to the processing device 10-1.

Specifically, the mobile image capturing apparatus 10-2 may periodically transmit the image including the target identifier to the processing apparatus 10-1, or the mobile image capturing apparatus 10-2 may transmit the image including the target identifier to the processing apparatus 10-1 after receiving the request message transmitted by the processing apparatus 10-1.

Alternatively, the mobile image capturing device 10-2 may filter the images according to the time of capturing the image including the target identifier and the content included in the image including the target identifier, and only send the newly captured image including the target identifier to the processing device 10-1 for the image including the target identifier of the same shelf. Therefore, for the same shelf, the newly acquired image comprising the target identifier can better reflect the real condition of the goods in the current shelf, and redundant images can be reduced.

S203: the processing device 10-1 identifies the items on the shelves in the image from the received image using a predetermined algorithm.

Specifically, reference is made to the description of S103, which is not repeated.

Further optionally, as shown in fig. 9, the method provided in the embodiment of the present application further includes S204.

S204: when the processing device 10-1 determines that the quantity of the items of at least one type of items in the shelf represented by the target identifier is smaller than a preset threshold value, or when the processing device 10-1 determines that the ratio of the area of the items of at least one type of items in the shelf represented by the target identifier to the area of the items is smaller than or equal to a threshold value, alarm information is sent out. The alarm information may include the identification of the shelf, the type of the goods whose number is less than the preset threshold, and other out-of-stock information.

Optionally, the stock out information includes at least one of a current quantity of the at least one item or a quantity of the item requiring replenishment.

In the data management method provided by the embodiment of the application, the mobile image capturing device 10-2 may further include a positioning device. When the moving image capturing device 10-2 includes a positioning device, the processing device 10-1 may further obtain a current position of the moving image capturing device 10-2, or obtain a track point of the moving image capturing device 10-2, and determine a hot spot movement trajectory of the moving image capturing device 10-2 according to the obtained track point.

In one case: the moving image acquisition device 10-2 records the moving track of the moving image acquisition device during the moving process. The movement track comprises a plurality of track points (also called positions) and a plurality of time corresponding to the track points. The moving image acquisition device 10-2 determines the hot spot movement track of the moving image acquisition device 10-2 according to the plurality of track points and the time corresponding to each track point in the plurality of track points.

Specifically, the moving image capturing device 10-2 may count track points of the moving image capturing device 10-2 within a preset time period, determine track points of which the number of the same track points is greater than a third threshold as hot spot track points, and determine a moving track formed by the hot spot track points as a hot spot moving track of the moving image capturing device 10-2.

In another case: the moving image capturing device 10-2 sends the track point of the moving image capturing device 10-2 and the time corresponding to the track point to the processing device 10-1 during the moving process. The processing device 10-1 determines the hotspot moving trajectory of the moving image capturing device 10-2 according to the received multiple trace points of the moving image capturing device 10-2 and the time corresponding to each trace point in the multiple trace points. The moving image capturing device 10-2 may send track points to the processing device 10-1 at regular time, or the processing device 10-1 may send a request message to the moving image capturing device 10-2 at regular time, so that the moving image capturing device 10-2 feeds back the track points. This is not limited in the embodiments of the present application.

In another case: the processing device 10-1 may determine the hotspot moving trajectory of the image capturing device 10-2 moving in the entire supermarket according to the received multiple trajectory points of the multiple moving image capturing devices 10-2 and the time corresponding to each trajectory point of the multiple trajectory points.

Optionally, the supermarket plane icon may be marked as a plurality of areas, and the processing device 10-1 may determine the hot spot area in the entire supermarket according to the received plurality of track points of the plurality of moving image acquisition devices 10-2 and the time corresponding to each track point of the plurality of track points.

Illustratively, fig. 10 is a schematic diagram of a track recorded by the processing device 10-1 in a supermarket plan. Wherein the dotted line with arrow is the track recorded by the moving image capturing device 10-2. As can be seen from fig. 10, there are two tracks passing through the area a and 1 track passing through the area B, so that the area a is a hot spot area compared with the area B.

Therefore, the manager can identify the user preference according to the determined hot spot moving track and arrange the sales promotion commodities on the shelves near the hot spot moving track or the hot spot area according to the user preference.

The scheme provided by the embodiment of the application is mainly introduced from the perspective of a method. To implement the above functions, it includes hardware structures and/or software modules for performing the respective functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the exemplary method steps described in connection with the embodiments disclosed herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiment of the present application, the processing apparatus 10-1 may be divided into functional modules according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.

Fig. 11 is a schematic structural diagram of a processing apparatus according to an embodiment of the present disclosure. The processing device 90 may be configured to perform the functions performed by the processing device in any of the above embodiments (e.g., the embodiments shown in fig. 3 or fig. 9). The processing device 90 includes: an acquisition unit 901, a determination unit 902 and a recognition unit 903. Wherein, the obtaining unit 901: the method is used for acquiring images, and the images are shot by a camera arranged in the mobile equipment. Determination unit 902: for determining that the image includes the target identification of the shelf. The target identification is used to characterize the integrity of the shelf. The recognition unit 903: the goods shelf recognition method is used for recognizing goods on the goods shelf in the image according to a preset recognition algorithm. For example, in conjunction with fig. 3, the obtaining unit 901 may be configured to perform the receiving step in S101. The determining unit 902 may be configured to perform S102. The identifying unit 903 may be configured to perform S103. Optionally, the processing device 90 further includes a sending unit 904 for executing S104. In conjunction with fig. 9, the acquiring unit 901 may be configured to perform the receiving step in S202, and the identifying unit 903 may be configured to perform S203. Optionally, the sending unit 904 may be configured to execute S204.

Optionally, the determining unit 902 is specifically configured to: the determined image includes at least two identifiers, each of the at least two identifiers for uniquely identifying the shelf.

Optionally, the shelf is a rectangular shelf, and the determining unit 902 is specifically configured to: the image is determined to comprise n marks, and at least two marks in the n marks are respectively positioned at the first position and the second position of the rectangular shelf. An included angle between a connecting line of the first position and the second position and a horizontal line is within a preset angle range, and the distance between the first position and the second position is smaller than a preset distance. Each of the n identifiers uniquely identifies the rectangular goods shelf, and n is an integer greater than or equal to 2.

Optionally, the first position and the second position are located on the same diagonal of the rectangular shelf, and the distance between the first position and the second position is equal to the length of the diagonal.

Optionally, the sending unit 904 is configured to send an alarm message when it is determined that the number of the goods is smaller than the preset threshold.

Optionally, the obtaining unit 901 is further configured to: the method comprises the steps of obtaining a historical movement track of the camera, wherein the historical movement track comprises a plurality of track points and the time corresponding to each track point in the plurality of track points. The determining unit 902 is further configured to: and determining the hot spot moving track of the camera according to the time corresponding to each track point in the plurality of track points.

In one example, referring to fig. 2, the receiving function of the acquiring unit 901 and the sending function of the sending unit 904 may be implemented by the interface unit 105 in fig. 2. The processing function of the above-described acquisition unit 901, the determination unit 902, and the identification unit 903 may all be implemented by the processor 101 in fig. 2 calling a computer program stored in the memory 102.

For the detailed description of the above alternative modes, reference is made to the foregoing method embodiments, which are not described herein again. In addition, for any explanation and beneficial effect description of the processing apparatus 90 provided above, reference may be made to the corresponding method embodiment described above, and details are not repeated.

It should be noted that the actions correspondingly performed by the modules are merely specific examples, and the actions actually performed by the units refer to the actions or steps mentioned in the description of the embodiment based on fig. 3 and fig. 9.

In the embodiment of the present application, the moving image capturing device 10-2 may be divided into functional modules according to the above method, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.

Fig. 12 is a schematic structural diagram of an image capturing device according to an embodiment of the present disclosure. The image capturing device 80 may be used to perform the functions performed by the image capturing device of any of the above embodiments (e.g., the embodiments shown in fig. 3 or 9). The image pickup device 80 includes: an acquisition unit 801, a determination unit 802, and a transmission unit 803. Wherein, the obtaining unit 801: the method is used for acquiring images, and the images are shot by a camera arranged in the mobile equipment. The determining unit 802 determines that the image includes the target identification of the shelf. The target identification is used to characterize the integrity of the shelf. A sending unit 803 for sending the image to the processing device for the processing device to recognize the image. For example, in conjunction with fig. 3, the obtaining unit 801 may be configured to perform S100, and the sending unit 803 may be configured to perform S101. With reference to fig. 9, the acquiring unit 801 may be configured to perform S200, the determining unit 802 may be configured to perform S201, and the sending unit 803 may be configured to perform S202.

Optionally, the determining unit 802 is specifically configured to: the determined image includes at least two identifiers, each of the at least two identifiers for uniquely identifying the shelf.

Optionally, the shelf is a rectangular shelf, and the determining unit 802 is specifically configured to: the image is determined to comprise n marks, and at least two marks in the n marks are respectively positioned at the first position and the second position of the rectangular shelf. An included angle between a connecting line of the first position and the second position and a horizontal line is within a preset angle range, and the distance between the first position and the second position is larger than or equal to a preset distance. Each of the n identifiers uniquely identifies the rectangular goods shelf, and n is an integer greater than or equal to 2.

In one example, referring to fig. 2, the receiving function of the acquiring unit 801 and the sending function of the sending unit 803 may be implemented by the interface unit 105 in fig. 2. The processing function of the above-described acquisition unit 801 and the determination unit 802 may both be realized by the processor 101 in fig. 2 calling a computer program stored in the memory 102.

For the detailed description of the above alternative modes, reference is made to the foregoing method embodiments, which are not described herein again. In addition, for the explanation and the description of the beneficial effects of any of the image capturing devices 80 provided above, reference may be made to the corresponding method embodiments, and details are not repeated.

An embodiment of the present application further provides a computer device, including: a memory and a processor; the memory is for storing a computer program, and the processor is for invoking the computer program to perform the actions or steps mentioned in any of the embodiments provided above.

Embodiments of the present application also provide a computer-readable storage medium, which stores a computer program, and when the computer program runs on a computer, the computer program causes the computer to execute the actions or steps mentioned in any of the embodiments provided above.

The embodiment of the application also provides a chip. Integrated with the chip are circuits and one or more interfaces for implementing the functions of the processing means and/or the image acquisition means described above. Optionally, the functions supported by the chip may include processing actions in the embodiments described based on fig. 3 or fig. 9, which are not described herein again. Those skilled in the art will appreciate that all or part of the steps for implementing the above embodiments may be implemented by a program instructing the associated hardware to perform the steps. The program may be stored in a computer-readable storage medium. The above-mentioned storage medium may be a read-only memory, a random access memory, or the like. The processing unit or processor may be a central processing unit, a general purpose processor, an Application Specific Integrated Circuit (ASIC), a microprocessor (DSP), a Field Programmable Gate Array (FPGA) or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof.

The embodiments of the present application also provide a computer program product containing instructions, which when executed on a computer, cause the computer to execute any one of the methods in the above embodiments. The computer program product includes one or more computer instructions. The procedures or functions described in accordance with the embodiments of the present application are all or partially generated upon loading and execution of computer program instructions on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). Computer-readable storage media can be any available media that can be accessed by a computer or can comprise one or more data storage devices, such as servers, data centers, and the like, that can be integrated with the media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It should be noted that the above devices for storing computer instructions or computer programs provided in the embodiments of the present application, such as, but not limited to, the above memories, computer readable storage media, communication chips, and the like, are all nonvolatile (non-volatile).

Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed application, from a review of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the word "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Although the present application has been described in conjunction with specific features and embodiments thereof, various modifications and combinations can be made thereto without departing from the spirit and scope of the application. Accordingly, the specification and figures are merely exemplary of the present application as defined in the appended claims and are intended to cover any and all modifications, variations, combinations, or equivalents within the scope of the present application.

Claims

1. A method for managing data, comprising:

acquiring an image, wherein the image is shot by a camera arranged in mobile equipment;

determining that the image includes a target identification of a shelf; the target identification is used for representing the integrity of the shelf;

and identifying goods on the shelf in the image according to a preset identification algorithm.

2. The data management method of claim 1, wherein the determining that the image includes a target identification comprises:

determining that the image includes at least two identifiers, each of the at least two identifiers for uniquely identifying the shelf.

3. The data management method of claim 1, wherein the shelf is a rectangular shelf, and wherein the determining that the image includes an object identification comprises:

determining that the image comprises n markers, and at least two markers of the n markers are respectively located at a first position and a second position of the rectangular shelf; an included angle between a connecting line of the first position and the second position and a horizontal line is within a preset angle range, and the distance between the first position and the second position is smaller than a preset distance; each of the n identifiers uniquely identifies the rectangular shelf, and n is an integer greater than or equal to 2.

4. The data management method according to claim 3,

the first position and the second position are located on the same diagonal of the rectangular shelf, and the distance between the first position and the second position is equal to the length of the diagonal.

5. The data management method according to any one of claims 1 to 4, characterized in that the data management method further comprises:

and sending alarm information when the quantity of the goods is smaller than a preset threshold value.

6. The data management method according to any one of claims 1 to 4, characterized in that the data management method further comprises:

acquiring a historical movement track of the camera, wherein the historical movement track comprises a plurality of track points and time corresponding to each track point in the plurality of track points;

and determining the hot spot moving track of the camera according to the plurality of track points and the time corresponding to each track point in the plurality of track points.

7. A method for managing data, comprising:

the image is sent to a processing device for identifying items of the shelf in the image.

8. The data management method of claim 7, wherein the determining that the image includes a target identification comprises:

9. The method of claim 7, wherein the shelf is a rectangular shelf, and wherein the determining that the image includes an object identification comprises:

determining that the image comprises n markers, and at least two markers of the n markers are respectively located at a first position and a second position of the rectangular shelf; an included angle between a connecting line of the first position and the second position and a horizontal line is within a preset angle range, and the distance between the first position and the second position is greater than or equal to a preset distance; each of the n identifiers uniquely identifies the rectangular shelf, and n is an integer greater than or equal to 2.

10. The data management method according to claim 9,

11. A computer device, comprising: a memory for storing a computer program and a processor for executing the computer program to perform the method of any one of claims 1 to 6 or to perform the method of any one of claims 7 to 10.

12. A computer-readable storage medium, having stored thereon a computer program which, when run on a computer, causes the computer to perform the method of any one of claims 1-6, or the method of any one of claims 7-10.