CN113627418B

CN113627418B - Data management method, computer device, and computer-readable storage medium

Info

Publication number: CN113627418B
Application number: CN202010377338.4A
Authority: CN
Inventors: 李昂阳
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2020-05-07
Filing date: 2020-05-07
Publication date: 2023-08-25
Anticipated expiration: 2040-05-07
Also published as: CN113627418A

Abstract

The application discloses a data management method, computer equipment and a computer readable storage medium, relates to the technical field of image processing, and is beneficial to improving the accuracy of acquired goods data. The data management method disclosed by the application comprises the following steps: after an image shot by a camera in the mobile equipment is acquired, the image is initially identified, when the image is determined to comprise a target identification (used for representing the integrity of the goods shelf) of the goods shelf, goods in the goods shelf represented by the target identification are identified according to a preset identification algorithm to acquire goods data of the goods shelf, and the accuracy of the acquired goods data is improved by the method.

Description

Data management method, computer device, and computer-readable storage medium

Technical Field

The present application relates to the field of data processing technologies, and in particular, to a data management method, a computer device, and a computer readable storage medium.

Background

A mall, supermarket, factory or warehouse will typically place shelves for holding goods. The manager needs to collect information about the goods on each shelf to know the condition (such as the number of goods, the arrangement of goods, etc.) on each shelf.

At present, the method for collecting the information of goods on the goods shelf comprises the following steps: installing a camera (such as a spherical monitoring camera) on the goods shelf, and regularly shooting images of goods on the goods shelf by the camera and sending the images to a server; subsequently, the server identifies the item in the image. However, due to the influence of factors such as the installation angle, the camera may not be able to photograph all the goods on the shelf, and thus, the information accuracy of the server for identifying the goods is low.

Disclosure of Invention

The application provides a data management method, computer equipment and a computer readable storage medium, which solve the problem of low information accuracy of a server for identifying goods according to images.

In a first aspect, a data management method is provided, the method comprising: an image is acquired, wherein the image is shot by a camera arranged in the mobile device. The determined image includes a target identification of the shelf. The target identifier is used for representing the integrity of the goods shelf and identifying goods of the goods shelf in the image according to a preset identification algorithm.

It can be seen that in the data management method provided by the application, after the image is determined to comprise the target identification of the goods shelf, goods of the goods shelf in the image are identified. That is, only in the case that the image includes a complete shelf, the goods of the shelf in the image are identified, effectively improving the accuracy of information of the identified goods.

Further, since the image acquisition device in the embodiment of the application is movable, even if the position of the shelf is changed, the image acquisition device is not affected to acquire images. The image acquisition device is not arranged on the goods shelf, so that the installation/disassembly of the goods shelf can not influence the image acquisition device. Compared with the mode of installing the camera on the goods shelf in the prior art, the installation mode provided by the embodiment of the application is more convenient.

In a first possible implementation manner of the first aspect, the determining image includes at least two identifiers, each of the at least two identifiers being used to uniquely identify the shelf.

In a second possible implementation manner of the first aspect according to the first implementation manner of the first aspect, the shelf is a rectangular shelf, and the method for determining that the image includes the target identifier includes: the determined image comprises n (n is an integer greater than or equal to 2) identifiers, and at least two of the n identifiers are respectively located at a first position and a second position of the rectangular shelf. The included angle between the connecting line of the first position and the second position and the horizontal line is within a preset angle range, and the distance between the first position and the second position is smaller than the preset distance. Each of the n identifications uniquely identifies the rectangular shelf.

Thus, for a rectangular shelf, two marks are respectively arranged near the vertex of the same diagonal line of the rectangular shelf (namely, the included angle between the connecting line of the first position and the second position and the horizontal line is in a preset angle range, and the distance between the first position and the second position is greater than or equal to a preset distance), when the acquired image simultaneously comprises the two marks, the length of the acquired image of the rectangular shelf and the length of the complete image of the shelf are smaller than or equal to a first threshold value, and the width of the acquired image of the rectangular shelf and the width of the complete image of the shelf are smaller than or equal to a second threshold value. Thus, the image acquisition device may determine that the acquired image includes a complete image of the shelf.

In a third possible implementation form of the first aspect according to the second implementation form of the first aspect, the first location and the second location are located on a same diagonal of the rectangular shelf, and a distance between the first location and the second location is equal to a length of the diagonal.

In a fourth possible implementation manner of the first aspect according to the first aspect, the data management method further includes: and when the number of the goods is determined to be smaller than the preset threshold value, sending out alarm information.

In a fifth possible implementation manner of the first aspect according to the fourth implementation manner of the first aspect, the data management method further includes: the method comprises the steps of obtaining a historical movement track of a camera, wherein the historical movement track comprises a plurality of track points and time corresponding to each track point in the plurality of track points. And determining the hot spot moving track of the camera according to the track points and the time corresponding to each track point in the track points. In this way, the manager can identify user preferences based on the determined hotspot movement trajectory and place promotional items on shelves in the vicinity of the hotspot movement trajectory or hotspot area based on the user preferences.

In a second aspect, a data management method is provided for use in a data management system comprising a mobile image acquisition device and a processing device. Specifically, the mobile image acquisition device acquires an image and, after determining that the acquired image includes a target identification of the shelf (for characterizing the integrity of the shelf), sends the image to the processing device for the processing device to identify the image.

In a first possible implementation manner of the second aspect, according to the second aspect, the image is determined to include at least two identifiers, each of the at least two identifiers being used to uniquely identify the shelf.

In a second possible implementation manner of the second aspect according to the first implementation manner of the second aspect, the shelf is a rectangular shelf, and the determining that the image includes the target identifier includes: the determined image comprises n identifications, and at least two identifications of the n identifications are respectively positioned at a first position and a second position of the rectangular shelf. The included angle between the connecting line of the first position and the second position and the horizontal line is within a preset angle range, and the distance between the first position and the second position is smaller than the preset distance. Each of the n identifiers uniquely identifies the rectangular shelf, and n is an integer greater than or equal to 2.

In a third possible implementation form of the second aspect according to the second implementation form of the second aspect, the first position and the second position are located on a same diagonal of the rectangular shelf, and a distance between the first position and the second position is equal to a length of the diagonal.

In a third aspect, a processing device is provided, which may be used to perform any of the methods provided in any of the possible implementations of the first aspect to the first aspect. The present application may provide a method according to any of the above first aspects, wherein the processing device is divided into functional modules. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated in one processing unit.

In a fourth aspect, there is provided an image acquisition apparatus operable to perform any of the methods provided in any of the possible implementations of the second to the second aspects described above. The present application may provide a method according to any one of the first aspect, wherein the image capturing device is divided into functional modules. For example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated in one processing unit.

In a fifth aspect, the present application provides a computer device comprising a memory and a processor. The memory is coupled to the processor. The memory is for storing computer program code, the computer program code comprising computer instructions. When the processor executes the computer instructions, the computer device performs the method as described in any one of the possible implementations of the first to second aspects.

In a sixth aspect, the present application provides a chip system for use in a computer device, the chip system comprising one or more interface circuits, and one or more processors. The interface circuit and the processor are interconnected through a circuit; the interface circuit is configured to receive a signal from a memory of the computer device and to send the signal to the processor, the signal including computer instructions stored in the memory. When the processor executes the computer instructions, the computer device performs the method as described in any one of the possible implementations of the first to second aspects.

In a seventh aspect, the present application provides a computer readable storage medium comprising computer instructions which, when run on a computer device, cause the computer device to perform a method as described in any one of the possible implementations of the first to second aspects.

In an eighth aspect, the present application provides a computer program product comprising computer instructions which, when run on a computer device, cause the computer device to perform the method according to any one of the possible implementations of the first to second aspects.

It is to be understood that any of the processing apparatus, the image capturing apparatus, the computer readable storage medium, the computer program product or the chip and the like provided above may be applied to the corresponding method provided above, and therefore, the advantages achieved by the processing apparatus, the image capturing apparatus, the computer readable storage medium, the computer program product or the chip and the like may refer to the advantages in the corresponding method and are not described herein.

These and other aspects of the application will be more readily apparent from the following description.

Drawings

Fig. 1 is a schematic structural diagram of a data management system to which the technical solution provided in the embodiment of the present application is applicable;

fig. 2 is a schematic structural diagram of a computer device to which the technical solution provided in the embodiment of the present application is applicable;

FIG. 3 is a schematic flow chart of a data management method according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a position relationship between a shopping cart and a camera according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a positional relationship between a shelf and a label according to an embodiment of the present application;

FIG. 6 is a schematic diagram of two rectangular shelf images provided by an embodiment of the present application;

FIG. 7 is a schematic diagram of an image according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a shelf image;

FIG. 9 is a flowchart illustrating another data management method according to an embodiment of the present application;

fig. 10 is a schematic diagram showing a trace recorded by an image acquisition device in a supermarket plan view;

FIG. 11 is a schematic diagram of a processing apparatus according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of an image capturing device according to an embodiment of the present application.

Detailed Description

In embodiments of the application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment should not be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

In embodiments of the present application, "at least one" refers to one or more. "plurality" means two or more.

In the embodiment of the present application, "and/or" is merely an association relationship describing an association object, and indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.

In an embodiment of the application, the combination includes one or more objects.

The data management method provided by the embodiment of the application can be applied to a data management system. Fig. 1 is a schematic structural diagram of a data management system to which the technical solution provided in the embodiment of the present application is applicable. The data management system comprises a processing device 10-1 and a plurality of mobile image acquisition devices 10-2. Two moving image acquisition devices are illustrated in fig. 1. Wherein the processing device 10-1 is connected with each mobile image acquisition device 10-2 through a network.

The moving image pickup device 10-2 may be any device for picking up an image. For example: cameras, candid cameras, video cameras, and the like.

Alternatively, the mobile image capture device 10-2 may send the captured image to the processing device 10-1, or may identify the captured image to determine whether the image includes a target identification of the shelf. Upon determining that the image includes the target identification of the shelf, the image is sent to the processing device 10-1.

The processing device 10-1 may be configured to identify images captured by the moving image capture device 10-2 and identify items on the shelf when it is determined that the images include a target identification of the shelf; an image including the target mark transmitted from the moving image pickup device 10-2 may be received and, after receiving the image, the goods of the shelf may be identified.

The processing means 10-1 may be a terminal device or a server. The terminal device can be a palm computer, a notebook computer, a smart phone, a tablet computer or a desktop computer and other computing devices. The server may be a server, a server cluster comprising a plurality of servers, or a cloud computing service center.

In practical applications, the processing device 10-1 and the mobile image capturing device 10-2 may be integrated in one computer device, or may be two devices that are independent of each other, and the positional relationship between the processing device 10-1 and the mobile image capturing device 10-2 is not limited in this embodiment of the present application. The following description of the embodiments of the present application will take as an example that the processing apparatus 10-1 and the moving image capturing apparatus 10-2 are independent devices.

The basic hardware architecture of the processing device 10-1 and the mobile image capture device 10-2 described above are similar, including the components included in the computer apparatus 10 shown in fig. 2. The hardware configuration of the processing device 10-1 and the moving image pickup device 10-2 will be described below taking the computer apparatus 10 shown in fig. 2 as an example.

Fig. 2 is a schematic structural diagram of a computer device to which the technical solution provided in the embodiment of the present application is applicable. The computer device 10 in fig. 2 includes, but is not limited to: a processor 101, a memory 102, an input unit 104, an interface unit 105, a power supply 106, and the like. Optionally, the computer device 10 further comprises a camera 100, a display 103, a positioning means 107.

The camera 100 is used for capturing images and transmitting the images to the processor 101. The processor 101 is a control center of the computer device, connects various parts of the entire computer device using various interfaces and lines, and performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 102, and calling data stored in the memory 102, thereby performing overall monitoring of the computer device. The processor 101 may include one or more processing units; alternatively, the processor 101 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 101. If the computer device 10 is a mobile image acquisition apparatus 10-2, the computer device 10 further comprises a camera 100.

The memory 102 may be used to store software programs as well as various data. The memory 102 may mainly include a storage program area that may store an operating system, application programs required for at least one functional unit, and the like, and a storage data area. In addition, memory 102 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Alternatively, the memory 102 may be a non-transitory computer readable storage medium, such as read-only memory (ROM), random-access memory (random access memory, RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

The display 103 is used to display information input by a user or information provided to the user. The display 103 may include a display panel, which may be configured in the form of a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), or the like. If the computer device 10 is a processing apparatus 10-1, the computer device 10 may also include a display 103.

The input unit 104 may include a graphics processor (graphics processing unit, GPU) that processes image data of still images or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display 103. The image frames processed by the graphics processor may be stored in memory 102 (or other storage medium).

The interface unit 105 is an interface to which an external device is connected to the computer apparatus 10. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 105 may be used to receive input (e.g., data information, etc.) from an external device and transmit the received input to one or more elements within the computer apparatus 10 or may be used to transmit data between the computer apparatus 10 and an external device.

A power supply 106 (e.g., a battery) may be used to power the various components, and alternatively, the power supply 106 may be logically connected to the processor 101 through a power management system, so as to perform functions of managing charging, discharging, and power consumption management through the power management system.

The positioning device 107 may be used to record the trajectory of the moving image acquisition device 10-2. The positioning device may include: global positioning system (global positioning system, GPS) devices, etc. If the computer device 10 is a mobile image acquisition apparatus 10-2, the computer device 10 further comprises positioning means 107.

Alternatively, the computer instructions in the embodiments of the present application may be referred to as application program codes or systems, and the embodiments of the present application are not limited thereto in particular.

It should be noted that the computer device shown in fig. 2 is only an example, and is not limited to the computer device configuration applicable to the embodiment of the present application. In actual implementation, the computer device may include more or fewer devices or apparatuses than those shown in FIG. 2.

Before describing the data management method provided by the embodiment of the present application in detail, an application scenario related to the embodiment of the present application is described. The embodiment of the application can be applied to the following scenes:

market or supermarket application scenario: goods shelves are arranged in markets or supermarkets and the like for placing goods. The manager needs to supplement the goods on the goods shelves or rearrange the goods on the goods shelves according to the goods information on each goods shelf.

Storehouse application scenario: the goods shelves are arranged in the storeroom for placing goods. The manager needs to update the inventory information according to the goods information on each shelf so as to facilitate the subsequent management of purchasing according to the inventory information.

Illustratively, in connection with FIG. 1, after the moving image acquisition device 10-2 acquires an image, the image is sent to the processing device 10-1. The processing device 10-1 recognizes the item information of the shelves placed in the image according to a preset recognition algorithm. Subsequently, the processing device 10-1 issues an alarm information based on the item information of the shelf, and/or the processing device 10-1 updates the inventory information based on the item information of the shelf.

Factory application scenario: shelves are placed in the factory for placing goods. The manager needs to collect the information of the goods on each goods shelf and supplement the goods on the goods shelf according to the information of the goods.

Illustratively, in connection with FIG. 1, after the moving image capturing device 10-2 acquires an image on the production line of the factory, the acquired image is sent to the processing device 10-1. The processing device 10-1 recognizes the item information of the shelves placed in the image according to a preset recognition algorithm. If the number of the goods in the goods information is smaller than the preset threshold value, the processing device 10-1 sends out alarm information for informing the manager to supplement the goods on the goods shelf. Alternatively, the processing device 10-1 issues a replenishment instruction for instructing the automatic replenishment device to replenish the article on the shelf shown in the image. The automatic replenishment device can receive replenishment instructions and replenish goods on corresponding goods shelves according to the replenishment instructions.

The following description of the embodiment of the application mainly takes supermarket application scenes as examples.

The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.

The data management method provided by the embodiment of the application comprises the following two implementation modes:

implementation mode I: the moving image pickup device 10-2 picks up (i.e., photographs) an image and transmits the image to the processing device 10-1. After receiving the image, the processing device 10-1 performs preliminary recognition on the image. When it is determined that the image includes a target identification of a shelf (used to characterize the integrity of the shelf), items in the shelf characterized by the target identification are identified according to a preset identification algorithm.

Implementation I I: the moving image pickup device 10-2 picks up (i.e., picks up) an image and performs preliminary recognition of the image. When it is determined that the image includes the target identification of the shelf, the image is sent to the processing device 10-1. Subsequently, the processing device 10-1 identifies the items in the racks characterized by the target identifications according to a preset identification algorithm. The target identity is used to characterize the integrity of the shelf.

The above implementation I will now be described.

Fig. 3 is a schematic flow chart of a data management method according to an embodiment of the present application. As shown in fig. 3, the method may include the steps of:

s100: the moving image pickup device 10-2 picks up an image.

Wherein the mobile image capturing apparatus 10-2 may be mounted on a mobile device. Alternatively, the mobile image capturing device 10-2 itself is a mobile device capable of capturing images or video. That is, the moving image pickup device 10-2 in the embodiment of the present application is movable.

The mobile image capture device 10-2 may be a combination of a mobile device and a camera, where the camera is a device that can capture images. The embodiment of the application does not limit the type of the camera. For example: the camera can be at least one of a gun type camera, a dome camera, a high-definition intelligent dome camera, a pen container type camera, a single-board camera, a flying saucer type camera, a key type camera or a mobile phone type camera. The mobile device may be any one of a supermarket shopping cart, a supermarket cleaning cart, a supermarket shopping basket or a supermarket patrol cart.

It should be noted that, the position and the number of the cameras installed on the mobile device are not limited in the embodiment of the present application.

The mobile device is exemplified as a shopping cart. Fig. 4 is a schematic diagram showing a positional relationship between a shopping cart and a camera according to an embodiment of the present application, in fig. 4, the camera 1 of the shopping cart 1 is installed on one side of the shopping cart 1, and the camera 2 is installed on the other side of the shopping cart 1. Thus, during the movement of the shopping cart 1, the camera 1 and the camera 2 can respectively shoot images of both sides of the shopping cart 1.

Because the image acquisition device in the embodiment of the application is movable, even if the position of the goods shelf is changed, the image acquisition device is not influenced to acquire images. The image acquisition device is not arranged on the goods shelf, so that the installation/disassembly of the goods shelf can not influence the image acquisition device. Compared with the mode of installing the camera on the goods shelf in the prior art, the installation mode provided by the embodiment of the application is more convenient.

The shooting function of the mobile image capturing device 10-2 in the embodiment of the present application may be always in an on state, or may be switched between an on state and an off state according to actual requirements, which is not limited in the embodiment of the present application.

Alternatively, the photographing function of the image pickup device 10-2, which is moved when the first preset condition is satisfied, is switched from the off state to the on state, and the acquisition of an image is started. The preset condition may be at least one of a preset time, a preset place or a preset signal.

When the first preset condition is that the time is the first preset time, if the current time is the first preset time, the processing device 10-1 sends an opening instruction to the moving image capturing device 10-2, so as to instruct to start the shooting function of the moving image capturing device 10-2 and start to acquire an image. Or when the current time is the preset time, the shooting function of the moving image capturing device 10-2 is automatically turned on, and the image capturing is started.

When the first preset condition is that the position of the moving image capturing device 10-2 is the first preset position, the moving image capturing device 10-2 further comprises a positioning device, and the positioning device can actively send the position of the moving image capturing device 10-2 to the processing device 10-1 at regular time. Alternatively, the processing device 10-1 periodically transmits a request message to the moving image pickup device 10-2 for acquiring the position of the moving image pickup device 10-2. The moving image pickup device 10-2 transmits the current position of the moving image pickup device 10-2 to the processing device 10-1 according to the request message. If the processing device 10-1 determines that the current position of the moving image capturing device 10-2 is the first preset position, an opening instruction is sent to the moving image capturing device 10-2 to instruct to open the shooting function of the moving image capturing device 10-2, and to start capturing an image. Or if the current position of the moving image capturing device 10-2 is the first preset position, the capturing function of the moving image capturing device 10-2 is automatically turned on, and the image capturing is started.

When the first preset condition is that the acquired signal is the first preset signal, if the signal acquired by the moving image capturing device 10-2 is the first preset signal, the shooting function of the moving image capturing device 10-2 is automatically started. For example, the first preset signal is that the moving image capturing device 10-2 determines that the moving image capturing device itself has moved, or the moving image capturing device 10-2 receives an opening instruction sent by the processor. The moving image capturing apparatus 10-2 may further include a sensing device, and if the sensing device senses the movement, the photographing function of the moving image capturing apparatus 10-2 is automatically turned on and the image capturing is started. Alternatively, the moving image capturing apparatus 10-2 transmits the position to the processing apparatus 10-1. If the processing device 10-1 determines that the moving image capturing device 10-2 moves according to the position sent by the moving image capturing device 10-2, an opening instruction is sent to the moving image capturing device 10-2 to instruct to open the shooting function of the moving image capturing device 10-2 and start to acquire an image.

Optionally, the shooting function of the mobile image capturing apparatus 10-2 is turned off when the second preset condition is satisfied, and the acquisition of the image is stopped. Specific:

When the second preset condition is that the current time is the second preset time, if the current time is the second preset time, the shooting function of the moving image capturing device 10-2 is turned off.

When the second preset condition is that the position of the moving image capturing device 10-2 is the second preset position, if the current position of the moving image capturing device 10-2 is the second preset position, the shooting function of the moving image capturing device 10-2 is turned off.

When the second preset condition is the second preset signal, if the second preset signal acquired by the moving image capturing device 10-2 is the second preset signal, the shooting function of the moving image capturing device 10-2 is turned off.

The moving image capturing device 10-2 may actively close the capturing function when the second preset condition is satisfied, or the processing device 10-1 may send an instruction to instruct the moving image capturing device 10-2 to close the capturing function. Specifically, with reference to the above specific method for starting the shooting function of the mobile image capturing apparatus 10-2 when the first preset condition is satisfied, no description will be repeated.

In this way, the moving image pickup device 10-2 turns on the photographing function when the first preset condition is satisfied and turns off the photographing function when the second preset condition is satisfied. On the one hand, the energy consumption of the movable image acquisition device 10-2 can be saved; on the other hand, redundant images acquired by the moving image acquisition device 10-2 can be reduced.

In an exemplary supermarket application scenario, the number of goods on a shelf is not changed in a non-working period of the supermarket, and if the shelf images are still continuously shot, the acquired shelf images are redundant images. Therefore, turning off the photographing function of the moving image pickup device 10-2 during the non-operation period can save power consumption of the moving image pickup device 10-2 and reduce the acquired redundant image.

S101: the moving image pickup device 10-2 transmits the image to the processing device 10-1.

Specifically, the moving image pickup device 10-2 may transmit the image to the processing device 10-1 at regular time, or the moving image pickup device 10-2 may transmit the image to the processing device 10-1 after receiving the request message transmitted from the processing device 10-1.

Alternatively, the mobile image capturing apparatus 10-2 may filter the images according to the time of image capturing and the content included in the images, and send only the image that was newly captured to the processing apparatus 10-1 for the images that include the same shelf. Thus, for the same goods shelf, the newly acquired images of the goods shelf can reflect the real condition of the goods in the current goods shelf, and redundant images can be reduced.

S102: the processing device 10-1 determines that the image includes a target identification of the shelf.

After the image is acquired, the moving image pickup device 10-2 recognizes the image and judges whether the image includes the target identification of the shelf. The target identifier is used to characterize the integrity of a shelf.

In the embodiment of the application, the target identifiers of different shelves are different.

Optionally, the target identifier comprises at least two identifiers, each for uniquely identifying one shelf. The two identifications may be the same or different. The identifier may be any one of a bar code, a two-dimensional code, a three-dimensional code (also called a three-dimensional code) number identifier, a character identifier or a character string identifier.

Specifically, the moving image capturing device 10-2 recognizes the image and determines whether the image includes the target identifier of the shelf, including the steps of:

step one: the moving image capturing device 10-2 recognizes the identification in the image. Wherein the identified identifier comprises a first identifier.

Step two: the mobile image acquisition device 10-2 acquires the target identifier of the shelf represented by the first identifier according to the corresponding relation between each shelf identifier and the target identifier in the prestored plurality of shelf identifiers.

In one case, when the identifier on the shelf is a shelf identifier, the correspondence between each of the plurality of shelf identifiers and the target identifier may be as shown in table 1 below:

TABLE 1

Goods shelf label	Target identification
		Identification of the pallet 1	2
Identification of the shelf 3	3

In table 1, the object identifier corresponding to the identifier of the shelf 1 is 2, and the object identifier represents that when the acquired image includes 2 identifiers of the shelf 1, the acquired image includes a complete image of the shelf 1. Other explanations are similar to this and will not be repeated.

In another case, when the identifier on the shelf is a different identifier from the shelf identifier, the correspondence between each of the plurality of shelf identifiers and the target identifier may be as shown in the following table 2:

TABLE 2

Goods shelf label	Target identification
		Identification of the pallet 1	Sign 1
Identification of the pallet 1	Sign 1
		Identification of shelf 2	Sign A
Identification of shelf 2	Sign B
		Identification of shelf 2	Sign C

In table 2, the identifier of the shelf 1 represents the shelf 1, the object identifier corresponding to the shelf 1 is two identifiers 1, and the object identifier represents that when the moving image capturing device 10-2 recognizes that the number of identifiers 1 included in the image is greater than or equal to 2, the moving image capturing device 10-2 determines that the image includes the complete image of the shelf 1. The identity of the shelf 2 in table 2 characterizes the shelf 2, and the object identities corresponding to the shelf 2 are identity a, identity B and identity C, where the object identity characterizes that when the moving image capturing device 10-2 recognizes that the image includes identity a, identity B and identity C, the moving image capturing device 10-2 determines that the image includes the complete image of the shelf 2.

In another case, when the identifier on the shelf is a different identifier from the shelf identifier, the correspondence between each of the plurality of shelf identifiers and the target identifier may be further as shown in the following table 3:

TABLE 3 Table 3

In table 3, the identifier of the shelf 1 represents the shelf 1, the object identifier corresponding to the shelf 1 is 2 identifiers 1, and the object identifier represents that when the moving image capturing device 10-2 recognizes that the number of identifiers 1 included in the image is greater than or equal to 2, the moving image capturing device 10-2 determines that the image includes the complete image of the shelf 1. The identity of the shelf 3 in table 3 characterizes the shelf 3, and the object identity corresponding to the shelf 3 is 3 identities 2, and the object identity characterizes that when the moving image capturing device 10-2 recognizes that 3 identities 2 are included in an image, the moving image capturing device 10-2 determines that the image includes a complete image of the shelf 2.

Of course, the correspondence between each of the plurality of shelf identifiers and the target identifier may be other storage forms, so long as the integrity of the shelf represented by the identifier can be determined by the identifier and the number of identifiers, which falls within the scope of the present application.

Step three: the image capture device 10-2 determines whether the integrity of the shelf characterized by the first identifier is included in the image based on the identifier in the identified image and the target identifier of the shelf characterized by the first identifier.

Exemplary, a schematic diagram of the positional relationship between the shelf and the logo is shown in fig. 5. Fig. 5 shows a pallet 1 and a pallet 3. Wherein the pallet 1 comprises two labels 1. Two identifications 1 are target identifications of the shelf 1. The pallet 3 comprises five labels 2. The five identifications 2 are target identifications of the shelves 3.

The embodiment of the application does not limit the shape of the goods shelf. By way of example, the shelves may be any of circular, rectangular, triangular, rectangular, or other polygonal shape.

Alternatively, when the shelf is rectangular and at least two identifiers in the image comprising the shelf are located at the first and second positions of the shelf, respectively, the moving image acquisition device 10-2 determines that the image comprises a complete image of the shelf. The included angle between the connecting line of the first position and the second position and the horizontal line is within a preset angle range, and the distance between the first position and the second position is greater than or equal to a preset distance.

Optionally, the first location and the second location are located on a same diagonal of the rectangular shelf, and the first location and the second location are vertices of the diagonal.

Thus, for a rectangular shelf, two marks are respectively arranged near the vertex of the same diagonal line of the rectangular shelf (namely, the included angle between the connecting line of the first position and the second position and the horizontal line is in a preset angle range, and the distance between the first position and the second position is greater than or equal to a preset distance), when the acquired image simultaneously comprises the two marks, the length of the acquired image of the rectangular shelf and the length of the complete image of the shelf are smaller than or equal to a first threshold value, and the width of the acquired image of the rectangular shelf and the width of the complete image of the shelf are smaller than or equal to a second threshold value. Thus, the moving image capture device 10-2 may determine that the captured image includes a complete image of the shelf.

Exemplary, fig. 6 is a schematic diagram of two rectangular shelf images according to an embodiment of the present application: in fig. 6, the shelf 1 includes two marks 1, where the two marks 1 are located at a first position and a second position of the shelf 1, and an included angle between a connecting line of the first position and the second position and a horizontal line is less than or equal to α and greater than or equal to β. When the first position and the second position are within the dashed line box shown in fig. 6, it is ensured that the distance between the first position and the second position is equal to or greater than the preset distance, and the moving image capturing device 10-2 determines that the image includes the complete image of the shelf 1. In fig. 6, the shelf 4 includes two marks 3, where the two marks 3 are located at a first position and a second position of the shelf 4, and an included angle between a connecting line of the first position and the second position and a horizontal line is less than or equal to α and greater than or equal to β. When the first position and the second position are within the dashed line box shown in fig. 6, it is ensured that the distance between the first position and the second position is equal to or greater than the preset distance, and the moving image capturing device 10-2 determines that the image includes the complete image of the shelf 4.

S103: the processing device 10-1 uses a preset algorithm to identify items on shelves in the image based on the received image.

In one possible implementation, the preset identification algorithm is an algorithm for acquiring the kind of the item and the number of the items based on the identification of the items. The identification of the goods can be any one of two-dimensional codes, bar codes, three-dimensional codes, digital identifications, character identifications or character string identifications and the like.

Illustratively, the processing device 10-1 identifying the items of the shelf 1 in the image by the identifications of the items included in the image includes: 1 identity of item a, 3 identities of item B, and 10 identities of item C. The processing device 10-1 recognizes the article of the shelf 1 in the image, including: 1 article a, 3 articles B, and 10 articles C.

In another possible implementation, the preset recognition algorithm is an algorithm for acquiring the kind of the item and the number of the item based on the image features.

For example, a model for identifying the goods based on the image features is pre-stored in the processing device 10-1, and the model may be obtained to identify the number of the goods and the identity of the goods in the image, that is, the model is the above-mentioned preset identification algorithm. If the processing apparatus 10-1 receives the image as shown in fig. 7, the processing apparatus 10-1 may recognize that the image includes 2 items a, 4 items B, and 8 items C according to a pre-stored model for recognizing items.

In another possible implementation, a preset recognition algorithm is used to obtain the category of the article and "the ratio of the area of the article to the area of the article" based on the target identifier and the article identifier. The area of the goods is the area of the area for storing a certain kind of goods in the image, and the area of the goods is the area occupied by the goods in the image.

Specifically, the possible implementation manner includes the following steps:

step one: the processing device 10-1 identifies the target identity and the item identity in the image and obtains the area of each item in the image and the boundary coordinates of the item area of each item in the image based on the target identity and/or the item identity.

Illustratively, the processing arrangement 10-1 obtains the area of the article A by: the processing device 10-1 acquires the coordinates of the article identifier of the article a in the image coordinate system, and as shown in fig. 8, the processing device 10-1 acquires the coordinates of the article identifier of the article a in the image coordinate system as target coordinates including a target abscissa and a target ordinate. The processing device 10-1 acquires the coordinates of the identity 4 of the article C in the image coordinate system as the second coordinates, and acquires the coordinates of the identity 4 located near the y-axis in the image coordinate system as the third coordinates. The absolute value of the difference between the abscissa of the second coordinate and the target abscissa is greater than or equal to a first threshold value and less than or equal to a second threshold value. The absolute value of the difference between the ordinate of the second coordinate and the ordinate of the target is equal to or less than a third threshold. The absolute value of the difference between the abscissa of the third coordinate and the abscissa of the target is equal to or less than a third threshold value, and the absolute value of the difference between the ordinate of the third coordinate and the ordinate of the target is equal to or greater than a first threshold value and equal to or less than a second threshold value. The second coordinate and the third coordinate are the coordinates of the object mark or the goods mark in the image coordinate system. The product of the absolute value of the difference between the abscissa of the second coordinate and the abscissa of the target and the absolute value of the difference between the ordinate of the third coordinate and the ordinate of the target is the area of the article a. The processing device 10-1 acquires coordinates of a pixel point of a line connecting the target coordinates and the second coordinates.

Step two: the processing device 10-1 obtains the coordinates of the pixel point of each item in the image and the area of the item in the image according to the pre-stored model for identifying the item. And acquiring the ratio of the area of the product, which is the overlapping part of the area of the product and the area of the product in the product area, of the product and the product area of the product according to the coordinates of the pixel points of the product and the boundary coordinates of the product area in which the product is positioned, and determining that the product is in the area if the ratio is more than or equal to a threshold value.

Step three: the processing device 10-1 obtains the ratio of the total article area of the articles in the article area to the area of such articles.

Based on the example in step one, four item areas are included in the shelf characterized by reference 4 in FIG. 8. The article region of article a, the article region of article B, the article region of article C and the article region of article D. The area of the article a occupies 13% of the area of the article region of the article a, the area of the article C occupies 80% of the area of the article region of the article C, the area of the article B occupies 50% of the area of the article region of the article B, and the area of the article D occupies 0% of the area of the article region of the article D.

According to the data management method provided by the embodiment of the application, the moving image acquisition device 10-2 acquires the image, the integrity of the image is judged by using the mark, then the goods on the goods shelf indicated by the target mark in the image comprising the target mark are identified, the accuracy of the information of the identified goods is improved, and the problem that the accuracy of the information of the identified goods is low due to the fact that the goods shelf in the goods shelf image acquired by the moving image acquisition device 10-2 acquiring the goods shelf image is incomplete due to the influence of factors such as installation angle is solved.

Further optionally, as shown in fig. 3, the method provided in the embodiment of the present application further includes S104.

S104: when the processing device 10-1 determines that the number of at least one item in the shelf represented by the target identifier is less than the preset threshold, or when the processing device 10-1 determines that the ratio of the total item area of at least one item in the shelf represented by the target identifier to the area of the item is less than or equal to a threshold, an alarm message is sent. The warning information may include the identity of the shelf and the type of the goods with the number smaller than a preset threshold.

Optionally, the backorder information includes at least one of a current quantity of the item or a quantity of the item that needs to be replenished.

It should be noted that, in the embodiment of the present application, the alarm information may be the information of the absence on one shelf, or may be the information of the absence on one shelf in one frame of image, or may be the information of the absence on a plurality of shelves.

Based on the example in S103, assuming that the preset threshold is 5, the processing apparatus 10-1 issues an alarm message. The information of the shortage in the warning information includes the shelf 1, the article a and the article B.

The above implementation I I is described below.

Fig. 9 is a schematic flow chart of another data management method according to an embodiment of the present application. The present embodiment can be applied to the data management system shown in fig. 1. The method shown in fig. 9 may include the steps of:

s200: the moving image pickup device 10-2 picks up an image.

Specifically, reference is made to the description in S100 above, and details are not repeated here.

S201: the moving image capture device 10-2 determines that the image includes a target identification of the shelf.

Upon receiving the image, the moving image pickup device 10-2 recognizes the image and judges whether the image includes the target identification of the shelf. The target identifier is used to characterize the integrity of a shelf.

Specifically, the mobile image capturing device 10-2 determines whether the image of the shelf corresponding to the identifier in the image includes the target identifier according to the corresponding relationship between each of the prestored plurality of shelf identifiers and the target identifier, thereby determining the integrity of the shelf in the image.

The description in step S102 may be referred to for the corresponding relationship between the target identifier, the shelf, and each of the plurality of shelf identifiers and the target identifier, which is not described in detail.

S202: the moving image capturing device 10-2 sends an image including the target identification of the shelf to the processing device 10-1.

Specifically, the moving image pickup device 10-2 may transmit the image including the target identifier to the processing device 10-1 at regular time, or the moving image pickup device 10-2 may transmit the image including the target identifier to the processing device 10-1 after receiving the request message transmitted from the processing device 10-1.

Alternatively, the mobile image capturing apparatus 10-2 may filter the images according to the time of capturing the image including the target mark and the content included in the image including the target mark, and send only the image including the target mark that was newly captured to the processing apparatus 10-1 for the image including the target mark including the same shelf. Thus, for the same goods shelf, the latest acquired image comprising the target mark can reflect the real situation of the goods in the current goods shelf, and redundant images can be reduced.

S203: the processing device 10-1 uses a preset algorithm to identify items on shelves in the image based on the received image.

Specifically, with reference to the description of S103, a detailed description is omitted.

Further optionally, as shown in fig. 9, the method provided in the embodiment of the present application further includes S204.

S204: when the processing device 10-1 determines that the number of the goods of the at least one goods in the goods shelves represented by the target identification is smaller than the preset threshold value, or when the processing device 10-1 determines that the ratio of the area of the goods of the at least one goods in the goods shelves represented by the target identification to the area of the goods is smaller than or equal to a threshold value, an alarm message is sent. The warning information may include the identity of the shelf and the type of the goods with the number smaller than a preset threshold.

Optionally, the backorder information includes at least one of a current quantity of the at least one item or a quantity of the item that needs to be replenished.

In the data management method provided in the embodiment of the present application, the mobile image capturing device 10-2 may further include a positioning device. When the moving image capturing device 10-2 includes the positioning device, the processing device 10-1 may also obtain the current location of the moving image capturing device 10-2, or may also obtain the track point of the moving image capturing device 10-2, and determine the hot spot moving track of the moving image capturing device 10-2 according to the obtained track point.

In one case: the moving image pickup device 10-2 records its own moving track during the movement. The moving track comprises a plurality of track points (also called as positions) and corresponding time of the track points. The moving image capturing device 10-2 determines a hot spot moving track of the moving image capturing device 10-2 according to the plurality of track points and the time corresponding to each track point in the plurality of track points.

Specifically, the moving image capturing device 10-2 may count the track points of the moving image capturing device 10-2 in a preset period of time, determine track points with the number of the same track points being greater than the third threshold value as hot spot track points, and determine the moving track formed by the hot spot track points as the hot spot moving track of the moving image capturing device 10-2.

In another case: the moving image capturing device 10-2 transmits the track point of the moving image capturing device 10-2 and the time corresponding to the track point to the processing device 10-1 during the movement. The processing device 10-1 determines a hot spot moving track of the moving image capturing device 10-2 according to the received plurality of track points of the moving image capturing device 10-2 and the time corresponding to each track point of the plurality of track points. The moving image capturing device 10-2 may send the track point to the processing device 10-1 at regular time, or the processing device 10-1 may send a request message to the moving image capturing device 10-2 at regular time, so that the moving image capturing device 10-2 feeds back the track point. The embodiment of the present application is not limited thereto.

In another case: the processing device 10-1 may determine the hot spot moving track of the image capturing device 10-2 moving in the whole supermarket according to the received plurality of track points of the plurality of moving image capturing devices 10-2 and the time corresponding to each track point of the plurality of track points.

Alternatively, the supermarket plan view may be marked as a plurality of areas, and the processing device 10-1 may determine the hot spot area in the whole supermarket according to the received plurality of track points of the plurality of moving image capturing devices 10-2 and the time corresponding to each track point of the plurality of track points.

For example, fig. 10 is a schematic diagram of the track recorded by the processing device 10-1 in a supermarket plan view. Wherein the dashed arrowed line is the trace recorded by the moving image capturing device 10-2. As can be seen from fig. 10, there are two tracks passing through the a area and 1 track passing through the B area, so the a area is a hot spot area compared to the B area.

In this way, the manager can identify user preferences based on the determined hotspot movement trajectory and place promotional items on shelves in the vicinity of the hotspot movement trajectory or hotspot area based on the user preferences.

The foregoing description of the solution provided by the embodiments of the present application has been mainly presented in terms of a method. To achieve the above functions, it includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will readily appreciate that the present application may be implemented in hardware or a combination of hardware and computer software, as the method steps of the examples described in connection with the embodiments disclosed herein. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The embodiment of the present application may divide the functional modules of the processing apparatus 10-1 according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated modules may be implemented in hardware or in software functional modules. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation.

Fig. 11 is a schematic structural diagram of a processing apparatus according to an embodiment of the present application. The processing means 90 may be arranged to perform the functions performed by the processing means in any of the embodiments described above (e.g. the embodiments shown in fig. 3 or fig. 9). The processing device 90 includes: an acquisition unit 901, a determination unit 902, and an identification unit 903. Wherein, acquisition unit 901: the method is used for acquiring images, and the images are shot by a camera arranged in the mobile device. Determination unit 902: for determining that the image includes a target identification of the shelf. The target identification is used to characterize the integrity of the shelf. The identification unit 903: and the method is used for identifying goods of the goods shelf in the image according to a preset identification algorithm. For example, in connection with fig. 3, the acquisition unit 901 may be used to perform the receiving step in S101. The determining unit 902 may be used to perform S102. The recognition unit 903 may be used to perform S103. Optionally, the processing device 90 further comprises a sending unit 904, which may be used for performing S104. In connection with fig. 9, the acquisition unit 901 may be used to perform the receiving step in S202, and the identification unit 903 may be used to perform S203. Alternatively, the transmitting unit 904 may be configured to perform S204.

Optionally, the determining unit 902 is specifically configured to: the determined image includes at least two identifications, each of the at least two identifications being for uniquely identifying the shelf.

Optionally, the shelf is a rectangular shelf, and the determining unit 902 is specifically configured to: the determined image comprises n identifications, and at least two identifications of the n identifications are respectively positioned at a first position and a second position of the rectangular shelf. The included angle between the connecting line of the first position and the second position and the horizontal line is within a preset angle range, and the distance between the first position and the second position is smaller than the preset distance. Each of the n identifications uniquely identifies a rectangular shelf, and n is an integer greater than or equal to 2.

Optionally, the first location and the second location are located on a same diagonal of the rectangular shelf, and a distance between the first location and the second location is equal to a length of the diagonal.

Optionally, the sending unit 904 is configured to send out alarm information when it is determined that the number of the items is smaller than a preset threshold.

Optionally, the acquiring unit 901 is further configured to: the method comprises the steps of obtaining a historical movement track of a camera, wherein the historical movement track comprises a plurality of track points and time corresponding to each track point in the plurality of track points. The determining unit 902 is further configured to: and determining the hot spot moving track of the camera according to the track points and the time corresponding to each track point in the track points.

In one example, referring to fig. 2, the receiving function of the acquiring unit 901 and the transmitting function of the transmitting unit 904 described above may be implemented by the interface unit 105 in fig. 2. The processing functions of the acquisition unit 901, the determination unit 902, and the recognition unit 903 described above may all be implemented by the processor 101 in fig. 2 calling a computer program stored in the memory 102.

Reference is made to the foregoing method embodiments for the detailed description of the foregoing optional modes, and details are not repeated herein. In addition, any explanation and description of the beneficial effects of the processing device 90 provided above may refer to the corresponding method embodiments described above, and will not be repeated.

It should be noted that the actions correspondingly performed by the above modules are only specific examples, and the actions actually performed by the respective units refer to the actions or steps mentioned in the description of the embodiments described above based on fig. 3 and 9.

The embodiment of the present application may divide the functional modules of the mobile image capturing device 10-2 according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated modules may be implemented in hardware or in software functional modules. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation.

Fig. 12 is a schematic structural diagram of an image capturing device according to an embodiment of the present application. The image acquisition apparatus 80 may be used to perform the functions performed by the image acquisition apparatus in any of the embodiments described above (e.g., the embodiments shown in fig. 3 or 9). The image acquisition device 80 includes: an acquisition unit 801, a determination unit 802, and a transmission unit 803. Wherein the acquisition unit 801: the method is used for acquiring images, and the images are shot by a camera arranged in the mobile device. A determining unit 802 determines that the image includes a target identification of the shelf. The target identification is used to characterize the integrity of the shelf. A transmitting unit 803 for transmitting the image to the processing apparatus for the processing apparatus to recognize the image. For example, in connection with fig. 3, the acquisition unit 801 may be used to perform S100, and the transmission unit 803 may be used to perform S101. In connection with fig. 9, the acquisition unit 801 may be used to perform S200, the determination unit 802 may be used to perform S201, and the transmission unit 803 may be used to perform S202.

Optionally, the determining unit 802 is specifically configured to: the determined image includes at least two identifications, each of the at least two identifications being for uniquely identifying the shelf.

Optionally, the shelf is a rectangular shelf, and the determining unit 802 is specifically configured to: the determined image comprises n identifications, and at least two identifications of the n identifications are respectively positioned at a first position and a second position of the rectangular shelf. The included angle between the connecting line of the first position and the second position and the horizontal line is within a preset angle range, and the distance between the first position and the second position is greater than or equal to a preset distance. Each of the n identifications uniquely identifies a rectangular shelf, and n is an integer greater than or equal to 2.

In one example, referring to fig. 2, the receiving function of the acquiring unit 801 and the transmitting function of the transmitting unit 803 described above may be implemented by the interface unit 105 in fig. 2. The processing functions of the acquisition unit 801 and the determination unit 802 described above can each be implemented by the processor 101 in fig. 2 calling a computer program stored in the memory 102.

Reference is made to the foregoing method embodiments for the detailed description of the foregoing optional modes, and details are not repeated herein. In addition, any explanation and description of the beneficial effects of the image capturing device 80 provided above may refer to the corresponding method embodiments described above, and will not be repeated.

The embodiment of the application also provides computer equipment, which comprises: a memory and a processor; the memory is used to store a computer program that is used by the processor to invoke the computer program to perform the actions or steps mentioned in any of the embodiments provided above.

Embodiments of the present application also provide a computer readable storage medium having stored thereon a computer program which, when run on a computer, causes the computer to perform the actions or steps mentioned in any of the embodiments provided above.

The embodiment of the application also provides a chip. The chip has integrated therein circuitry and one or more interfaces for implementing the functions of the processing means and/or the image acquisition means described above. Optionally, the functions supported by the chip may include processing actions in the embodiments described based on fig. 3 or fig. 9, which are not described herein. Those of ordinary skill in the art will appreciate that all or a portion of the steps implementing the above-described embodiments may be implemented by a program to instruct associated hardware. The program may be stored in a computer readable storage medium. The above-mentioned storage medium may be a read-only memory, a random access memory, or the like. The processing unit or processor may be a central processing unit, a general purpose processor, an application specific integrated circuit (application specific integrated circuit, ASIC), a microprocessor (digital signal processor, DSP), a field programmable gate array (field programmable gate array, FPGA) or other programmable logic device, transistor logic device, hardware components, or any combination thereof.

Embodiments of the present application also provide a computer program product comprising instructions which, when run on a computer, cause the computer to perform any of the methods of the above embodiments. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, a website, computer, server, or data center via a wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. Computer readable storage media can be any available media that can be accessed by a computer or data storage devices including one or more servers, data centers, etc. that can be integrated with the media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), or the like.

It should be noted that the above-mentioned devices for storing computer instructions or computer programs, such as, but not limited to, the above-mentioned memories, computer-readable storage media, communication chips, and the like, provided by the embodiments of the present application all have non-volatility.

Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed application, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Although the application has been described in connection with specific features and embodiments thereof, various modifications and combinations thereof can be made without departing from the spirit and scope of the application. Accordingly, the specification and drawings are merely exemplary illustrations of the present application as defined in the appended claims and are considered to cover any and all modifications, variations, combinations, or equivalents that fall within the scope of the application.

Claims

1. A method of data management, comprising:

acquiring an image, wherein the image is shot by a camera arranged in the mobile equipment;

determining that the image includes a target identification of a shelf; the target identifier is used for representing the integrity of the goods shelf, the goods shelf is a rectangular goods shelf, the target identifier of the goods shelf comprises n identifiers, and at least two identifiers in the n identifiers are respectively positioned at a first position and a second position of the rectangular goods shelf; the included angle between the connecting line of the first position and the second position and the horizontal line is within a preset angle range, and the distance between the first position and the second position is smaller than a preset distance; each of the n identifiers uniquely identifies the rectangular shelf, and n is an integer greater than or equal to 2;

and identifying goods of the goods shelves in the image according to a preset identification algorithm.

2. The method for data management as claimed in claim 1, wherein,

the first location and the second location are located at the same diagonal of the rectangular shelf, and a distance between the first location and the second location is equal to a length of the diagonal.

3. The data management method according to claim 1 or 2, characterized in that the data management method further comprises:

And when the number of the goods is determined to be smaller than the preset threshold value, sending out alarm information.

4. The data management method according to claim 1 or 2, characterized in that the data management method further comprises:

acquiring a historical movement track of the camera, wherein the historical movement track comprises a plurality of track points and time corresponding to each track point in the plurality of track points;

and determining the hot spot moving track of the camera according to the track points and the time corresponding to each track point in the track points.

5. A method of data management, comprising:

And sending the image to a processing device for identifying the goods of the goods shelf in the image.

6. The method for data management as claimed in claim 5, wherein,

7. A computer device, comprising: a memory for storing a computer program for executing the computer program to perform the method of any one of claims 1-4 or to perform the method of claim 5 or 6.

8. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when run on a computer, causes the computer to perform the method of any of claims 1-4 or to perform the method of claim 5 or 6.