CN113850105A

CN113850105A - Information processing method, device and equipment

Info

Publication number: CN113850105A
Application number: CN202010599207.0A
Authority: CN
Inventors: 应高选; 赵烽; 张宇翔; 蒋佳忆
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-06-28
Filing date: 2020-06-28
Publication date: 2021-12-28

Abstract

The embodiment of the application provides an information processing method, device and equipment. The method comprises the steps of acquiring a shelf picture acquired by a mobile robot in a target place; the target place is provided with at least one shelf, the at least one shelf is respectively provided with at least one article and a first information carrier at the display position of each article, and the first information carrier carries article information of the corresponding article; identifying a first information carrier in the shelf picture and article information carried by the first information carrier; shelf display information is generated based on item information of at least one item belonging to the same shelf. The technical scheme provided by the embodiment of the application realizes efficient and accurate information acquisition.

Description

Information processing method, device and equipment

Technical Field

The embodiment of the application relates to the technical field of computer application, in particular to an information processing method, device and equipment.

Background

At present, goods shelves are generally adopted for displaying and managing goods in off-line places such as supermarkets, convenience stores, warehouses, warehouse stores and the like.

In order to facilitate the management of articles, the operation of a place, and the like, it is generally necessary to know the display condition of the articles on the shelf. Because articles on the shelf can change frequently, a large amount of manpower and time cost can be consumed by adopting a manual recording mode, and the accuracy is not high, so that an efficient and accurate processing mode is urgently needed to realize the acquisition of shelf display information.

Disclosure of Invention

The embodiment of the application provides an information processing method, device and equipment, and aims to solve the technical problems that in the prior art, the information acquisition time is high in cost and inaccurate.

In a first aspect, an embodiment of the present application provides an information processing method, including:

acquiring a shelf picture acquired by a mobile robot in a target place; the target place is provided with at least one shelf, the at least one shelf is respectively provided with at least one article and a first information carrier at the display position of each article, and the first information carrier carries article information of the corresponding article;

identifying a first information carrier in the shelf picture and article information carried by the first information carrier;

shelf display information is generated based on item information of at least one item belonging to the same shelf.

In a second aspect, an embodiment of the present application provides an information processing method, including:

acquiring shelf distribution information based on a shelf distribution request for a target place;

outputting the shelf distribution information;

acquiring shelf display information of a target shelf based on a shelf display request for the target shelf in the shelf distribution information;

outputting the shelf display information; the shelf display information is generated by identifying a first information carrier in a shelf picture and article information carried by the first information carrier and based on article information corresponding to the same shelf; the shelf distribution information is generated by identifying a second information carrier in the shelf picture and shelf information carried by the second information carrier and based on the respective shelf information of the at least one shelf.

In a third aspect, an embodiment of the present application provides an information processing method applied to a mobile robot, where the method includes:

receiving a drawing instruction;

surveying and mapping in a target place, and constructing an electronic map of the target place;

receiving a polling instruction and determining a polling area in the electronic map;

moving in the target place based on the inspection area, and acquiring pictures at different acquisition point positions;

and sending the acquisition result to a server side so that the server side can obtain the shelf picture of the target place, identify the first information carrier in the shelf picture and the article information carried by the first information carrier, and generate shelf display information based on the article information of at least one article belonging to the same shelf.

In a fourth aspect, an embodiment of the present application provides an information processing apparatus, including:

the picture acquisition module is used for acquiring shelf pictures acquired by the mobile robot in a target place; the target place is provided with at least one shelf, the at least one shelf is respectively provided with at least one article and a first information carrier at the display position of each article, and the first information carrier carries article information of the corresponding article;

the information identification module is used for identifying a first information carrier in the shelf picture and article information carried by the first information carrier;

and the information generation module is used for generating shelf display information based on the article information of at least one article belonging to the same shelf.

In a fifth aspect, an embodiment of the present application provides an information processing apparatus, including:

the system comprises a first acquisition module, a second acquisition module and a display module, wherein the first acquisition module is used for acquiring shelf distribution information based on a shelf distribution request aiming at a target place;

the first output module is used for outputting the shelf distribution information;

the second information acquisition module is used for acquiring shelf display information of a target shelf based on a shelf display request aiming at the target shelf in the shelf distribution information;

the second output module is used for outputting the shelf display information; the shelf display information is generated by identifying a first information carrier in a shelf picture and article information carried by the first information carrier and based on article information corresponding to the same shelf; the shelf distribution information is generated by identifying a second information carrier in the shelf picture and shelf information carried by the second information carrier and based on the respective shelf information of the at least one shelf.

In a sixth aspect, an embodiment of the present application provides an information processing apparatus, including:

the map building module is used for receiving drawing instructions; surveying and mapping in a target place, and constructing an electronic map of the target place;

the area determining module is used for receiving a polling instruction and determining a polling area in the electronic map;

the picture acquisition module is used for moving in the target place based on the inspection area and acquiring pictures at different acquisition point positions;

and the picture sending module is used for sending the acquisition result to the server so that the server can obtain the shelf picture of the target place, identify the first information carrier in the shelf picture and the article information carried by the first information carrier, and generate shelf display information based on the article information of at least one article belonging to the same shelf.

In a seventh aspect, an embodiment of the present application provides an information processing system, including a mobile robot and a server;

the mobile robot is used for collecting pictures in a target place and sending a collection result to the server; the target place is provided with at least one shelf, at least one article is respectively displayed on the at least one shelf, a first information carrier is arranged at the display position of each article, and the first information carrier carries article information of the corresponding article;

the server is used for acquiring shelf pictures acquired by the mobile robot, identifying a first information carrier in the shelf pictures and article information carried by the first information carrier, and generating shelf display information based on the article information of at least one article belonging to the same shelf.

In an eighth aspect, embodiments of the present application provide a computing device, including a processing component and a storage component;

the storage component stores one or more computer instructions; the one or more computer instructions are adapted to be invoked and executed by the processing component to implement the information processing method according to the first aspect.

In a ninth aspect, an embodiment of the present application provides an electronic device, including a processing component, a display component, and a storage component;

the storage component stores one or more computer instructions; the one or more computer instructions are adapted to be invoked and executed by the processing component to implement the information processing method according to the second aspect.

In a tenth aspect, an embodiment of the present application provides a mobile robot, including a processing component, a collecting component, and a storage component;

the storage component stores one or more computer instructions; the one or more computer instructions are configured to be invoked and executed by the processing component to implement the information processing method according to the third aspect.

In an eleventh aspect, the present application provides in an embodiment a computer storage medium storing a computer program, which when executed by a computer, implements the information processing method according to the first aspect.

In a twelfth aspect, an embodiment of the present application provides a computer storage medium storing a computer program, wherein the computer program, when executed by a computer, implements the information processing method according to the second aspect.

In a thirteenth aspect, the present application provides, in an embodiment, a computer storage medium storing a computer program, which when executed by a computer, implements the information processing method according to the third aspect.

In the embodiment of the application, articles are displayed in the shelf of the target place, the first information carrier bearing article information is arranged at the corresponding display position of the article, the mobile robot collects the image in the target place and uploads the image to the server, the server can obtain the shelf image in the target place, the first information carrier in the shelf image and the article information borne by the first information carrier can be identified by identifying the shelf image, so that the shelf display information of the shelf can be automatically generated based on the article information of at least one article belonging to the same shelf, only the first information carrier is required to be correspondingly arranged at the display position of the article in the shelf, the article information borne by the first information carrier can be automatically identified and obtained by moving the shelf image collected by the robot, the shelf display information is automatically generated, and the workload of manual participation is reduced, therefore, efficient and accurate information acquisition is realized.

These and other aspects of the present application will be more readily apparent from the following description of the embodiments.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

FIG. 1 is a flow chart illustrating one embodiment of an information processing method provided herein;

FIG. 2 is a flow chart illustrating a further embodiment of an information processing method provided by the present application;

FIG. 3 is a flow chart illustrating a further embodiment of an information processing method provided by the present application;

FIG. 4a is a schematic system interaction diagram illustrating an information processing procedure in a practical application according to an embodiment of the present application;

FIG. 4b is a schematic diagram illustrating interaction of a flow in an information processing process in an actual application according to the embodiment of the present application;

FIG. 4c is a schematic diagram of an implementation form of the shelf distribution information in a practical application according to the embodiment of the present application;

FIG. 4d is a schematic diagram of an implementation of the shelf display information in a practical application according to the embodiment of the present application;

FIG. 5 is a schematic diagram illustrating an embodiment of an information processing apparatus provided herein;

FIG. 6 illustrates a schematic structural diagram of one embodiment of a computing device provided herein;

FIG. 7 is a schematic diagram illustrating an information processing apparatus according to yet another embodiment of the present disclosure;

FIG. 8 is a schematic diagram illustrating an embodiment of an electronic device provided by the present application;

FIG. 9 is a schematic diagram illustrating an information processing apparatus according to yet another embodiment of the present disclosure;

fig. 10 shows a schematic structural diagram of an embodiment of a mobile robot provided by the present application.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

In some of the flows described in the specification and claims of this application and in the above-described figures, a number of operations are included that occur in a particular order, but it should be clearly understood that these operations may be performed out of order or in parallel as they occur herein, the number of operations, e.g., 101, 102, etc., merely being used to distinguish between various operations, and the number itself does not represent any order of performance. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.

The technical scheme of the application can be suitable for various offline places with shelves, such as small convenience stores, large supermarkets, warehouses, storage type malls and the like.

With the advent of the intelligent era, the requirements of the offline places on digital operation are higher and higher, shelf digitalization is an important part of the intelligent era, and shelf digitalization at least needs to know the display situation of shelves, which is very important for article management and place operation. To know the shelf display situation, the commodity information of each commodity on the shelf needs to be known, and the commodity information usually changes frequently, if the shelf display information is recorded manually, a lot of time and cost are consumed, the accuracy is not high due to untimely updating, and the like.

In order to achieve automatic, efficient and accurate acquisition of shelf display information, the inventor provides a technical scheme of the application through a series of researches, in the embodiment of the application, articles are displayed in shelves in a target place, a first information carrier bearing article information is arranged at a display position corresponding to the articles, a mobile robot collects images in the target place and uploads the images to a server, the server can obtain shelf images in the target place, and the first information carrier in the shelf images and the article information borne by the first information carrier can be identified by identifying the shelf images, so that the shelf display information of each shelf can be automatically generated based on the article information belonging to the articles in the same shelf. The technical scheme of this application only needs article display position to correspond in goods shelves and sets up first information carrier, and the goods shelves picture of gathering through mobile robot can automatic identification obtain the article information that first information carrier bore, reduces artifical participation work load to high efficiency, accurate acquisition of display information have been realized.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Fig. 1 is a flowchart of an embodiment of an information processing method provided in an embodiment of the present application, where a technical solution of the embodiment may be executed by a server, and the method may include the following steps:

101: and acquiring shelf pictures acquired by the mobile robot in a target place.

Wherein at least one shelf can be deployed in the target site; each shelf can display at least one article and is provided with a corresponding first information carrier at the respective display position of each article; the first information carrier carries article information of an article corresponding to the first information carrier. In practical application, the first information carrier can be a bar code, a two-dimensional code, a three-dimensional code or other graphic codes, and the first information carrier can be arranged in a price tag because the price tag corresponding to an article is usually arranged in a shelf; the price tag may be an electronic price tag or a paper price tag, and the like, which is not specifically limited in the present application, and certainly, for the consideration of deployment cost, a paper price tag may be adopted.

The mobile robot is a machine device capable of automatically executing work, can receive human commands, can run a pre-arranged program, can perform actions according to principles formulated by artificial intelligence technology, and is generally a comprehensive system integrating multiple functions of environment perception, dynamic decision and planning, behavior control and execution and the like. The mobile robot can move autonomously, and the moving mode can adopt a wheel mode, a crawler mode and the like, and the application is not limited to the method as in the prior art. The mobile robot can receive corresponding instructions and execute corresponding operations.

In the embodiment of the application, the mobile robot can move in a target place and collect pictures based on the inspection instruction, the collection result is uploaded to the server side, and the server side can obtain shelf pictures. The patrol instruction may be sent by the user or sent to the mobile robot by the service end upon a user request, etc.

Wherein, the shelf picture can comprise at least one; in practice, multiple shelves in the target site may be arranged side-by-side, and thus, a shelf picture may refer to a picture that includes one or more complete shelves.

Optionally, the acquisition result of the mobile robot may include a plurality of to-be-processed pictures, and the server may perform picture processing operations such as repeated region detection and/or image stitching and cropping processing on the plurality of to-be-processed pictures to obtain the shelf pictures, where the picture processing operations are conventional image processing operations, which are the same as in the prior art and are not described herein again.

The mobile robot can automatically plan a path and automatically avoid control operations such as obstacle processing and the like in a target place in the picture acquisition process, the specific control operation is the same as that in the prior art, and the method is not specifically limited in the application.

In addition, as another optional mode, the shelf may also collect pictures of the shelf, and the picture to be processed in the collection result of the mobile robot is assumed to be a first picture, where the first picture may include a plurality of pictures, and optionally, a second picture obtained by the shelf by collecting the shelf of the shelf by at least one shelf respectively may also be obtained; so that a shelf picture can be obtained based on the first picture and the second picture.

The first picture and the second picture can be subjected to picture processing operations such as repeated region detection and/or image splicing and clipping processing to obtain shelf pictures, so that the obtained shelf pictures are more accurate.

In addition, as yet another alternative, some image capturing devices, such as a monitoring camera and the like, may also be fixedly deployed at a specific position in the target site, for example, for performing pedestrian monitoring and the like, and therefore, the image capturing may also be implemented by using these fixedly deployed image capturing devices, and therefore, optionally, obtaining a shelf picture captured by the mobile robot at the target site may include:

acquiring a first picture acquired by a mobile robot in a target place;

acquiring a third picture acquired by image acquisition equipment fixedly deployed in the target site;

and obtaining a shelf picture based on the first picture and the third picture.

The picture to be processed in the acquisition result of the mobile robot is assumed to be a first picture, and the picture acquired by the image acquisition device is assumed to be a third picture, wherein the image acquisition device may include a plurality of pictures, and the third picture may also include a plurality of pictures, which is not specifically limited in the present application. Based on the first picture and the third picture, the shelf picture can be obtained through picture processing operations such as repeated region detection and/or image splicing and clipping processing, so that the obtained shelf picture is more accurate.

Of course, as another optional mode, the second picture acquired by the shelf or the third picture acquired by the image acquisition device may be sent to the mobile robot, the mobile robot combines with the first picture acquired by itself, and after obtaining the shelf picture through the picture processing operation, the shelf picture is sent to the server, and the server may directly perform subsequent processing operation on the shelf picture uploaded by the mobile robot.

In addition, as another optional mode, the server may also obtain a shelf picture based on a first picture acquired by the mobile robot, a second picture acquired by the shelf, and a third picture acquired by the image acquisition device;

of course, the mobile robot may also upload the shelf pictures to the server after processing the shelf pictures based on the first picture acquired by the mobile robot, the second picture acquired by the shelf, and the third picture acquired by the image acquisition device.

102: and identifying the first information carrier in the shelf picture and the article information carried by the first information carrier.

Since the first information carriers are correspondingly arranged at the display positions of the articles on each shelf, the first information carriers in the shelf pictures can be identified by identifying the shelf pictures, and then the first information carriers are identified, so that the article information of the articles represented by each first information carrier can be obtained from the first information carriers.

The article information may include, for example, an article identifier, and may further include article-related description information, for example, when the article is a product sold by a supermarket, the article-related description information may include a product price, a product origin, and product attributes such as size, weight, or quantity.

103: shelf display information is generated based on item information for at least one item belonging to the same shelf.

For each shelf, shelf display information corresponding to each shelf may be generated based on the item information pertaining to at least one item on the shelf, and the shelf display information for each shelf may include the item information of the at least one item displayed thereon. The at least one item belonging to the same shelf may refer to all items displayed on the shelf, that is, the shelf display information is generated based on the information on the items carried by all the first information carriers belonging to the shelf, which is obtained by identification.

As an alternative, the item information may further include a display position of the item in the shelf, and thus, the shelf display information may be generated based on the display position of at least one item belonging to the same shelf and the item-related description information including the item identifier. Thus, the article-related description information such as the display position of the article on the shelf and the article identification can be obtained from the shelf display information.

As another alternative, the first carrier position of the first information carrier in the shelf picture can also be identified; since each first information carrier represents an item, the display position of its corresponding item in the shelf can be determined on the basis of the first carrier position of the first information carrier. Thus, in this alternative, the method may further comprise:

identifying a first carrier position of a first information carrier in the shelf picture;

determining a display position of its corresponding item in the shelf based on the first carrier position of the first information carrier;

step 103 may generate shelf display information based on the display location and item information of at least one item belonging to the same shelf.

The shelf display information may be stored as structured information, but may also be stored in other ways, such as in the form shown, and will be described in detail in the corresponding embodiments below.

When a plurality of shelves are included in the target location, in order to determine the items belonging to the same shelf, as an optional mode, the item information may further include shelf identifiers of shelves on which the items are located, so that the items belonging to the same shelf or the first information carrier may be determined based on the shelf identifiers.

Since the display position of the article in the target place may be changed at any time, when the first information carrier is arranged on the price tag, only the article identification and the article related description can be included, so that when the display position of the article is changed, the corresponding price tag is replaced with the deployment position, and the first information carrier does not need to be regenerated. Then, as an alternative, in order to determine items belonging to the same shelf, a second information carrier carrying information about the respective shelf may be provided in each shelf; the shelf information may include at least a shelf identifier and a shelf attribute, and the shelf attribute may include, for example, a category to which an article displayed on the shelf belongs, such as clothes, department, or care. In this alternative, the method may further include:

identifying a second carrier position of a second information carrier in the shelf picture;

determining shelf display pictures corresponding to each shelf in the shelf pictures based on the second carrier positions of different second information carriers;

generating shelf display information based on item information for at least one item belonging to the same shelf may comprise:

shelf display information is generated on the basis of information on items carried by at least one first information carrier located in the same shelf display picture.

Wherein each first information carrier represents an item and each shelf display picture may refer to a picture comprising only one complete shelf. Optionally, the first carrier position of each first information carrier in the display picture of the shelf on which it is located can also be identified, so that the display position of the items in the shelf can be determined on the basis of the first carrier position of the first information carrier. The shelf display information can thus be generated on the basis of the item information carried by the at least one first information carrier and the display position of the respective corresponding item in the same shelf display picture.

Alternatively, for the convenience of determining shelf display pictures for each shelf, the deployment positions of the second information carriers in different shelves may be the same, e.g. the second information carrier may be deployed at the left border in the shelf and the picture area located in the middle of the two second information carriers may belong to the shelf identified by the second information carrier on the left. In practical application, the second information carrier may be a bar code, a two-dimensional code, a three-dimensional code or other graphic code.

In practice, the shelves typically include multiple tiers of shelves, and the display locations for the items may include the tiered locations of the items in the shelves and the arrangement locations of the items in each tier. Optionally, clustering may be performed on the first carrier positions of different first information carriers, and the first information carriers located on the same layer of the support are determined, so as to obtain the hierarchical positions of the first information carriers; then, the first carrier positions of the first information carriers located in the same layer may be subjected to a sorting process, so as to obtain the arrangement positions of the first information carriers in the same layer, and the hierarchical position and the arrangement position of the first information carriers may be used as the hierarchical position and the arrangement position of the corresponding articles in the shelf.

In this embodiment, articles are displayed in shelves in a target place, a first information carrier bearing article information is disposed at a display position corresponding to the articles, a mobile robot collects images in the target place and uploads the images to a server, the server can obtain shelf images in the target place, and the first information carrier in the shelf images and the article information carried by the first information carrier can be identified by identifying the shelf images, so that shelf display information of each shelf can be automatically generated based on the article information belonging to the same shelf. The technical scheme of this application only needs article display position to correspond in goods shelves and sets up first information carrier, and the goods shelves picture of gathering through mobile robot can automatic identification obtain the article information that first information carrier bore, reduces artifical participation work load to high efficiency, accurate acquisition of display information have been realized.

Since a plurality of shelves can be deployed in the target site, in the case that a plurality of shelves are deployed in the target site, in order to facilitate understanding of distribution information of the shelves in the target site, as can be seen from the foregoing description, each shelf may be provided with a second information carrier carrying shelf information. Thus, in some embodiments, the method may further comprise:

identifying a second information carrier in the shelf picture and shelf information carried by the second information carrier;

shelf distribution information is generated based on shelf information of each of at least one shelf in the target location.

The shelf information may include information such as shelf identifiers and shelf attributes.

As an alternative, the shelf identifier may refer to a shelf position of the shelf in the target location, and thus the shelf distribution information may be generated based on the shelf position and the shelf attribute of at least one shelf.

Of course, as another alternative, the mobile robot performs image acquisition at different acquisition point locations, and may record acquisition coordinates of the different acquisition point locations in the target site. Accordingly, the method may further comprise:

determining the shelf positions of at least one shelf in the target place respectively based on the corresponding acquisition coordinates of the shelf pictures in the target place;

generating shelf distribution information based on the respective shelf information of the at least one shelf may comprise:

shelf distribution information is generated based on the respective shelf location of the at least one shelf and the shelf information.

Alternatively, the acquired coordinates corresponding to the shelf picture may be used as the shelf position of the shelf in the target place.

When the shelf picture is obtained by splicing and/or cutting at least one to-be-processed picture acquired by the mobile robot, the acquisition coordinate corresponding to the shelf picture can be obtained by fusing the acquisition coordinate of the at least one to-be-processed picture corresponding to the shelf picture, for example, the average value of the acquisition coordinates of the at least one to-be-processed picture can be used as the acquisition coordinate corresponding to the shelf picture.

In some embodiments, the method may further comprise:

identifying the articles in the shelf picture to obtain article mattes;

establishing a binding relationship between the article matting and the article information;

generating shelf display information based on item information for at least one item belonging to the same shelf comprises:

and generating shelf display information based on the article information of at least one article belonging to the same shelf and the article matting bound by the article information.

In the embodiment of the application, the articles in the shelf picture can be detected and identified, so that the article cutout is obtained, wherein the article identification mode is the same as that in the prior art, for example, the pre-trained model can be used for positioning the article detection frame where the articles in the shelf picture are located, and the image area in the article detection frame is used as the article cutout.

The method comprises the following steps of establishing a binding relationship between the article matting and the article information, wherein the binding relationship between the article matting and the article information can be realized according to the following modes:

identifying a matting position of an article matte in a shelf picture and a first carrier position of a first information carrier in the shelf picture;

and establishing a binding relation between the article cutout and the article information based on the cutout position of the article cutout and the first carrier position of the first information carrier.

The article matting and the first information carrier, which have the same position of the matting position and the first carrier position or the position distance difference within the error range, can be regarded as corresponding to the same article, so that the binding relationship can be established. Further, the shelf display information may be generated based on the article information of at least one article belonging to the same shelf and the article cutout bound to the article information. The goods shelf display information can not only know the goods information, but also search the corresponding goods cutout.

Furthermore, a matting position of the article matting and a first carrier position of the first information carrier can be obtained, and the matting position and the first carrier position can be bound, so that the display position of the article can also be determined on the basis of the matting position. Thus, in some embodiments, the method may further comprise:

determining a display position of the corresponding item in the shelf based on the matte position of the item matte or the first carrier position of the first information carrier;

generating shelf display information based on item information for at least one item belonging to the same shelf and item matting of the item information binding may comprise:

and generating shelf display information based on the display position, the article information and the article cutout which respectively correspond to at least one article belonging to the same shelf.

In some embodiments, the method may further comprise:

based on the second carrier positions of different second information carriers, carrying out picture processing on shelf pictures to obtain shelf display pictures corresponding to different shelves;

generating shelf distribution information based on the respective shelf information of the at least one shelf comprises:

and generating shelf distribution information based on the shelf information of at least one shelf and the corresponding shelf display picture.

That is, the shelf distribution information may include shelf information of each shelf and a shelf display picture corresponding to the shelf information; the shelf distribution information can be used for knowing the shelf distribution condition in the target place and checking shelf display pictures of each shelf.

The shelf display information and the shelf distribution information may be stored in the form of structured information, or may be stored in the form of a display map or a distribution map constructed in the form of a graphic representation.

Thus, in some embodiments, generating shelf distribution information based on the respective shelf information of at least one shelf may comprise:

and dividing the shelf area in the electronic map of the target place based on the shelf information of at least one shelf to obtain a shelf distribution map.

The electronic map of the target location may be a two-dimensional planar map of the target location, which may be pre-constructed, or may be constructed by mapping with a mobile robot, which will be described below.

In some embodiments, generating shelf display information based on item information for at least one item belonging to the same shelf may comprise:

a shelf display map is generated based on item information of at least one item belonging to the same shelf.

Alternatively, the shelf display map may be generated based on the display position of at least one item belonging to the same shelf and the item information.

Alternatively, a shelf display map may be generated based on, in particular, the display location of at least one item belonging to the same shelf, item information, and item matting.

In addition, the method may further include:

and establishing an association relation between the shelf display map and the shelf distribution map to generate an article distribution map of the target place.

Due to the regional distribution of different shelves shown in the shelf distribution map, each shelf in the shelf distribution map can be associated with a corresponding shelf display map, so that the associated shelf display map is requested to be obtained for any shelf in the shelf distribution map.

The object distribution map may have a variety of usage scenarios, and may be provided to relevant persons, such as management persons at the target site, or customers entering the target site, for example.

The item search and the like can be performed based on the item distribution map, and therefore, after the item distribution map is obtained, in one practical application, the method may further include:

outputting a shelf distribution map in the article distribution map;

receiving a search request for a target item;

searching a target shelf where the target article is located;

and outputting a shelf display map corresponding to the target shelf.

When a map output request for the article distribution map is received, outputting a shelf distribution map in the article distribution map; the goods distribution map is composed of a shelf distribution map and a shelf display map, so that the goods distribution map is responded to a map output request, and particularly the shelf distribution map is output;

the search request can include the item identifier of the target item, and the item information includes the item identifier, so that the target shelf where the item is located can be determined based on the item identifier, a shelf display map corresponding to the target shelf can be searched, and the shelf display map is output to facilitate the user to view.

The target item may be marked on the shelf display map, and for example, a specific mark symbol may be provided at the display position of the target item.

In yet another practical application, after obtaining the distribution map of the article, the method may further include:

outputting a shelf distribution map in the article distribution map;

receiving a navigation request of a user for a target item;

searching a target shelf where the target article is located;

generating a navigation route based on the shelf position of the target shelf and the user position;

the navigation route is output in the shelf distribution map.

It should be noted that there may be a variety of application scenarios based on the article distribution map, and this application is not limited in this respect.

Further, in some embodiments, the method may further comprise:

and establishing the incidence relation between the shelf display information and the shelf distribution information to obtain the article distribution information.

That is, the shelf display information and the shelf distribution information may be associated with each other to obtain the article distribution information. The article distribution information includes the shelf distribution information and shelf display information associated with each shelf in the shelf distribution information.

Because the second information carrier can be arranged in the shelf, the shelf identification can be identified and obtained, the shelf display information corresponding to each shelf can be determined based on the shelf identification, and the association relation with the shelf distribution information is further established.

There may be a variety of application scenarios for the item distribution information, for example, in some embodiments, the method may further comprise:

and providing the article distribution information to related personnel.

These related persons may refer to, for example, managers at the target site, customers who enter the target site, or item providers.

Further, in some embodiments, the method may further comprise:

based on the article distribution information, it is determined whether there is an abnormal display condition.

It may be determined whether a display anomaly exists in each shelf in combination with shelf display information in the item distribution information.

Since the shelf display information may include article information, article matting, display position, and the like of each article, the display abnormal condition may be that the display position of the article is different from a preset position, for example; the item description information and the pre-configuration information of the item are different, such as the price of the item is different from the pre-configuration price; or the article matting is not consistent with the actual image of the article, and the like, so as to realize the detection of abnormal conditions such as shortage of goods, misplacement of goods, and the like.

In addition, when an abnormal display condition exists, a display early warning and the like can be performed on the relevant person, and the early warning manner can be, for example, sending early warning information to the relevant person through various communication forms, and the like, which is not particularly limited in the present application.

As can be seen from the foregoing description, the shelf image may be acquired by the mobile robot moving in the target site, and in order to obtain a more accurate shelf image, in some embodiments, the method may further include:

controlling the mobile robot to carry out surveying and mapping in a target place, and constructing an electronic map of the target place;

determining a routing inspection area in the electronic map;

and controlling the mobile robot to move in the target place based on the inspection area, and acquiring pictures at different acquisition point positions.

Therefore, the mobile robot can upload the acquisition result to the server side, and the server side can obtain the shelf picture from the acquisition result.

The way of surveying and mapping and constructing the electronic map by the mobile robot is the same as that of the prior art, and is not described herein again.

Alternatively, a mapping instruction may be sent to the mobile robot based on a user-triggered mapping request to trigger the mobile robot to map in the target site in response to the mapping instruction, building an electronic map of the target site.

The inspection area can be selected and determined in the electronic map by the user according to the position of the goods shelf. Thus, optionally, determining the patrol area in the electronic map may be:

and determining a routing inspection area in the electronic map based on the user selection operation.

After the electronic map is constructed and obtained, the electronic map can be displayed for the user to perform selection operation.

After the inspection area is determined, the mobile robot can be controlled to move in the target place based on the inspection area, so that the pictures are acquired at different acquisition point positions. The mobile robot can automatically perform control operations such as path regulation, obstacle avoidance processing and the like according to the routing inspection area.

Optionally, the method may include receiving a patrol request triggered by a user, sending a patrol instruction to the mobile robot, so that the mobile robot responds to the patrol instruction, moves in the target place based on the patrol area, and acquires the picture at different acquisition points.

The patrol inspection instruction can comprise the patrol inspection area, and in addition, the patrol inspection instruction can also comprise position information of different acquisition point positions and the like.

Of course, as another optional implementation manner, the training instruction may include an inspection step length, such as 1 meter, and the different collection point locations may be determined by the mobile robot in combination with the inspection area and the inspection step length.

Due to the fact that the target place may have the regions such as the passageways where the shelves are not placed, the mobile robot inevitably collects the pictures without the shelves in the picture collection process.

Therefore, as an alternative, acquiring a shelf picture acquired by the mobile robot at the target site may include:

acquiring a to-be-processed picture acquired and obtained by a mobile robot in a target place;

and filtering the invalid picture based on the acquisition coordinate corresponding to the picture to be processed to obtain the shelf picture.

The mobile robot collects the acquired to-be-processed pictures at different collection point positions, and can determine the collection coordinates of the different collection point positions based on the constructed electronic map, so that if the collection coordinates are aisle coordinates, the to-be-processed pictures can be considered as invalid pictures, and the invalid pictures can be filtered from the collection results.

As another alternative, the obtaining of the shelf picture acquired by the mobile robot at the target site includes:

identifying an information carrier of the picture to be processed;

and filtering the invalid picture based on the identification result to obtain the shelf picture.

Because the shelf is provided with the first information carrier and the second information carrier, the picture to be processed can be identified, if any information carrier does not exist in the picture to be processed based on the identification result, the picture to be processed can be considered as an invalid picture, and the invalid picture can be filtered from the acquisition result.

Of course, the server may filter the invalid picture by combining the collected coordinates and the recognition result at the same time.

In addition, the remaining to-be-processed pictures after the invalid pictures are filtered out may be directly used as shelf pictures, and the shelf pictures may be obtained by performing picture processing operations such as repeat region detection, image stitching and/or clipping on the to-be-processed pictures, which have been described above, and are not described here any more.

Fig. 2 is a flowchart of an information processing method according to another embodiment of the present application, which introduces the technical solution of the present application from the perspective of applying shelf display information and shelf distribution information, and the method may include the following steps:

201: shelf distribution information is obtained based on the shelf distribution request for the target location.

The technical scheme of the embodiment can be executed by the user side, the shelf distribution request is triggered by the user, and shelf distribution information can be acquired from the server side based on the shelf distribution request.

The user terminal can be a user terminal corresponding to a worker in the target place, a customer in the target place or an article provider in the target place. So that shelf distribution information may be provided to staff, customers, or item providers, etc.

202: and outputting the shelf distribution information.

203: and acquiring shelf display information of the target shelf based on the shelf display request aiming at the target shelf in the shelf distribution information.

The shelf distribution information indicates the distribution of at least one shelf in the target location, and may include shelf information such as a shelf identifier and shelf attributes for each shelf, and information such as shelf display pictures.

Alternatively, the shelf information in the shelf distribution information may be output first, and in response to a picture viewing request for any one of the shelves, the corresponding shelf display picture may be output again.

After the shelf distribution information is output, a trigger control for each shelf can be output, and the shelf display request can be generated by a user executing a trigger operation for the trigger control of the target shelf. Based on the shelf display request, shelf display information of the target shelf may be acquired from the server. The shelf display request can include shelf identification, and the server can search corresponding shelf display information based on the shelf identification.

204: and outputting shelf display information.

The shelf display information of the target shelf is output, so that the article display condition of the target shelf can be viewed. The shelf display information can include article information, display position, article matting and the like.

Alternatively, outputting shelf display information may be outputting item information and display location first, in response to a picture viewing request for any item, outputting the corresponding item cutout again, and so on.

The shelf display information is generated by identifying a first information carrier in a shelf picture and article information carried by the first information carrier and based on article information corresponding to the same shelf; the shelf distribution information is generated by identifying the second information carrier in the shelf picture and shelf information carried by the second information carrier and based on the respective shelf information of at least one shelf.

The detailed generation process of the shelf display information and the shelf distribution information can be described in the foregoing embodiments, and will not be described repeatedly herein.

In some embodiments, the shelf distribution information may be a shelf distribution map generated based on the respective shelf information of the at least one shelf and an electronic map of the target location;

the outputting of the shelf distribution information may include:

outputting a shelf distribution map, and displaying shelf information corresponding to at least one shelf in the shelf distribution map;

optionally, it may be specific to show shelf attributes in the shelf information, such as categories and the like.

Then obtaining shelf display information for the target shelf based on the shelf display request for the target shelf in the shelf distribution information may include:

and detecting a shelf display request triggered by a target shelf in the shelf distribution map, and acquiring shelf display information of the target shelf corresponding to the target shelf information.

The distribution conditions and the category conditions of different shelves can be checked in the shelf distribution map, a user can perform selection operation and the like in the shelf distribution map, a shelf display request can be triggered by the selection operation of the area where the target shelf is located in the shelf distribution map, and the target shelf can refer to any shelf.

Alternatively, the shelf display information may be a shelf display map generated based on at least item information of at least one item belonging to the same shelf,

the output shelf display information may specifically be an output shelf display map.

In practical application, the user can conveniently know the distribution condition of the articles in the target place, whether the articles are out of stock and the like by checking the shelf distribution information and the shelf display information. In addition, the shelf in the area with larger passenger flow volume can be determined by combining the passenger flow volume situation, the shelf attribute and shelf display information of the shelf can be known, and the hot or cold goods can be determined. In short, a variety of applications can be realized using the shelf display information and the shelf distribution information, which is not particularly limited in this application.

Fig. 3 is a flowchart of an information processing method according to another embodiment of the present application, which is described in the present application from the perspective of executing a mobile robot, and the method may include the following steps:

301: a drawing instruction is received.

The drawing instruction can be triggered by the user directly to the mobile robot, or the service end sends the drawing instruction to the mobile robot based on the user request.

302: and mapping in the target place, and constructing an electronic map of the target place.

303: and receiving a polling instruction and determining a polling area in the electronic map.

Wherein, can include this region of patrolling and examining in the instruction of patrolling and examining, can also include the collection step length in addition to it confirms the collection point position to move the robot.

Accordingly, the method may further comprise:

determining a collection step length based on the inspection instruction;

and planning the acquisition point location based on the acquisition step length.

304: the method is characterized in that the method moves in a target place based on a routing inspection area, and picture acquisition is carried out at different acquisition point positions.

The mobile robot can also automatically plan a moving path based on the inspection area and perform operation such as obstacle avoidance processing.

305: and sending the acquisition result to a server side so that the server side can obtain a shelf picture of a target place, identify a first information carrier in the shelf picture and article information carried by the first information carrier, and generate shelf display information based on the article information of at least one article belonging to the same shelf.

According to the embodiment, the mobile robot can be used for rapidly completing map construction and picture collection of the target place, picture collection in the target place is automatically achieved, efficiency is high, accuracy is achieved, the server can be combined with the goods shelf pictures to generate goods shelf display information in the target place, semantization and visualization of goods shelf display are automatically achieved, workload of manual participation is reduced, and efficient and accurate information acquisition is achieved.

In some embodiments, the acquiring the pictures at the different acquisition points may include:

acquiring pictures at different acquisition point positions and determining acquisition coordinates; and the acquisition coordinates are used for filtering invalid pictures in the acquisition result by the server side so as to obtain shelf pictures.

The acquisition coordinate and the to-be-processed picture in the acquisition result can be simultaneously sent to the server side for the server side to filter the picture and the like.

In some embodiments, the method may further comprise:

acquiring a picture acquired by image acquisition equipment; wherein the image acquisition device is fixedly deployed in the target site;

and acquiring the acquisition result based on the images acquired at different acquisition point positions and the images acquired by the image acquisition equipment.

Optionally, the acquisition result may directly include pictures acquired by the mobile robot at different acquisition points and pictures acquired by the image acquisition device.

In addition, as another optional mode, a shelf picture may be obtained based on pictures acquired at different acquisition points and pictures acquired by the image acquisition device;

and sending the shelf picture as an acquisition result to a server.

That is, the mobile robot can perform image processing operations such as repeated region detection and/or image splicing and clipping on the images acquired at different acquisition points and the images acquired by the image acquisition equipment to obtain shelf images, and then upload the shelf images to the server; of course, the pictures acquired at different acquisition points and the pictures acquired by the image acquisition equipment can also be directly sent to the server, and the server performs image processing operation and the like to acquire shelf pictures.

The pictures acquired by the mobile robot at different acquisition points are assumed to be a first picture, which may include a plurality of pictures, the pictures acquired by the image acquisition device are assumed to be a third picture, which may include a plurality of pictures, and the process of processing the first picture and the third picture to obtain the shelf picture can be described in detail in the foregoing, and is not repeated herein.

In addition, in some embodiments, the shelf may also acquire a picture of the shelf itself, and if a second picture is obtained, the mobile robot may further obtain second pictures acquired by at least one shelf on the shelf itself; therefore, the acquisition result can be obtained based on the first picture and the second picture acquired at different acquisition points.

The acquisition result may be composed of the first picture and the second picture, or may be composed of shelf pictures obtained by performing picture processing based on the first picture and the second picture.

The technical scheme of this application embodiment can be applied to supermarket, convenience store, storehouse formula market etc. in providing the off-line place that the commodity was sold, article specifically sell for commodity promptly in practical application, can realize the goods shelves display information in the off-line place and the formation of goods shelves distribution information automatically through the technical scheme of this application embodiment, need not artifical record, reduced artifical participation volume, realized high-efficient, accurate information acquisition.

The application also provides an information processing system which can comprise a mobile robot and a server;

and the server is used for acquiring shelf pictures acquired by the mobile robot, identifying a first information carrier in the shelf pictures and article information carried by the first information carrier, and generating shelf display information based on the article information of at least one article belonging to the same shelf.

Specific operations performed by the mobile robot may be described in detail in the embodiment of fig. 3, and specific operations performed by the server may be described in detail in the embodiment of fig. 1, which are not repeated herein.

In addition, the system can also comprise a user terminal;

the server side can also be used for sending the shelf display information to the user side;

and the user side can be used for outputting the shelf display information.

Certainly, the user side can send a shelf distribution request for a target place to the server side to obtain shelf distribution information and output the shelf distribution information; based on the shelf display request for the target shelf in the shelf distribution information, shelf display information of the target shelf is obtained, and the shelf display information is output, and specific execution operations may be detailed as described in the embodiment of fig. 2, and are not repeated herein.

For convenience of understanding, fig. 4a to 4d are schematic diagrams showing information processing procedures of the technical solution of the present application in a practical application.

In fig. 4a, the mobile robot 41 may perform mapping in a target location based on a drawing instruction to construct an electronic map, and send the electronic map to the server 42, the server 42 may display the electronic map for a user to view or send the electronic map to the first user 43, because the first user 43 displays the electronic map for the user to view, the user may select a polling area from the electronic map, the server 42 may send a polling instruction to the mobile robot 41 based on the polling area, the mobile robot 41 may move in the target location based on the polling instruction, perform picture collection at different collection points, and upload a collection result to the server 22.

In a practical application, the first information carrier and the second information carrier can be graphic codes, such as two-dimensional codes, bar codes or three-dimensional codes. The first information carrier may specifically be an item code carrying item information, the second information carrier may specifically be a shelf code carrying shelf information, etc. The deployed position of the shelf code may be the same on each shelf with the item code deployed at the display position of its corresponding item.

Fig. 4b shows a processing procedure of the server on the acquisition result, where the server may first identify and/or combine the acquisition coordinate by using a graphic code to filter out invalid pictures in the acquisition result, so as to obtain a shelf picture 401; and then, detecting and identifying the shelf picture, and based on shelf information carried by the shelf code obtained by identification, performing shelf segmentation to generate shelf distribution information 402, where the shelf distribution information may be a shelf distribution map, and the shelf distribution map may be specifically as shown in fig. 4 c. The shelf display pictures can be obtained by cutting or splicing the shelf pictures, and the shelf distribution information can be generated based on the shelf information and the shelf display pictures; afterwards, the service end can determine the article information by obtaining the article code based on the identification, and can also determine the article code position of the article code in the picture and perform article detection to obtain the article matting and the article matting position, based on the article code and the article matting position, the article matting and the corresponding article information can be bound, and the article display position is determined by combining the article matting position or the article code position, so that the shelf display information 403 can be generated based on the article display position, the article information, the article matting and the like, and the shelf display information can be a specific shelf display map, which can be specifically shown in fig. 4d, for example.

As shown in fig. 4a, after the server 42 obtains the shelf display information and the shelf distribution information, it can be provided to the first client 43 or the second client 44 for viewing by the corresponding personnel, etc.

Fig. 5 is a schematic structural diagram of an embodiment of an information processing apparatus according to an embodiment of the present application, where the apparatus may include:

the image acquisition module 501 is used for acquiring shelf images acquired by the mobile robot in a target place; at least one shelf is deployed at a target place, at least one shelf is respectively provided with at least one article, and a first information carrier is arranged at the display position of each article, and the first information carrier carries article information of the corresponding article;

the information identification module 502 is used for identifying a first information carrier in the shelf picture and article information carried by the first information carrier;

an information generating module 503 is configured to generate shelf display information based on the item information of at least one item belonging to the same shelf.

In some embodiments, the information identification module is further configured to identify a first carrier position in the shelf picture of a first information carrier in the shelf picture; determining a display position of its corresponding item in the shelf based on the first carrier position of the first information carrier;

the information generating module may be specifically configured to generate shelf display information based on the display position of at least one item belonging to the same shelf and the item information.

In some embodiments, the information identification module is further configured to identify an item in the shelf picture to obtain an item matte; establishing a binding relationship between the article matting and the article information;

the information generation module may be specifically configured to generate shelf display information based on item information of at least one item belonging to the same shelf and item matting to which the item information is bound.

In some embodiments, the information identification module establishing a binding relationship between the article matting and the article information may include: identifying a matting position of an article matte in a shelf picture and a first carrier position of a first information carrier in the shelf picture; and establishing a binding relation between the article cutout and the article information based on the cutout position of the article cutout and the first carrier position of the first information carrier.

In some embodiments, the information generation module may be specifically configured to determine a display location of a corresponding item in the shelf based on a matte location of the item matte or a first carrier location of a first information carrier; and generating shelf display information based on the display position, the article information and the article cutout which respectively correspond to at least one article belonging to the same shelf.

In some embodiments, a second information carrier carrying respective shelf information is provided in the at least one shelf, respectively;

the information identification module is also used for identifying a second information carrier in the shelf picture and shelf information carried by the second information carrier;

the information generation module is further configured to generate shelf distribution information based on respective shelf information of at least one shelf.

In some embodiments, the information generation module is further configured to determine a shelf position of at least one shelf in the target location based on the corresponding acquisition coordinates of the shelf picture in the target location;

the information generating module may generate the shelf distribution information based on the respective shelf information of the at least one shelf, and may include: shelf distribution information is generated based on the respective shelf location of the at least one shelf and the shelf information.

In some embodiments, the information identification module is further configured to identify a second carrier position in the shelf picture of a second information carrier; determining shelf display pictures respectively corresponding to different shelves in the shelf pictures based on the second carrier positions of different second information carriers;

the information generation module may generate shelf display information based on item information of at least one item belonging to the same shelf, including: shelf display information is generated on the basis of information on items carried by at least one first information carrier located in the same shelf display picture.

In some embodiments, the apparatus may further comprise:

the picture processing module is used for carrying out picture processing on the shelf pictures based on the positions of the second carriers of different second information carriers to obtain shelf display pictures corresponding to different shelves;

the information generating module may generate the shelf distribution information based on the respective shelf information of the at least one shelf, including: and generating shelf distribution information based on the shelf information of at least one shelf and the corresponding shelf display picture.

In some embodiments, the information generation module generates the shelf distribution information based on the respective shelf information of the at least one shelf comprises:

based on the respective shelf information of at least one shelf, carrying out shelf area segmentation in an electronic map of a target place to obtain a shelf distribution map;

the information generation module may generate shelf display information based on item information of at least one item belonging to the same shelf, including: generating a shelf display map based on item information of at least one item belonging to the same shelf;

in addition, the information generation module is also used for establishing the incidence relation between the shelf display map and the shelf distribution map and generating the article distribution map of the target place.

In some embodiments, the apparatus may further comprise:

the first processing module is used for outputting a goods shelf distribution map in the goods distribution map; receiving a search request for a target item; searching a target shelf where the target article is located;

in some embodiments, the apparatus may further comprise:

and the association module is used for establishing the association relationship between the shelf display information and the shelf distribution information to obtain the article distribution information.

In some embodiments, the apparatus may further comprise:

and the second processing module is used for providing the article distribution information to related personnel.

In some embodiments, the apparatus may further comprise:

the control module is used for controlling the mobile robot to carry out surveying and mapping in the target place and constructing an electronic map of the target place; determining a routing inspection area in the electronic map; and controlling the mobile robot to move in the target place based on the inspection area, and acquiring pictures at different acquisition point positions.

In some embodiments, the obtaining, by the information obtaining module, a shelf picture acquired by the mobile robot at the target location may include: acquiring a to-be-processed picture acquired and obtained by a mobile robot in a target place; and filtering the invalid picture based on the acquisition coordinate corresponding to the picture to be processed to obtain the shelf picture.

In some embodiments, the obtaining, by the information obtaining module, a shelf picture acquired by the mobile robot at the target location may include: acquiring a to-be-processed picture acquired and obtained by a mobile robot in a target place; identifying an information carrier of the picture to be processed; and filtering the invalid picture based on the identification result to obtain the shelf picture.

The information processing apparatus shown in fig. 5 can execute the information processing method shown in the embodiment shown in fig. 1, and the implementation principle and the technical effect are not described again. The specific manner in which each module and unit of the information processing apparatus in the above embodiments perform operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

In one possible design, the information processing apparatus of the embodiment shown in fig. 5 may be implemented as a computing device, which may include a storage component and a processing component, as shown in fig. 6;

the storage component 601 stores one or more computer instructions, wherein the one or more computer instructions are called and executed by the processing component 601 to implement the information processing method according to the embodiment shown in fig. 1.

Of course, a computing device may also necessarily include other components, such as input/output interfaces, communication components, and so forth. The input/output interface provides an interface between the processing components and peripheral interface modules, which may be output devices, input devices, etc. The communication component is configured to facilitate wired or wireless communication between the computing device and other devices, and the like.

The computing device may be a physical device or an elastic computing host provided by a cloud computing platform, and the computing device may be a cloud server, and the processing component, the storage component, and the like may be a basic server resource rented or purchased from the cloud computing platform.

The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a computer, the information processing method of the embodiment shown in fig. 1 can be implemented.

Fig. 7 is a schematic structural diagram of an embodiment of an information processing apparatus according to an embodiment of the present application, where the apparatus may include:

a first obtaining module 701, configured to obtain shelf distribution information based on a shelf distribution request for a target location;

a first output module 702 for outputting shelf distribution information;

a second obtaining module 703, configured to obtain shelf display information of a target shelf based on a shelf display request for the target shelf in the shelf distribution information;

a second output module 704 for outputting shelf display information; the shelf display information is generated by identifying a first information carrier in a shelf picture and article information carried by the first information carrier and based on article information corresponding to the same shelf; the shelf distribution information is generated by identifying the second information carrier in the shelf picture and shelf information carried by the second information carrier and based on the respective shelf information of at least one shelf.

In some embodiments, the shelf distribution information is a shelf distribution map generated based on the respective shelf information of the at least one shelf and the electronic map of the target location;

the first output module may specifically output a shelf distribution map, and display shelf information corresponding to at least one shelf in the shelf distribution map;

the second obtaining module may specifically detect a shelf display request triggered by a target shelf in the shelf distribution map, and obtain shelf display information of the target shelf.

The information processing apparatus shown in fig. 7 can execute the information processing method shown in the embodiment shown in fig. 2, and the implementation principle and the technical effect are not repeated. The specific manner in which each module and unit of the information processing apparatus in the above embodiments perform operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

In one possible design, the information processing apparatus of the embodiment shown in fig. 7 may be implemented as an electronic device, as shown in fig. 8, which may include a storage component 801, a display component 802, and a processing component 803;

the storage component 801 stores one or more computer instructions, which are called and executed by the processing component 803 to implement the information processing method of the embodiment shown in fig. 2.

Wherein the display component 802 is responsible for outputting shelf distribution information or shelf display information based on the triggering of the processing component 803.

Of course, the electronic device may of course also comprise other components, such as input/output interfaces, communication components, etc. The input/output interface provides an interface between the processing components and peripheral interface modules, which may be output devices, input devices, etc. The communication component is configured to facilitate wired or wireless communication between the computing device and other devices, and the like.

In practical applications, the electronic device may refer to a mobile terminal such as a personal computer, a tablet computer, or a mobile phone.

An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a computer, the information processing method according to the embodiment shown in fig. 2 may be implemented.

Fig. 9 is a schematic structural diagram of another embodiment of an information processing apparatus according to an embodiment of the present application, where the apparatus may include:

a map building module 901, configured to receive a drawing instruction; surveying and mapping in a target place, and constructing an electronic map of the target place;

the area determining module 902 is configured to receive a patrol instruction and determine a patrol area in the electronic map;

the picture acquisition module 903 is used for moving in a target place based on the inspection area and acquiring pictures at different acquisition points;

and the picture sending module 904 is configured to send the acquisition result to the server, so that the server obtains a shelf picture of the target place, identifies the first information carrier in the shelf picture and the article information carried by the first information carrier, and generates shelf display information based on the article information of at least one article belonging to the same shelf.

In some embodiments, the apparatus may further comprise:

the point location planning module is used for determining a collection step length based on the inspection instruction; and planning the acquisition point location based on the acquisition step length.

In some embodiments, the acquiring the pictures at different acquiring points by the picture acquiring module may include: acquiring pictures at different acquisition point positions and determining acquisition coordinates; and the acquisition coordinates are used for filtering invalid pictures in the acquisition result by the server side so as to obtain shelf pictures.

In one possible design, the information processing apparatus of the embodiment shown in fig. 9 may be configured in a mobile robot, as shown in fig. 10, which may include a storage component 1001, a collection component 1002, and a processing component 1003;

the storage component 1001 stores one or more computer instructions, wherein the one or more computer instructions are called and executed by the processing component 1003 to implement the information processing method according to the embodiment shown in fig. 3.

Wherein the capture component 1002 is responsible for capturing pictures based on the triggering of the processing component 1003.

Of course, the mobile robot may of course also comprise other components, such as input/output interfaces, communication components, etc. The input/output interface provides an interface between the processing components and peripheral interface modules, which may be output devices, input devices, etc. The communication component is configured to facilitate wired or wireless communication between the computing device and other devices, and the like.

Furthermore, it will be understood by those skilled in the art that the mobile robot may also include walking parts, a special-shaped housing, and other necessary components, and the present application is not limited thereto.

In addition, an embodiment of the present application further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a computer, the computer program can implement the information processing method according to the embodiment shown in fig. 3.

The processing components as referred to in some of the foregoing embodiments may comprise one or more processors executing computer instructions to perform all or part of the steps of the methods described above. Of course, the processing elements may also be implemented as one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components configured to perform the above-described methods.

The storage component may be configured to store various types of data to support operations in the device. The memory components may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The display element may be an Electroluminescent (EL) element, a liquid crystal display or a microdisplay having a similar structure, or a retina-directable display or similar laser scanning type display.

The acquisition component can be a camera and other sensors capable of realizing image acquisition.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. An information processing method characterized by comprising:

2. The method of claim 1, further comprising:

the generating shelf display information based on item information of at least one item belonging to the same shelf includes:

shelf display information is generated based on the display position of at least one item belonging to the same shelf and the item information.

3. The method of claim 1, further comprising:

identifying the articles in the shelf picture to obtain article mattes;

4. The method according to claim 3, wherein the establishing the binding relationship between the article matting and the article information comprises:

identifying a matte position of the item matte in the shelf picture and a first carrier position of the first information carrier in the shelf picture;

and establishing a binding relationship between the article cutout and the article information based on the cutout position of the article cutout and the first carrier position of the first information carrier.

5. The method of claim 4, further comprising:

the generating shelf display information based on item information of at least one item belonging to the same shelf and item matting bound to the item information comprises:

6. Method according to claim 1, characterized in that in each of said at least one shelf a second information carrier is provided carrying respective shelf information;

the method further comprises the following steps:

and generating shelf distribution information based on the shelf information of each shelf.

7. The method of claim 6, further comprising:

determining a shelf position of the at least one shelf in the target site based on corresponding acquisition coordinates of the shelf picture in the target site;

the generating shelf distribution information based on the respective shelf information of the at least one shelf comprises:

shelf distribution information is generated based on the respective shelf positions of the at least one shelf and the shelf information.

8. The method of claim 6, further comprising:

determining shelf display pictures respectively corresponding to different shelves in the shelf pictures based on second carrier positions of different second information carriers;

9. The method of claim 8, further comprising:

based on the second carrier positions of different second information carriers, carrying out picture processing on the shelf pictures to obtain shelf display pictures corresponding to different shelves;

10. The method of claim 6, wherein generating shelf distribution information based on the respective shelf information of the at least one shelf comprises:

based on the respective shelf information of the at least one shelf, carrying out shelf area segmentation in the electronic map of the target place to obtain a shelf distribution map;

the generating shelf display information based on item information of at least one item belonging to the same shelf comprises:

generating a shelf display map based on item information of at least one item belonging to the same shelf;

the method further comprises the following steps:

and establishing the incidence relation between the shelf display map and the shelf distribution map to generate an article distribution map of the target place.

11. The method of claim 10, further comprising:

outputting a shelf distribution map in the item distribution map;

receiving a search request for a target item;

searching a target shelf where the target article is located;

and outputting a shelf display map corresponding to the target shelf.

12. The method of claim 6, further comprising:

13. The method of claim 12, further comprising:

and providing the article distribution information to related personnel.

14. The method of claim 12, further comprising:

determining whether a display anomaly exists based on the item distribution information.

15. The method of claim 1, further comprising:

controlling the mobile robot to carry out mapping in the target place, and constructing an electronic map of the target place;

determining a routing inspection area in the electronic map;

16. The method of claim 1, wherein the obtaining the shelf picture acquired by the mobile robot at the target site comprises:

acquiring a to-be-processed picture acquired and obtained by the mobile robot in the target place;

17. The method of claim 1, wherein the obtaining the shelf picture acquired by the mobile robot at the target site comprises:

identifying an information carrier for the picture to be processed;

18. The method of claim 1, wherein the obtaining the shelf picture acquired by the mobile robot at the target site comprises:

acquiring a first picture acquired by a mobile robot in a target place;

acquiring second pictures acquired by the at least one shelf for the shelf;

and obtaining a shelf picture based on the first picture and the second picture.

19. The method of claim 1, wherein the obtaining the shelf picture acquired by the mobile robot at the target site comprises:

acquiring a first picture acquired by a mobile robot in a target place;

and obtaining a shelf picture based on the first picture and the third picture.

20. An information processing method characterized by comprising:

outputting the shelf distribution information;

21. The method of claim 20, wherein the shelf distribution information is a shelf distribution map generated based on the respective shelf information of the at least one shelf and an electronic map of the target location;

the outputting the shelf distribution information includes:

outputting the shelf distribution map, and displaying shelf information corresponding to the at least one shelf in the shelf distribution map;

the obtaining shelf display information of the target shelf based on the shelf display request for the target shelf in the shelf distribution information includes:

and detecting a shelf display request triggered by a target shelf in the shelf distribution map, and acquiring shelf display information of the target shelf.

22. An information processing method applied to a mobile robot, the method comprising:

receiving a drawing instruction;

23. The method of claim 22, further comprising:

determining a collection step length based on the inspection instruction;

24. The method of claim 22, wherein said taking pictures at different points of acquisition comprises:

acquiring pictures at different acquisition point positions and determining acquisition coordinates; and the acquisition coordinates are used for filtering invalid pictures in the acquisition result by the server so as to obtain shelf pictures.

25. The method of claim 21, further comprising:

26. An information processing apparatus characterized by comprising:

27. An information processing apparatus characterized by comprising:

28. An information processing apparatus characterized by comprising:

29. An information processing system is characterized by comprising a mobile robot and a server;

30. A computing device comprising a processing component and a storage component;

the storage component stores one or more computer instructions; the one or more computer instructions are used for being called and executed by the processing component to realize the information processing method according to any one of claims 1-19.

31. An electronic device comprising a processing component, a display component, and a storage component;

the storage component stores one or more computer instructions; the one or more computer instructions are used for being called and executed by the processing component to realize the information processing method according to any one of claims 20-21.

32. A mobile robot is characterized by comprising a processing component, a collecting component and a storage component;

the storage component stores one or more computer instructions; the one or more computer instructions are used for being called and executed by the processing component to realize the information processing method according to any one of claims 22-25.

33. A computer storage medium storing a computer program which, when executed by a computer, implements the information processing method according to any one of claims 1 to 19.

34. A computer storage medium storing a computer program which, when executed by a computer, implements the information processing method according to any one of claims 20 to 21.

35. A computer storage medium storing a computer program which, when executed by a computer, implements the information processing method according to any one of claims 22 to 25.