CN117593421A

CN117593421A - Electronic marking method and device for offline display object

Info

Publication number: CN117593421A
Application number: CN202311550609.1A
Authority: CN
Inventors: 郑卫东
Original assignee: Zhejiang Shenxiang Intelligent Technology Co ltd
Current assignee: Zhejiang Shenxiang Intelligent Technology Co ltd
Priority date: 2023-11-17
Filing date: 2023-11-17
Publication date: 2024-02-23

Abstract

The application discloses an electronic marking method and device for an offline display object, wherein the method comprises the following steps: according to the acquired offline display scene image, determining first marking data of a display object in an electronic map corresponding to the offline display scene; determining second marking data in the electronic map corresponding to the offline display scene of the display object according to the acquired moving object image in the offline display scene image; determining a marking area of the display object in the electronic map according to the first marking data and the second marking data, and marking an icon of the display object in the electronic map; therefore, the accuracy of marking the display object icons in the electronic map is effectively improved, and the icons in the electronic map are positioned more accurately.

Description

Electronic marking method and device for offline display object

Technical Field

The application relates to the field of computer image vision processing, in particular to an electronic marking method and device for an offline display object. The application also relates to an electronic marking method and device for the off-line display vehicle, a computer storage medium and an electronic device.

Background

The exhibition is a cultural communication and exhibition mode, and is also an important way for exhibiting products and technologies in various industries.

With the continuous development of computer technology and internet technology, large-screen data display has become a new data display form, which can help a demander to intuitively obtain relevant data conditions needing to be understood. Therefore, the large-scale exhibition hall data screen also becomes an important means for exhibition parties to display own products. Related information can be known through the exhibition hall data large screen, such as: heat of product, overall planning of product display. However, the large display screen for displaying data is mainly a digital display mode for data statistical analysis and prediction at present, and has a large distance from the user demand.

For example, in the thermodynamic diagram display of an exhibition hall, icons of displayed objects (such as automobiles) cannot be marked in proper positions on the thermodynamic diagram in the most proper positions and directions, so that viewers cannot intuitively know the placement space and placement position of the exhibited objects from the thermodynamic diagram, and thus it is difficult to obtain an intuitive understanding of the on-site display situation through the thermodynamic diagram.

Disclosure of Invention

The application provides an electronic marking method of an offline display object, which aims to solve the problem of how to realize electronic marking in the prior art under the condition of facing to the deployment of a large number of display objects.

The application provides an electronic marking method for an offline display object, which comprises the following steps:

according to the acquired offline display scene image, determining first marking data of a display object in an electronic map corresponding to the offline display scene;

determining second marking data in the electronic map corresponding to the offline display scene of the display object according to the acquired moving object image in the offline display scene image;

and determining a marking area of the display object in the electronic map according to the first marking data and the second marking data, and marking an icon of the display object in the electronic map.

In some embodiments, the determining, according to the acquired display object image in the offline display scene, first indication data of the display object in an electronic map corresponding to the offline display scene includes:

acquiring the offline display scene image;

acquiring image information and position information of a display object according to the display scene image;

acquiring the shape and the position of the display object in the electronic map according to the display object image information and the position information;

And determining the shape and the position as first marking data in an electronic map corresponding to the display scene of the display object under the line.

In some embodiments, the acquiring the shape and the position of the display object in the electronic map according to the display object image information and the position information, where the acquiring the position includes:

identifying a first location in the display object image in the offline display scene of the display object;

and mapping the first position to a corresponding second position in the electronic map according to the mapping relation between the offline display scene and the electronic map, so as to determine the position of the display object in the electronic map.

In some embodiments, the method for acquiring the shape and the position of the display object in the electronic map according to the display object image information and the position information, where the method for acquiring the shape includes:

identifying the outline of the display object according to the display object image information;

determining the bottom shape of the display object according to the outline;

mapping the bottom shape into the electronic map, and determining the shape of the display object in the electronic map;

Or alternatively;

identifying boundary points in the display object image information in a overlook angle;

mapping the boundary points into the electronic map;

and determining the area formed by connecting lines among the boundary points as the shape of the display object in the electronic map.

In some embodiments, the determining, according to the acquired image information of the moving object in the offline display scene, the second indication data of the display object in the electronic map corresponding to the offline display scene includes:

acquiring moving object image information in the offline display scene;

determining a thermodynamic area around the display object in the off-line display scene according to the image information of the mobile object;

according to the mapping relation between the thermal area and the relative position in the electronic map, determining an area outside the thermal area in the electronic map as an inter-cooling area of the display object in the electronic map;

and determining the cold area as second marking data of the display object.

In some embodiments, the determining the indication area of the display object in the electronic map according to the first indication data and the second indication data, and indicating the icon of the display object in the electronic map includes:

Determining a marking area of the display object in the electronic map according to the shape of the display object in the first marking data and the cold area in the second marking data;

determining the average value of the lengths of the marked areas of the display objects as the icon length of the icon of the display object;

determining the icon width of the icon in the electronic map according to the length-width ratio of the display object in the physical structure and the icon length;

determining the icon size of the display object in the electronic map according to the icon length and the icon width;

and marking the icon representing the display object in the marking area according to the icon size.

In some embodiments, the determining the indication area of the display object in the electronic map according to the shape of the display object in the first display data and the cold area in the second display data includes:

constructing an external rectangle of the shape and the cold area according to the superposition of the shape of the display object and the cold area;

and determining the circumscribed rectangle as a marking area of the display object in the electronic map.

In some embodiments, further comprising:

determining a center point of the display object according to the display object image;

determining the marking direction of the icon of the display object in the marking area according to the distances from the center point to the widths of the two sides of the marking area;

and marking the icon representing the display object in the marking area according to the marking direction.

In some embodiments, further comprising:

identifying attribute information of the display object according to the display object image;

and marking the attribute information on the periphery of the icon of the display object in the electronic map.

In some embodiments, further comprising:

acquiring the real-time moving object image around the display object;

determining thermodynamic data related to the display object according to the moving object image;

and displaying the thermal data in the electronic map in the form of thermal marks.

The application also provides an electronic marking device for an offline display object, comprising:

the first determining unit is used for determining first marking data of the display object in the electronic map corresponding to the offline display scene according to the acquired display object image in the offline display scene;

The second determining unit is used for determining second marking data in the electronic map corresponding to the offline display scene of the display object according to the acquired moving object image in the offline display scene;

and the third determining unit is used for determining a marking area of the display object in the electronic map according to the first marking data and the second marking data and marking an icon of the display object in the electronic map.

The application also provides an electronic marking method for the off-line display vehicle, which comprises the following steps:

according to the acquired off-line vehicle display scene image, determining first marking data of the display vehicle in an electronic map corresponding to the off-line vehicle display scene;

determining second marking data in the electronic map corresponding to the off-line vehicle display scene of the display vehicle according to the obtained visitor image in the off-line vehicle display scene image;

and determining a marking area of the vehicle object in the electronic map according to the first marking data and the second marking data, and marking the icon of the display vehicle in the electronic map.

The application also provides a computer storage medium for storing network platform generated data and a program for processing the network platform generated data;

The program, when read and executed by the processor, performs an electronic labeling method for an off-line display object as described above, or performs an electronic labeling method for an off-line display vehicle as described above.

The application also provides an electronic device comprising:

a processor;

and the memory is used for storing a program for processing the data generated by the network platform, and the program, when being read and executed by the processor, executes the electronic marking method of the off-line display object or executes the electronic marking method of the off-line display vehicle.

Compared with the prior art, the application has the following advantages:

according to the electronic marking method for the offline display object, first marking data of the display object in an electronic map corresponding to the offline display scene are determined according to the acquired offline display scene image; determining second marking data in the electronic map corresponding to the offline display scene of the display object according to the acquired moving object image in the offline display scene image; and determining a marking area of the display object in the electronic map according to the first marking data and the second marking data, and marking an icon of the display object in the electronic map. According to the static display characteristics of the display object and the dynamic movement characteristics of the moving object, the method combines the first marking data reflecting the static characteristics and the second marking data reflecting the dynamic characteristics in the electronic map, so that the accuracy degree of marking the icons of the display object in the electronic map is effectively improved, and the positioning of the icons in the electronic map is more accurate; in a further preferred embodiment, the placement direction of the display object can be accurately marked by using the icon; thus, the accuracy of the electronic map marking information is realized through off-line data. A user can intuitively know the display objects arranged at all positions in the offline display scene and the related information of the display objects through the electronic map.

Drawings

FIG. 1 is a flowchart of an embodiment of an electronic labeling method for an offline display object provided in the present application;

FIG. 2 is a schematic diagram of first marking data in an embodiment of an electronic marking method for an offline display object provided in the present application;

FIG. 3 is a schematic diagram of second marking data in an embodiment of an electronic marking method for an offline display object provided in the present application;

FIG. 4 is a schematic diagram of a labeled region in an embodiment of an electronic labeling method for an offline display object provided in the present application;

FIG. 5 is a schematic diagram of a labeling direction in an embodiment of an electronic labeling method for an offline display object provided in the present application;

FIG. 6 is a schematic diagram of a marking icon in an electronic map of an embodiment of an electronic marking method for an offline display object provided in the present application;

FIG. 7 is a schematic diagram of a non-labeled region labeled icon in an electronic map according to an embodiment of an electronic labeling method for offline display objects provided in the present application;

FIG. 8 is a schematic structural diagram of an exemplary embodiment of an electronic marking device for offline display of objects provided in the present application;

FIG. 9 is a flow chart of an embodiment of an electronic labeling method for an off-line display vehicle provided herein;

FIG. 10 is a schematic view of an exemplary embodiment of an electronic marking device for an off-line display vehicle provided herein;

fig. 11 is a schematic structural diagram of an embodiment of an electronic device provided in the present application.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is, however, susceptible of embodiment in many other ways than those herein described and similar generalizations can be made by those skilled in the art without departing from the spirit of the application and the application is therefore not limited to the specific embodiments disclosed below.

The terminology used in the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application. The manner of description used in this application and in the appended claims is for example: "a", "a" and "a" etc. are not limited in number or order, but are used to distinguish the same type of information from each other.

Based on the above background technology, the inventive concept of the present application is derived from the fact that when the display is electronically displayed, icons of the display objects are expressed in the map, and visual, image and accurate electronic marks cannot be provided for the user, for example: in the vehicle display of 4S shop, 4S shop can set up different show areas in order to make things convenient for the customer to observe and experience commodity generally, sets up each functional area according to purchasing the car flow simultaneously to provide good purchasing experience. The following is an example of a 4S store presentation:

Sample car show area: main in this regional show shop plays the exhibition car, and the master pin motorcycle type is placed in the obvious position at exhibition hall entrance, makes things convenient for the customer to get into the exhibition hall and sees the full view of car. The trolley type and the multifunctional vehicle are respectively concentrated in the left side area and the right side area, so that convenience is brought to customers for comparison.

Customer parking area: this area provides a comfortable environment for the customer where he can rest while watching his own cardiometer model.

Exhibition hall list: the area displays all the vehicle types in the exhibition hall, and each vehicle type is provided with a color board of the vehicle and an introduction manual of all products of the vehicle.

Main exhibition car show district of beating: this area shows the main display vehicles in the store, which are typically the most popular models.

Rest area: this area provides a comfortable environment for the customer where he can rest while watching his own cardiometer for the vehicle maintenance and repair process.

Product introduction area: the whole car exhibition hall is arranged in the area, so that a customer can sit in the negotiation room to lift the head to see the whole car.

Fine sales area: the area is provided with a fine product selling area, so that customers can conveniently purchase fine products during shopping.

In the process of digitally displaying the electronic map of the 4S store live-action, only one type of large-screen data is often provided in the prior art, wherein the large-screen data is obtained by analyzing and processing the acquired data, and is completely irrelevant to an actual scene, so that a user cannot obtain the field feeling of the actual scene through the large screen, and the data cannot be combined with the actual display place.

In the prior art, some technical schemes of combining data and an electronic map are adopted, but in the schemes provided by the prior art, the specific display position and display space of a display object in the electronic map cannot be visualized and marked according to the actual condition of the scene, so that a user cannot obtain visual impression of the actual condition of the scene display from the electronic map.

For example: when the thermodynamic diagram in the form of an electronic map is adopted, thermodynamic diagram users need to accurately know the arrangement space and arrangement modes of vehicles at different positions in a store or an exhibition hall and the attractive degree of each displayed vehicle to a client, and therefore the visualized icons are needed to be adopted to mark the vehicles or other exhibits in a 4s store or an exhibition hall in the electronic map; however, how to make the icons in the electronic map be marked in the electronic map in a manner consistent with the actual display objects is not a simple problem; if the manual operation is carried out according to the site display condition, the cost is high, the implementation efficiency is low, and the problems of incapability of updating in time according to the site condition and the like are caused. Accordingly, embodiments of the present application provide a method for implementing on-line electronic processing of graphic identifiers (i.e., icons) of presentation objects using on-site surveillance images.

Based on the above-mentioned problems in the prior art, the present application provides an electronic marking method for an offline display object, which is not limited to vehicle display in a 4s shop scene, such as: the work of art exhibition in the city exhibition room, the showpiece that carries out the show in the actual physical space all can be marked through the mode that this embodiment provided to the museum etc. realizes adopting the mode of electronization.

The embodiment of the application provides an electronic marking method for an offline display object, which can accurately and vividly map the online display condition of the display object to an electronic map corresponding to a display scene of the display object, so that a user can intuitively see related information of a display product in an exhibition hall or a store through the electronic map. The method for electronically marking the offline display object provided by the application is described in detail below. The embodiment of the application is described with a typical scene of a vehicle show or a vehicle show of a 4S shop showing hall, and a thermal electronic question chart is taken as a typical electronic map in the embodiment of the application. Obviously, the embodiments can also be applied to other display scenes such as museums and other forms of electronic maps.

As shown in fig. 1, fig. 1 is a flowchart of an embodiment of an electronic labeling method for an offline display object provided in the present application, where the embodiment may include:

step S101: according to the acquired offline display scene image, determining first marking data of a display object in an electronic map corresponding to the offline display scene;

step S102: determining second marking data in the electronic map corresponding to the offline display scene of the display object according to the acquired moving object image in the offline display scene image;

step S103: and determining a marking area of the display object in the electronic map according to the first marking data and the second marking data, and marking an icon of the display object in the electronic map.

The above steps S101 to S103 are described in detail in order.

Regarding step S101: and determining first marking data of the display object in the electronic map corresponding to the offline display scene according to the acquired offline display scene image.

The purpose of the step S101 is to determine, according to the acquired offline display scene image, first indication data of the display object in the electronic map corresponding to the offline display scene. The first marking data are obtained by mapping in the electronic map according to the actual image information in the scene image displayed by the display object on line.

In this embodiment, the display object may be an article displayed in a scene such as an exhibition hall or a store, for example: vehicles in 4S shops, artwork in exhibition halls, store planning in a certain area, etc. may of course be included.

In this embodiment, the off-line exhibition scene may be understood as an exhibition hall or a store with a physical space, such as: 4S shops, exhibitions, business areas, parking lots, etc.

In this embodiment, the electronic map is an electronic map having a correspondence with the offline display scene, and the actual situation of the offline display scene is expressed in an electronic form in a map display manner.

Fig. 2 is a schematic diagram of first marking data in an embodiment of an electronic marking method for an offline display object provided in the present application. In this embodiment, the display object is exemplified by a vehicle, but is not limited to a vehicle.

The specific implementation process of step S101 may include:

step S101-1: acquiring the offline display scene image; the method specifically can be that the image acquisition equipment arranged in the offline display scene can acquire images of the offline display scene from a plurality of directions or positions, wherein the images comprise images of the display objects and can reflect layout arrangement of the display objects in the real scene.

Step S101-2: acquiring image information and position information of a display object according to the display scene image; specifically, the display object image may be identified by a computer vision identification algorithm, for example: through Haar feature cascade algorithm, HOG feature+svm classifier algorithm, convolutional Neural Network (CNN) algorithm, target detection algorithm (YOLO, fast R-CNN), etc., namely: by acquiring an offline display scene image, the display object in the offline display scene image is identified by using the algorithm, so that the image information and the position information of the display object in the offline display scene are acquired.

Step S101-3: and acquiring the shape and the position of the display object in the electronic map according to the display object image information and the position information.

In this embodiment, a corresponding electronic map is established according to the topography of the offline display scene, and the electronic map is an electronic representation form of the topography of the offline display scene, and the electronic map can be mapped to the electronic map according to the display object image information and the position information, so as to obtain the shape and the position of the display object on the electronic map. In this embodiment, if the display object is a vehicle, the shape may be a chassis contour shape of the vehicle obtained from the display scene image recognition, and if it is a building or a building model, it may be a contour shape of the building or the building model. The shape and position of the display object in the electronic map may be an identification frame reflecting the position and outline shape of the display object in the electronic map.

The obtaining manner of the position may include:

step S101-31: a first location in the display object image in the offline display scene of the display object is identified.

According to the display object identified in the display scene image, the display object image comprises the position of the display object in the display scene image, and the position of the display object in the display scene, namely the first position, is also obtained when the display object is obtained through image identification.

Step S101-32: and mapping the first position to a corresponding second position in the electronic map according to the mapping relation between the offline display scene and the electronic map so as to determine the position of the display object in the electronic map.

The step is to obtain the position, namely the first position, of the display object in the scene image according to the position, namely the second position, of the display object in the electronic map according to the mapping relation between the image and the electronic map; mapping from the first location to the second location in an image is a typical technical task of a computer vision and Geographic Information System (GIS), and many solutions are known in the art. Such as object calibration and three-dimensional reconstruction: by means of object calibration and three-dimensional reconstruction, objects in the monitoring image can be mapped to corresponding positions on the electronic map; the object calibration means that the size of an object is measured in a monitoring image by using a known size or a specific calibration object, so that the actual size of the object is determined; then, the position of the object in the three-dimensional space is matched and mapped with the corresponding position on the electronic map by using the pose of the camera and the three-dimensional reconstruction technology. For another example, a matching method based on image features is implemented by extracting feature descriptors of objects in a monitored image, such as SIFT, SURF or ORB, and feature descriptors of corresponding areas on an electronic map, and then using a feature matching algorithm to find a corresponding relationship between the feature descriptors; the method can find the position of the object on the map by comparing the distance or similarity between the feature points in the image and the feature points on the map. These methods may be used alone or in combination, depending on the requirements of the scene and the available data. By mapping the object in the monitoring image to the corresponding position on the electronic map, more comprehensive geographic information analysis and decision support can be realized; for the purposes of this application, it is the user that is given an intuitive and accurate perception of location.

The obtaining mode of the shape may include:

step S101-33: identifying the outline of the display object according to the display object image information;

step S101-34: determining the bottom shape of the display object according to the outline; of course, the bottom shape of the display object can be identified directly according to the image information of the display object;

step S101-35: mapping the bottom shape into the electronic map, and determining the shape of the display object in the electronic map.

Or alternatively;

step S101-36: identifying boundary points in the display object image information in a overlook angle;

step S101-37: mapping the boundary points into the electronic map;

step S101-38: and determining the area formed by connecting lines among the boundary points as the shape of the display object in the electronic map.

The two ways provided above for mapping the shape of the display object in the on-site monitoring image to the electronic map are two different ways in the specific way of obtaining the marked object in the electronic map in the prior art, the shape of the object is mapped to the electronic map, and the conforming shape is obtained in the electronic map, which can be generally realized by the following steps: and (3) data acquisition: the use of a monitoring camera captures live monitoring images and ensures that the image quality and resolution are high enough to extract shape information of the object. It is also necessary to acquire shape information of objects in a real scene corresponding to the electronic map, and a laser scanner or other three-dimensional scanning method may be used to acquire shape data of the real objects as a reference.

Object detection and segmentation: object detection and segmentation is performed in the field monitoring image using computer vision algorithms. These algorithms may be deep learning based target detection algorithms, such as Convolutional Neural Network (CNN) based detection models, or conventional image processing and feature extraction based methods. The goal of this step is to accurately locate and segment the object to be mapped in the image.

Feature extraction and description: for each detected object, features of its shape are extracted using image processing techniques or computer vision algorithms. These features may be contour information, edge features, corner points, etc. These features will be used to match the features of the corresponding area on the map.

Feature matching and positioning: and matching the characteristics of the detected object with the characteristics of the corresponding area on the electronic map. This may be achieved by comparison of feature descriptors and similarity measures, for example using feature matching algorithms such as SIFT, SURF or ORB, etc. The purpose of the matching is to find the position and pose of the shape conforming to the object in the electronic map.

Shape mapping and display: and obtaining the position information of the object in the electronic map according to the matching result, and displaying the shape of the object on the electronic map. Projection and display of object shapes may be accomplished using Geographic Information System (GIS) tools or custom mapping algorithms.

The two ways of relying on contour recognition and boundary point recognition techniques described above have several implementations available in the prior art, nor do they exclude the use of new solutions that may occur in the future.

Step S101-4: and determining the shape and the position as first marking data in an electronic map corresponding to the display scene of the display object under the line.

Step S101-1 to step S101-3 are described above, and after the shape and the position of the display object in the electronic map are obtained, these data may be combined to form the first indication data in the electronic map corresponding to the display scene of the display object under the line. The system comprises a vehicle 1 chassis, a vehicle 2 chassis, a vehicle 3 chassis and a vehicle 4 chassis as shown in fig. 2, namely, the system is characterized in that first marking data of each vehicle on an electronic map are obtained; these data each include the shape and location of the individual presentation object.

Regarding step S102: and determining second marking data of the display object in the electronic map corresponding to the offline display scene according to the acquired moving object image in the offline display scene.

The purpose of step S102 is to determine the second label data according to the moving object image. The second marking data is obtained in a completely different manner from the first marking data according to the characteristics of the display scene. Specifically, since the moving tracks of the visitors are not overlapped with the display object in the display scene, the tracks of the visitors can be used as another information channel for obtaining the indication information of the display object.

Fig. 3 is a schematic diagram of second marking data in an embodiment of an electronic marking method for an offline display object provided in the present application. In this embodiment, the moving object image may be a visitor image or a user image, that is: images of the visitor (or also referred to as user) acquired in the scene are presented offline. The specific implementation process can comprise the following steps:

step S102-1: acquiring moving object image information in the offline display scene; the method specifically can be that images of moving objects in the offline display scene can be acquired from multiple directions or positions through acquisition equipment arranged in the offline display scene.

The moving object image information at this step does not need to re-identify the moving object, but is based on a series of video frames or a moving trajectory of the moving object in a prescribed period of time, and thus, unlike the above S101, the moving object image information obtained at this step should be understood as a superposition of a large amount of image information obtained by a plurality of video frame images.

Step S102-2: determining a thermodynamic area around the display object in the off-line display scene according to the image information of the mobile object; in this embodiment, whether the image includes the moving object may be identified by a computer vision identification algorithm, and specifically, a thermal condition around the display object may be determined according to whether the moving object exists around the display object. In this step, the moving object is taken as the object to be marked, and the statistical rule of the action track of the moving object (such as the exhibition visitor) is obtained through marking the moving track of the moving object. Specifically, a thermodynamic diagram of the moving object may be generated by collecting position data of the moving object and applying some algorithm (e.g., kernel density estimation, etc.) to calculate the density of the position points. The thermodynamic diagram in this embodiment does not relate to a specific moving object, but is a statistical rule of the moving trajectories of all moving objects. In particular, the trajectory information of the moving object may be discretized into a series of location points, and then the density of the data distribution is calculated at these location points. The higher density areas will be displayed in a thermodynamic diagram as brighter or hotter colors, while the lower density areas will be displayed in darker or colder colors. In this way, the thermodynamic diagram may provide visual feedback regarding the spatial distribution density of the moving object. It should be noted in particular that thermodynamic diagrams do not directly reflect the speed, direction or other motion characteristics of a moving object, but are merely a statistical representation of the data distribution. To obtain more information about the moving object on the thermodynamic diagram, it may be necessary to combine other data, such as time stamps or motion trajectories, while performing the analysis. In this embodiment, since the space occupied by the display object in the display scene does not overlap with the movement track of the moving object, the shape of the thermal area (i.e., the area where the movement object track appears) can be utilized, and the reverse method is adopted to obtain the relevant information of the position and shape occupied by the display object.

Step S102-3: according to the mapping relation between the thermal area and the relative position in the electronic map, determining an area outside the thermal area in the electronic map as an inter-cooling area of the display object in the electronic map; in this embodiment, when there is a moving object around the display object, it is indicated that there is a thermal area around the display object, and the location of the display object does not have a moving object, so the location of the display object is a non-thermal area, i.e. a cold area. The step S102-3 may be to determine an area outside the thermal area as a cold area or a non-thermal area of the display object in the electronic map.

Step S102-4: and determining the cold area as second marking data of the display object. As shown in fig. 3, the system comprises a vehicle-mounted non-thermal area 1, a vehicle-mounted non-thermal area 2, a vehicle-mounted non-thermal area 3 and a vehicle-mounted non-thermal area 4, namely a second marking area of each vehicle on the electronic map; therefore, the position of the display object in the offline display scene can be more accurately determined and mapped to the electronic map, and the accuracy of positioning and expressing the display object in the electronic map is ensured.

Regarding step S103: and determining a marking area of the display object in the electronic map according to the first marking data and the second marking data, and marking an icon of the display object in the electronic map.

The purpose of the step S103 is to combine the first marking data and the second marking data obtained in the previous two steps, and finally accurately determine the marking area of the display object in the electronic map and mark the icon.

In order to better map the display objects in the offline display scene onto the electronic map and mark the display objects, the icons can reach the unified standard when the offline display objects are marked on the electronic map. As shown in fig. 4, fig. 4 is a schematic diagram of a labeled region in an embodiment of an electronic labeling method for an offline display object provided in the present application, and the specific implementation process of step S103 may include:

step S103-1: determining a marking area of the display object in the electronic map according to the shape of the display object in the first marking data and the cold area in the second marking data; specifically, the shape of the display object and the cold area can be overlapped, and an external rectangle of the shape and the cold area is constructed after the overlapping, wherein the external rectangle encloses the boundary of the display object, and the position of the external rectangle determines the marking position of the display object in the electronic map.

As shown in fig. 4, there is a vehicle-to-no-heat-force-area circumscribed rectangle R1, a vehicle-to-no-heat-force-area circumscribed rectangle R2, a vehicle-to-no-heat-force-area circumscribed rectangle R3, and a vehicle-to-no-heat-force-area circumscribed rectangle R4.

Step S103-2: determining the average value of the lengths of the marked areas of the display objects as the icon length of the icon of the display object; for example: length of the vehicle icon= (r1_l+r2_l+r3_l+r4_l)/4, wherein r1_l is the length of the region circumscribed by the vehicle-no-heat region rectangle R1 in fig. 4, wherein r2_l is the length of the region circumscribed by the vehicle-no-heat region rectangle R2 in fig. 4, wherein r3_l is the length of the region circumscribed by the vehicle-no-heat region rectangle R3 in fig. 4, wherein r4_l is the length of the region circumscribed by the vehicle-no-heat region rectangle R4 in fig. 4, and the average of 4 is taken as the length of the vehicle icon displayed on the electronic map.

In the step, in a 4S shop scene, the positions occupied by the vehicles or exhibition areas with the same model of each exhibition object are assumed to be identical, and the average value of each exhibition object is adopted so as to overcome the observation errors of the exhibition objects at different positions; if in actual situations, each display object or exhibition area does not have the characteristics of the same size, the adjustment can be performed without using this step, and the rectangle obtained by directly overlapping the shape of the display object in the first marking data and the cold area in the second marking data can be obtained.

Step S103-3: determining the icon width of the icon in the electronic map according to the length-width ratio of the display object in the physical structure and the icon length; when the display object is a vehicle, the width of the icon can be determined according to the length-width ratio in the physical structure of the vehicle, namely the actual length-width ratio. Of course, the method is applicable when the display objects are the same type of product, and of course, the method can also be determined according to the preset width of the display objects, such as the width of the display stand and the average width of the display objects. That is, the icon length may be determined in conjunction with the display object's own size attribute, and such data may be obtained as pre-stored parameters in a relational database.

Step S103-4: determining the icon size of the display object in the electronic map according to the icon length and the icon width;

step S103-5: and marking the icon representing the display object in the marking area according to the icon size.

Since the marking positions and marking sizes of the icons of the display objects are ensured to be consistent with the actual conditions in the above steps in a plurality of ways, after the icons of the display objects are marked in the marking areas, a user of the electronic map can intuitively obtain the positions of the display objects (determined by the marking areas) and accurately understand the sizes of the display objects (displayed in the icon sizes) from the electronic map.

In order to further improve the actual display of the display object under the more attached line marked in the electronic map, as shown in fig. 5, fig. 5 is a schematic diagram of a marking direction in an embodiment of an electronic marking method for an offline display object provided in the present application, and may further include:

step S501: determining a center point of the display object according to the display object image; specifically, the center point may be determined by identifying the center point position of the display object according to the display image, or may be determined by determining the center point from the top view angle of the display image.

Step S502: determining the marking direction of the icon of the display object in the marking area according to the distances from the center point to the widths of the two sides of the marking area; for example: and comparing the distances L1 and L2 from the center point A to the widths of the two sides, wherein L1 is larger than L2, the intersection point of L1 and the width of one side is the vehicle head position, and the intersection point of L2 and the width of the other side is the vehicle tail position. For a display object to be a vehicle, the distance from the center position of the vehicle to the head is generally greater than the distance from the tail to the center position. If the display object is a mechanical device or an electronic device, the display object can be determined according to the structural characteristics of the device.

Step S503: and marking the icon representing the display object in the marking area according to the marking direction.

The method comprises the steps that the icons of the display objects can be marked on the electronic map intuitively, specifically and accurately in a mode corresponding to the real placement mode of the display objects, so that an electronic map user can acquire very intuitive and accurate knowledge of the display objects; when these icons are combined with the thermodynamic diagrams of moving objects, an intuitive understanding of which display objects are more popular can also be obtained, facilitating improved display modes or display lines.

Further, in order to achieve consistency between the offline display and the icon display information in the electronic map, or in other words, to facilitate understanding of specific information of the offline display object through the display object icon displayed in the electronic map, as shown in fig. 6 and fig. 7, fig. 6 is a schematic diagram of a labeled icon in the electronic map in an embodiment of an electronic labeling method for the offline display object provided in the present application, and fig. 7 is a schematic diagram of a labeled icon in a non-labeled area in the electronic map in an embodiment of an electronic labeling method for the offline display object provided in the present application; may further include: identifying attribute information of the display object according to the display object image; and marking the attribute information on the periphery of the icon of the display object in the electronic map. For example: and identifying the relevant attribute information such as the model of the vehicle according to the display object image.

In order to be able to know the attraction degree of the offline display object to the display object visitor through the electronic map, the thermal condition related to the display object (i.e. the statistical condition of the occurrence frequency of the movement track of the visitor for a certain display object) may be identified on the electronic map, so as to obtain the electronic map combined with the thermodynamic diagram, and specific modes include:

acquiring the real-time moving object image around the display object;

determining thermal data related to the display object according to the moving object image;

The thermal signature may be a thermodynamic diagram, a visualization technique, represented by rectangles, squares or dots of different colors, representing the intensity or intensity of the data. In thermodynamic diagrams, higher densities or intensities are typically represented by darker or more vivid colors, while lower densities or intensities are represented by lighter or darker colors. Thermodynamic diagrams are commonly applied to data analysis and information presentation to help users intuitively understand and analyze patterns, trends, and associations of data. They can quickly capture critical information in large amounts of data and highlight high points or concentrated areas of data.

In this embodiment, the thermodynamic diagram may represent the popularity or browsing degree of the display object, and may be calculated by a thermodynamic value, for example: the method is characterized in that the method comprises the steps of determining the number of moving objects around the display object and a set thermal threshold value, wherein the thermal threshold value can be set according to the display object attribute, the display time, the off-line display address, the display weather and the like. The thermal threshold may be set to different levels, corresponding to different thermal values, so as to mark different thermodynamic diagrams in the electronic map according to the different thermal values, for example: the thermodynamic situation is represented by different colors. Therefore, the popularity or the visit degree of different display objects can be obtained through the electronic map.

The above is a description of an embodiment of an electronic marking method for an offline display object, which is provided by the application, and the embodiment of the method can improve the standard of displaying object icons in an electronic map by combining first marking data and second marking data in the electronic map, and locate the display object in the electronic map more accurately, so as to realize standardization and synchronization of offline and online display information. A user can intuitively know the display objects arranged at all positions in the offline display scene and the related information of the display objects through the electronic map.

The foregoing is a specific description of an embodiment of an electronic marking device for an offline display object provided in the present application, corresponding to the foregoing embodiment of an electronic marking device for an offline display object provided in the present application, and further discloses an embodiment of an electronic marking device for an offline display object, please refer to fig. 7, and since the device embodiment is substantially similar to the method embodiment, the description is relatively simple, and the relevant points refer to a part of the description of the method embodiment. The device embodiments described below are merely illustrative.

As shown in fig. 8, fig. 8 is a schematic structural diagram of an embodiment of an electronic marking device for displaying objects offline, where the embodiment of the device includes: a first determination unit 801, a second determination unit 802, and a third determination unit 803;

the first determining unit 801 is configured to determine, according to the acquired display object image in the offline display scene, first indication data of the display object in an electronic map corresponding to the offline display scene;

the second determining unit 802 is configured to determine, according to the acquired moving object image in the offline display scene, second indication data in the electronic map corresponding to the offline display scene of the display object;

The third determining unit 803 is configured to determine a labeling area of the display object in the electronic map according to the first labeling data and the second labeling data, and label an icon of the display object in the electronic map.

The first determining unit 801 may include: the device comprises a first acquisition subunit, a second acquisition subunit, a third acquisition subunit and a determination subunit;

the first acquisition subunit is used for acquiring the display object image in the offline display scene;

the second acquisition subunit is used for acquiring display object image information and position information according to the display object image;

the third obtaining subunit is configured to obtain, according to the display object image information and the position information, a shape and a position of the display object in the electronic map;

the determining subunit is configured to determine the shape and the position as first indication data in an electronic map corresponding to the offline display scene of the display object.

In this embodiment, the third obtaining subunit includes: the first recognition subunit and the mapping subunit.

The identification subunit is used for identifying a first position of the display object in the offline display scene in the display object image;

The mapping subunit is configured to map the first position to a corresponding second position in the electronic map according to the mapping relationship between the offline display scene and the electronic map, so as to determine the position of the display object in the electronic map.

In this embodiment, the third obtaining subunit includes: a second recognition subunit, a first determination subunit, and a second determination subunit; the second recognition subunit is used for recognizing the outline of the display object according to the image information of the display object; the first determining subunit is configured to determine, according to the outline, a bottom shape of the display object; the second determining subunit is configured to map the bottom shape into the electronic map, and determine a shape of the display object in the electronic map. Or the second identifying subunit is configured to identify a boundary point in the image information of the display object in a top view; the first determining subunit is configured to map the boundary point into the electronic map; and the second determination subunit is used for determining the area formed by the connecting lines among the boundary points as the shape of the display object in the electronic map.

The second determining unit 802 may include: the first acquisition subunit is used for acquiring the image information of the moving object in the offline display scene; the first determining subunit is used for determining a thermodynamic area around the display object in the offline display scene according to the image information of the mobile object; the mapping subunit is used for determining the area outside the range of the thermal area in the electronic map as a cold area of the display object in the electronic map according to the mapping relation between the thermal area and the relative position in the electronic map; and the second determining subunit is used for determining the cold area as second marking data of the display object.

The third determining unit 803 may include: a first determination subunit, a second determination subunit, a third determination subunit, a fourth determination subunit, and a fifth determination subunit;

the first determining subunit is configured to determine a labeling area of the display object in the electronic map according to the shape of the display object in the first labeling data and the cold area in the second labeling data;

the second determining subunit is configured to determine, as an icon length of the display object icon, a mean value of the lengths of the indication areas of the plurality of display objects;

The third determining subunit is configured to determine, according to the aspect ratio in the physical structure of the display object and the icon length, an icon width of the icon in the electronic map;

the fourth determining subunit is configured to determine, according to the icon length and the icon width, an icon size of the display object in the electronic map;

and the fifth determining subunit is configured to mark an icon that represents the display object in the marking area according to the icon size.

The first determination subunit includes: a construction subunit, configured to construct an circumscribed rectangle of the shape and the cold area according to the superposition of the shape of the display object and the cold area; the first determining subunit is specifically configured to determine the circumscribed rectangle as a marking area of the display object in the electronic map.

Further, the method can also comprise the following steps: a center determination subunit, a direction determination subunit, and a sign subunit;

the center determining subunit is used for determining a center point of the display object according to the display object image;

the direction determining subunit is used for determining the marking direction of the icon of the display object in the marking area according to the distances from the central point to the widths of the two sides of the marking area respectively;

The marking subunit is configured to mark the icon representing the display object in the marking area according to the marking direction.

Further, the method can also comprise the following steps: and the attribute identification subunit is used for identifying the attribute information of the display object according to the display object image. The marking subunit is used for marking the attribute information on the periphery of the icon of the display object in the electronic map.

The present embodiment may further include: the device comprises an acquisition unit, a thermal determination unit and a display unit;

the acquisition unit is used for acquiring the moving object image around the display object in real time;

the thermodynamic determination unit is used for determining thermodynamic data according to the moving object image;

and the display unit is used for displaying the thermal data in the electronic map in the form of a thermal mark.

The above is a description of an embodiment of an electronic marking device for an offline display object provided in the present application, and specific content of the embodiment of the device may refer to the content of steps S101 to S103.

Based on the foregoing, the present application further provides an electronic marking method for an offline display vehicle, as shown in fig. 9, and fig. 9 is a flowchart of an embodiment of an electronic marking method for an offline display vehicle, where the method includes:

Step S901: according to the acquired off-line vehicle display scene image, determining first marking data of the display vehicle in an electronic map corresponding to the off-line vehicle display scene;

step S902: determining second marking data in the electronic map corresponding to the off-line vehicle display scene of the display vehicle according to the obtained visitor image in the off-line vehicle display scene image;

step S903: and determining a marking area of the vehicle object in the electronic map according to the first marking data and the second marking data, and marking the icon of the display vehicle in the electronic map.

For the specific content of this embodiment, reference is made to the content of the above-described steps S101 to S103, and details thereof will not be described here.

Correspondingly, the application further provides an electronic marking device for an offline display vehicle, as shown in fig. 10, fig. 10 is a schematic structural diagram of an embodiment of the electronic marking device for an offline display vehicle, which may include:

a first determining unit 1001, configured to determine, according to an acquired display vehicle image in an offline vehicle display scene, first indication data in an electronic map corresponding to the offline vehicle display scene of the display vehicle;

A second determining unit 1002, configured to determine, according to the acquired image of the visitor in the offline vehicle display scene, second indicating data in the electronic map corresponding to the offline vehicle display scene, where the display vehicle is displayed;

a third determining unit 1003, configured to determine a labeling area of the vehicle object in the electronic map according to the first labeling data and the second labeling data, and label the icon showing the vehicle in the electronic map.

For the specific content of this embodiment, reference is also made to the content of the above-mentioned step S101 to step S103, and details thereof will not be described here.

Based on the foregoing, it will be appreciated that the display object in the online under-display scenario is not limited to vehicles, but may include other exhibits, such as: household exhibits, art exhibits, etc.

Based on the foregoing, the present application further provides a computer storage medium for storing network platform generated data and a program for processing the network platform generated data;

the program, when read by a processor, performs steps in an embodiment of an electronic labeling method for an off-line display object as described above, or performs steps in an embodiment of an electronic labeling method for an off-line display vehicle as described above.

Based on the foregoing, the present application further provides an electronic device, as shown in fig. 11, and fig. 11 is a schematic structural diagram of an embodiment of an electronic device provided in the present application, where the embodiment of the electronic device may include:

a processor 1101;

the memory 1102 is configured to store a program for processing data generated by the network platform, where the program, when read and executed by the processor, performs steps in an embodiment of an electronic labeling method for an off-line display object as described above, or performs steps in an embodiment of an electronic labeling method for an off-line display vehicle as described above.

It should be noted that, the user information (including but not limited to user equipment information, user personal information, etc.) and the data (including but not limited to data for analysis, stored data, presented data, etc.) related to the present application are information and data authorized by the user or fully authorized by each party, and the collection, use and processing of the related data need to comply with the related laws and regulations and standards of the related country and region, and provide corresponding operation entries for the user to select authorization or rejection.

In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.

1. Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer readable media, as defined herein, does not include non-transitory computer readable media (transmission media), such as modulated data signals and carrier waves.

2. It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

While the preferred embodiment has been described, it is not intended to limit the invention thereto, and any person skilled in the art may make variations and modifications without departing from the spirit and scope of the present invention, so that the scope of the present invention shall be defined by the claims of the present application.

Claims

1. An electronic marking method for an offline display object is characterized by comprising the following steps:

2. The method for electronically marking an offline display object according to claim 1, wherein the determining, according to the acquired display object image in the offline display scene, first marking data of the display object in an electronic map corresponding to the offline display scene includes:

acquiring the offline display scene image;

3. The method for electronically marking an offline display object according to claim 2, wherein the acquiring the shape and the position of the display object in the electronic map according to the display object image information and the position information, wherein the acquiring the position includes:

4. The method for electronically marking an offline display object according to claim 2, wherein the acquiring the shape and the position of the display object in the electronic map according to the display object image information and the position information, wherein the acquiring the shape includes:

determining the bottom shape of the display object according to the outline;

or alternatively;

mapping the boundary points into the electronic map;

5. The method for electronically marking an offline display object according to claim 1, wherein determining second marking data in the electronic map corresponding to the offline display scene by the display object according to the acquired image information of the mobile object in the offline display scene includes:

acquiring moving object image information in the offline display scene;

and determining the cold area as second marking data of the display object.

6. The method for electronically marking an offline display object according to claim 5, wherein the determining a marked area of the display object in the electronic map according to the first marking data and the second marking data, and marking an icon of the display object in the electronic map, comprises:

7. The method for electronically marking an off-line display object according to claim 6, wherein the determining a marking area of the display object in the electronic map according to the shape of the display object in the first display data and the cold area in the second display data comprises:

8. The method for electronically labeling an off-line display object of claim 6, further comprising:

9. The method for electronically labeling an off-line display object of claim 8, further comprising:

10. The method for electronically labeling an off-line display object of claim 1, further comprising:

acquiring the real-time moving object image around the display object;

11. An electronic marking device for an offline display object, comprising:

12. An electronic marking method for an off-line display vehicle, comprising:

13. A computer storage medium for storing network platform generated data and a program for processing the network platform generated data;

the program, when read and executed by a processor, performs the method of electronically marking an off-line display object as claimed in any one of the preceding claims 1 to 10, or performs the method of electronically marking an off-line display vehicle as claimed in claim 12.

14. An electronic device, comprising:

a processor;

a memory for storing a program for processing network platform generated data, which when read and executed by the processor, performs the method of electronically marking an off-line display object as claimed in any one of the preceding claims 1-10, or performs the method of electronically marking an off-line display vehicle as claimed in claim 12.