CN113468250A

CN113468250A - Thermodynamic diagram generation method, thermodynamic diagram generation device, thermodynamic diagram generation equipment and storage medium

Info

Publication number: CN113468250A
Application number: CN202110729689.1A
Authority: CN
Inventors: 孙贺然; 王磊; 李佳宁
Original assignee: Beijing Sensetime Technology Development Co Ltd
Current assignee: Beijing Sensetime Technology Development Co Ltd
Priority date: 2021-06-29
Filing date: 2021-06-29
Publication date: 2021-10-01

Abstract

The embodiment of the disclosure discloses a thermodynamic diagram generation method, a thermodynamic diagram generation device, thermodynamic diagram generation equipment and a storage medium, wherein the thermodynamic diagram generation method comprises the following steps: acquiring human body information of each human body in the image; acquiring a plurality of grids obtained by dividing an electronic map corresponding to the image; obtaining the number of human body relevant points matched with each grid in the multiple grids based on the human body information; and generating a thermodynamic diagram based on the number of the human body related points matched by each grid.

Description

Thermodynamic diagram generation method, thermodynamic diagram generation device, thermodynamic diagram generation equipment and storage medium

Technical Field

The embodiments of the present disclosure relate to, but not limited to, electronic technologies, and in particular, to a thermodynamic diagram generation method, apparatus, terminal device, and computer storage medium.

Background

The thermodynamic diagram is a way that a plurality of statistical index data can be obtained according to a certain statistical standard, and the size of the statistical index data of each region in an image is represented in a special highlight form, so that the global features of the region can be visually displayed in front of people.

Thermodynamic diagrams can be applied in various aspects, for example, to analyze population density distribution in certain areas. However, the current thermodynamic diagrams cannot accurately show the distribution of population density in a certain space.

Disclosure of Invention

The embodiment of the disclosure provides a thermodynamic diagram generation method, a thermodynamic diagram generation device, terminal equipment and a computer storage medium.

In a first aspect, a thermodynamic diagram generation method is provided, including: acquiring human body information of each human body in the image; acquiring a plurality of grids obtained by dividing an electronic map corresponding to the image; obtaining the number of human body relevant points matched with each grid in the multiple grids based on the human body information; and generating a thermodynamic diagram based on the number of the human body related points matched by each grid.

In some embodiments, the obtaining, based on the human body information, the number of human body relevant points matched by each grid in the multiple grids includes: acquiring target attribute information aiming at least one of a human face and a human body; determining a person having the target attribute information from the human body information to obtain a target crowd including the person having the target attribute information; determining a first number of human body relevant points respectively matched with each grid based on the human body information of the target crowd; generating a thermodynamic diagram based on the number of the human body relevant points matched by each grid, wherein the generating comprises the following steps: generating the thermodynamic diagram based on the first quantity.

In this way, the target crowd with the target attribute information is determined, so that the thermodynamic diagram generated based on the human body information in the target crowd can represent the target crowd density in the space region corresponding to the electronic map in the target time period, and the distribution situation of the target crowd density in the scene can be accurately determined through the thermodynamic diagram.

In some embodiments, the obtaining target attribute information for at least one of a human face and a human body includes: acquiring at least one of attribute information of each human body and attribute information of each human face in the image; determining a plurality of attribute information for obtaining the target population based on the acquired attribute information; in response to a trigger operation on at least one of the plurality of displayed attribute information, determining attribute information matching the trigger operation as the target attribute information.

In this way, a manner of determining the target attribute information of at least one of the human body and the human face is provided, that is, the target attribute information of at least one of the human body and the human face is obtained according to the triggering operation of the user on at least one of the plurality of attribute information displayed, so that the obtained target attribute information of at least one of the human body and the human face meets the requirement of the user, and the generated thermodynamic diagram is displayed according to the target population distribution condition with the target attribute information of at least one of the human body and the human face, so that the thermodynamic diagram can be displayed in a differentiated manner according to the differentiation requirement of the user.

In some embodiments, the obtaining at least one of the attribute information of each human body and the attribute information of each human face in the image includes one of:

receiving at least one of attribute information of each human body and attribute information of each human face in the image sent by the electronic equipment at each moment;

receiving the image sent by the electronic equipment at each moment and position information of at least one of a human body frame and a human face frame in the image on the image; determining at least one of each human body image and each human face image corresponding to the received position information in the image; analyzing at least one of the human body images and the face images to obtain at least one of attribute information of the human bodies and attribute information of the faces;

receiving at least one of each human body image and each face image in the images sent by the electronic equipment at each moment; analyzing at least one of the human body images and the face images to obtain at least one of attribute information of the human bodies and attribute information of the faces.

In this way, when the thermodynamic diagram generation device receives at least one of the attribute information of each human body and the attribute information of each human face transmitted by the electronic equipment, the thermodynamic diagram generation device does not need to analyze the image, thereby reducing the calculation load of the thermodynamic diagram generation device; under the condition that the thermodynamic diagram generating device receives the position information of at least one of the human body frame and the human face frame on the image, which is sent by the electronic equipment, the thermodynamic diagram generating device and the electronic equipment both bear part of calculated amount, so that the condition that the calculated amount is large and the processing speed is slow in one equipment is avoided; in the case where the thermodynamic diagram generating device receives at least one of the human body images and the human face images transmitted by the electronic device, the image analysis task is completed on the thermodynamic diagram generating device, thereby reducing the computational load of the electronic device.

In some embodiments, the acquiring human body information of each human body in the image includes: acquiring serial number information of each human body in an image shot at a historical moment and time information of each human body appearing at the beginning; determining the shooting time information of each human body in each image shot at the historical moment based on the serial number information of each human body, the time information of each human body starting to appear and the configured time interval; in response to an input operation for the displayed selectable period, human body information of each human body corresponding to a target period matching the input operation is determined based on the shooting time information.

In this way, the shooting time information of each human body in each image shot at the historical time is determined based on the serial number information of each human body, the time information when each human body starts to appear and the configured time interval, so that the human body information of each human body in the crowd corresponding to the target time period input by the user is positioned based on the shooting time information of each human body, the obtained thermodynamic diagram can correspond to the target time period input by the user, and the user can know the crowd density distribution in the target time period through the thermodynamic diagram.

In some embodiments, the method further comprises: responding to a trigger operation of a target grid in the displayed thermodynamic diagram, and displaying the crowd attribute information corresponding to the target grid; the crowd attribute information corresponding to the target grid comprises: the human body matched with the target grid corresponds to at least one of the following: the human body identification, the human body attribute information, the human body image, the human face image, at least one time interval of all crowd peaks and valleys, at least one time interval of crowd peaks and valleys of different sexes, at least one time interval of crowd peaks and valleys of different age groups, at least one time interval of crowd peaks and valleys of different professions and the human traffic.

In this way, the user can also trigger the target grid in the displayed thermodynamic diagram, so that the crowd attribute information corresponding to the triggered target grid can be displayed, and the user can pay attention to the density distribution condition of the people in the real space corresponding to the target grid.

In some embodiments, the obtaining, based on the human body information, the number of human body relevant points matched by each grid in the multiple grids includes: determining human body information of each human body in a designated crowd from the human body information, wherein the designated crowd comprises people with front faces; determining a second number of human body relevant points matched with each grid based on the human body information of each human body in the designated crowd; generating a thermodynamic diagram based on the number of the human body relevant points matched by each grid, wherein the generating comprises the following steps: generating the thermodynamic diagram based on the second quantity.

In this way, the thermodynamic diagram of the crowd density having the frontal face can be obtained by specifying the human body information of each human body in the specified crowd including the person having the frontal face from the human body information and then generating the thermodynamic diagram based on the human body information of each human body in the specified crowd.

In some embodiments, the human body information of each human body includes: position information of the human body relevant points on the image; the obtaining of the number of the human body relevant points matched with each grid in the multiple grids based on the human body information includes: determining the position information of the human body related points on the electronic map based on the position information of the human body related points on the image; and determining the number of the human body related points matched with each grid based on the position information of the human body related points on the electronic map.

In this way, the position information of the human body relevant points on the electronic map is determined based on the position information of the human body relevant points on the image, so that the number of the human body relevant points in each grid in a plurality of grids obtained by dividing the electronic map can be accurately determined, and the obtained thermodynamic diagram can accurately determine the crowd density distribution in the scene in the target time period.

In some embodiments, the method further comprises: acquiring first user identification information input in a displayed user identification input box; determining a first electronic equipment identifier corresponding to the first user identifier information; the acquiring human body information of each human body in the image comprises the following steps: and receiving the position information of the human body relevant points on the image, which is sent by the electronic equipment corresponding to the first electronic equipment identifier at each moment.

In this way, a user can input first user identification information to the thermodynamic diagram generation device, so that the thermodynamic diagram generation device can determine the associated first electronic device identifier based on the first user identification information input by the user, and further can acquire the position information of each human body relevant point on the image in the image sent by the electronic device corresponding to the first electronic device identifier, so that the thermodynamic diagram generation device only visualizes the data corresponding to the first user identification information, and the user can also pay attention to the crowd density distribution related to the first user identification information, thereby not only reducing the risk of information leakage, but also improving the convenience of the user for acquiring required information.

In some embodiments, the method further comprises: receiving second user identification information sent by the terminal equipment; determining a second electronic equipment identifier corresponding to the second user identification information; the acquiring human body information of each human body in the image comprises the following steps: receiving position information of each human body relevant point on the image, which is sent by the electronic equipment corresponding to the second electronic equipment identifier at each moment; the method further comprises the following steps: and sending the thermodynamic diagram to the terminal equipment.

In this way, a user can input second user identification information to the terminal device, the terminal device sends the second user identification information to the thermodynamic diagram generation device, and the thermodynamic diagram generated by the thermodynamic diagram generation device is related to each image obtained by the electronic device corresponding to the second user identification information, so that only data corresponding to the second user identification information is visualized, the user can also pay attention to crowd density distribution related to the second user identification information, the risk of information leakage is reduced, and the convenience of the user for obtaining required information is improved; in addition, the terminal equipment can also display the thermodynamic diagram, so that the user can see the crowd density distribution through the terminal equipment, and the use convenience of the user is improved.

In some embodiments, the method further comprises: acquiring a mapping relation between a picture shot by the electronic equipment and the electronic map; the shooting parameters of the picture and the image are the same; the determining the position information of the human body related points on the electronic map based on the position information of the human body related points on the image comprises the following steps: and determining the position information of the human body relevant points on the electronic map based on the position information of the human body relevant points on the image and the mapping relation.

In this way, the thermodynamic diagram generation device can acquire the mapping relationship between the picture and the electronic map, and then determine the position information of each human body related point on the electronic map based on the mapping relationship and the position information of each human body related point on the image, so that the determined position information of each human body related point on the electronic map is accurate.

In some embodiments, the obtaining a mapping relationship between a picture taken by the electronic device and the electronic map includes: in response to the calibration operation of a first position in the picture and the calibration operation of a second position in the electronic map, determining first position information of the first position in the picture and second position information of the second position in the electronic map; generating the mapping relation between the picture and the electronic map based on the first position information and the second position information; the first position and the second position are the same position in the corresponding real world.

In this way, the mapping relation between the picture and the electronic map is generated based on the first position and the second position through the calibration operation of the first position and the second position by the user, and the mapping relation can be determined easily and accurately.

In some embodiments, the method further comprises: sending configuration information to the electronic device; the configuration information indicates: the electronic equipment sends the time interval of the position information of each human body relevant point on the image and whether the position information is continuously reported or not; under the condition that the configuration information indicates continuous reporting, receiving position information of each human body relevant point on the image, which is sent by the electronic equipment at the time interval, in the image; under the condition that the configuration information indicates that the position information of each human body on the image is not continuously reported, the position information of each human body sent by the electronic equipment at the current moment is received; receiving the position information of each human body on the image, which is sent by the electronic equipment at a specified moment after at least one time interval; and under the condition of not continuously reporting, the similarity between the images acquired before and after at least one time interval is smaller than a set threshold value.

In this way, the thermodynamic diagram generating device can report the position information of each human body related point on the image to the thermodynamic diagram generating device by sending the configuration information to the electronic device, so that the electronic device is instructed to report the position information of each human body related point on the image continuously under the condition that the service busyness of the thermodynamic diagram generating device is low, the determined thermodynamic diagram can reflect the crowd density distribution under the real scene more accurately, and the discontinuous electronic device is instructed to report the position information of each human body related point on the image under the condition that the service busyness of the thermodynamic diagram generating device is high, so that the operating efficiency of the thermodynamic diagram generating device is improved.

In a second aspect, an thermodynamic diagram generation apparatus is provided, including: the acquisition unit is used for acquiring human body information of each human body in the image; acquiring a plurality of grids obtained by dividing an electronic map corresponding to the image; the determining unit is used for obtaining the number of the human body related points matched with each grid in the grids based on the human body information; and the generating unit is used for generating a thermodynamic diagram based on the number of the human body related points matched with each grid.

In a third aspect, a thermodynamic diagram generation device is provided, including: a memory storing a computer program executable on the processor and a processor performing the steps of the above method.

In a fourth aspect, a computer storage medium is provided that stores one or more programs executable by one or more processors to implement the steps in the above-described method.

In the embodiment of the disclosure, the number of the human body relevant points matched with each grid determined by the thermodynamic diagram generation device is related to the human body information of each human body in the image, and further, the distribution situation of the human group density in a certain space in a scene can be accurately determined by the thermodynamic diagram generated based on the number of the human body relevant points matched with each grid.

Drawings

To more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without inventive efforts.

Fig. 1 is a schematic implementation flow diagram of a thermodynamic diagram generation method provided in an embodiment of the present disclosure;

fig. 2 is a schematic implementation flow diagram of another thermodynamic diagram generation method provided by the embodiment of the present disclosure;

fig. 3 is a schematic implementation flow chart of yet another thermodynamic diagram generation method provided by the embodiment of the present disclosure;

fig. 4 is a schematic implementation flow chart of a further thermodynamic diagram generation method provided by an embodiment of the present disclosure;

fig. 5 is a schematic implementation flow chart of a thermodynamic diagram generation method according to another embodiment of the present disclosure;

fig. 6 is a schematic view of an interface for uploading an electronic map according to an embodiment of the present disclosure;

FIG. 7 is a schematic interface diagram of a map list provided by an embodiment of the present disclosure;

FIG. 8 is a schematic diagram of a merchant identification configuration window provided by an embodiment of the present disclosure;

fig. 9 is a schematic diagram of a calibration result uploading manner according to an embodiment of the present disclosure;

fig. 10 is a schematic diagram illustrating a mapping relationship obtained through camera calibration according to an embodiment of the present disclosure;

fig. 11 is a schematic illustration of a thermodynamic diagram provided by an embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of a thermodynamic diagram generating device according to an embodiment of the present disclosure;

fig. 13 is a hardware entity diagram of a thermodynamic diagram generation device according to an embodiment of the present disclosure.

Detailed Description

The technical solution of the present disclosure will be specifically described below by way of examples with reference to the accompanying drawings. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.

It should be noted that: in the examples of this disclosure, "first," "second," etc. are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. In the embodiments of the present disclosure, at least two are referred to.

In addition, the technical solutions described in the embodiments of the present disclosure can be arbitrarily combined without conflict.

In some embodiments, a thermodynamic diagram is generated based on the number of times a person appears in a region of space, which may not accurately reflect the thermodynamic condition of the population. For example, if a person stays in a spatial area for a long time, but the thermodynamic diagram generated in this way shows only one occurrence of the person, the thermodynamic situation of the person in the spatial area is not well expressed. In addition, the use of face data is limited to situations where the face is occluded, resulting in data loss. Therefore, the thermodynamic diagram obtained in the embodiment cannot accurately show the distribution of the crowd density in the real scene.

In the embodiment of the disclosure, a new thermodynamic diagram generation method is provided, and the method can comprehensively generate a thermodynamic diagram according to the stay time and the human index of the human body data, or comprehensively generate a thermodynamic diagram according to the stay time, the human face data and the human index of the human body data, and can objectively evaluate the thermodynamic condition of an actual area, so that the obtained thermodynamic diagram is closer to an actual scene.

The following describes an architecture to which the method for generating a thermal map provided by the embodiments of the present disclosure is applicable:

in some implementations, the architecture can include a camera device and a thermodynamic diagram generation device, the camera device can include at least one camera that can send captured images and/or analysis data to the thermodynamic diagram generation device to cause the thermodynamic diagram generation device to generate a thermodynamic diagram based on the captured images and/or analysis data. The thermodynamic diagram generation device may display the thermodynamic diagram on a display screen, or may transmit the thermodynamic diagram to a display device associated therewith to cause the display device to display the thermodynamic diagram.

In some embodiments, the architecture may include an image capture device, an image analysis device, and a thermodynamic diagram generation device, the image capture device continuously capturing each image and transmitting the captured images to the image analysis device, the image analysis device analyzing the captured images to obtain analysis data, and transmitting the analysis data to the thermodynamic diagram generation device to cause the thermodynamic diagram generation device to generate a thermodynamic diagram based on the analysis data. Wherein the image analysis apparatus and the image pickup apparatus may be integrated together or separately provided.

In some embodiments, the architecture may include an image capture device, a thermodynamic diagram generation device, and a terminal device, the image capture device may transmit captured images and/or analysis data to the thermodynamic diagram generation device, and the thermodynamic diagram generation device may transmit a thermodynamic diagram to the terminal device after generating the thermodynamic diagram based on the captured images and/or analysis data to cause the terminal device to display the thermodynamic diagram.

Fig. 1 is a schematic implementation flow diagram of a thermodynamic diagram generation method provided in an embodiment of the present disclosure, and as shown in fig. 1, the method is applied to a thermodynamic diagram generation apparatus, and the method includes:

s101, acquiring human body information of each human body in the image.

In some embodiments, the thermodynamic diagram generating device may be a chip or a processor, and the chip or the processor may be applied to the thermodynamic diagram generating apparatus. In other embodiments, the thermodynamic diagram generating device may be a thermodynamic diagram generating apparatus. The thermodynamic diagram generation device may include one of: a server, a cloud device, a Mobile Phone (Mobile Phone), a tablet computer (Pad), a computer with wireless transceiving function, a palm computer, a desktop computer, a personal digital assistant, a portable media player, an intelligent sound box, a navigation device, an intelligent watch, and an intelligent glasses, wearable devices such as Smart necklaces, pedometers, digital TVs, Virtual Reality (VR) terminal devices, Augmented Reality (AR) terminal devices, wireless terminals in Industrial Control (Industrial Control), wireless terminals in unmanned Driving (Self Driving), wireless terminals in Remote Surgery (Remote Medical Surgery), wireless terminals in Smart Grid, wireless terminals in Transportation Safety (Transportation Safety), wireless terminals in Smart City (Smart City), wireless terminals in Smart Home (Smart Home), and vehicles, onboard devices, onboard modules in an in-vehicle networking system, and the like.

The embodiment of the present disclosure will explain a thermodynamic diagram generation method by taking a thermodynamic diagram generation device as an example. It is to be noted that the method of generating a thermodynamic diagram may be performed by a thermodynamic diagram generating device, a processor, or a chip.

Acquiring the body information of each body in the image may include: human body information of each human body in an image obtained in a target period is acquired.

The image in S101 may be at least one frame image. The image obtained in the target period may include at least one frame image. In some embodiments, the image may be captured. In other embodiments, the image may be captured from a video source; the video source may be obtained from the cloud, or may be read from the storage of the thermodynamic diagram generating apparatus itself.

In some implementations, the target period may be determined based on a period of user input. For example, the thermodynamic diagram generation device may display an input period, and the user may input a target period based on a trigger for the displayed input period, so that the thermodynamic diagram generation device gets the target period. For another example, the terminal device may display the input period, the user may trigger the displayed input period on the terminal device, input the target period, and the terminal device may transmit the obtained target period to the thermodynamic diagram generating device, so that the thermodynamic diagram generating device obtains the target period. In other embodiments, the target period may be automatically generated by the thermodynamic diagram generation device. The thermodynamic diagram generation device may determine a latest target period every preset time period. The preset time period may be between 1 second and 1 day. For example, the preset time period may be 1 second, 1 minute, 30 minutes, one hour, 12 hours, 1 day, or the like. In this way, when the current time reaches the last time corresponding to a certain target time period, the thermodynamic diagram generation device can acquire the human body information of each human body in the image acquired in the target time period.

The at least one frame image may be a continuously photographed image or a discontinuously photographed image. For example, the image pickup apparatus may take images every set time length, and the human body information of each human body acquired by the thermodynamic diagram generation apparatus is determined from at least one frame of images taken every set time length within the target period. In other embodiments, the image capturing apparatus may capture an image every set time length, analyze whether a similarity between the image captured this time and a previous image (i.e., an image captured last time) is smaller than a threshold, if so, characterize that a difference between the image captured this time and the previous image is large, analyze the image captured this time, and obtain human body information of each human body in the image captured this time; and if the similarity is larger than or equal to the threshold value, the image pickup equipment shoots the next image without analyzing the human body information of the shot image until the similarity between a certain image shot later and the previous image is determined to be smaller than the threshold value, and the image pickup equipment analyzes the image to obtain the human body information of each human body in the image, so that the human body information of each human body in the image obtained in the target time period is obtained.

The image in the embodiment of the present disclosure may be a captured image, and in a case where the image capturing apparatus includes a plurality of cameras, the captured image may be: the images taken by the multiple cameras are spliced or synthesized to obtain a spliced image or a synthesized image, or the images taken by the multiple cameras respectively, that is, the images that have not been spliced or synthesized, are included.

In some embodiments, the imaging apparatus may acquire human body information of each human body in the image and transmit the information to the thermodynamic diagram generation apparatus, so that the thermodynamic diagram generation apparatus may obtain the human body information of each human body in the image. In other embodiments, the image capturing apparatus may transmit the image to the thermodynamic diagram generation apparatus after capturing the image, so that the thermodynamic diagram generation apparatus may analyze the image to obtain the body information of each body in the image. For example, the two adjacent images transmitted to the thermodynamic diagram generation apparatus by the image pickup apparatus may be continuously captured or not (in a case where the image pickup apparatus determines that there is a similarity between the two adjacent images that should be larger than a threshold value, the two adjacent images transmitted to the thermodynamic diagram generation apparatus are not continuously captured). For another example, in a case where the image capturing apparatus transmits the currently captured image to the thermodynamic diagram generation apparatus once every set period of time, the thermodynamic diagram generation apparatus may analyze only the current image to obtain the human body information of each human body in the current image, but not to obtain the human body information of each human body in at least one next frame of image, in a case where a similarity between the current image and at least one next frame of image that is adjacent to the current image is greater than a threshold.

In some embodiments, each human in the image may be all the human present in the image. For example, in a case where it is determined that 5 persons are included in a certain frame image, each person in the image may be a person of the 5 persons. In other embodiments, each human body in the image may be a human body meeting a set condition in the image, and the human body meeting the set condition may include at least one of the following: images with a frontal face, a male human body, a female human body, a child human body, an elderly human body, an educational practitioner human body, and the like.

The human body information of each human body may include at least one of: position information of a human body frame of each human body in the image, position information of a feature point (for example, at least one of four vertices) on the human body frame of each human body in the image, and position information of a feature point (for example, at least one of a head feature point, an arm feature point, and a leg feature point) of each human body in the image. In further embodiments, the body information of each body may further include at least one of: height information, gender information, stature information, dressing style information and occupation information. In the disclosed embodiment, the position information may include coordinate information, and the coordinate information may be two-dimensional coordinate information.

And S102, acquiring a plurality of grids obtained by dividing the electronic map corresponding to the image.

At least a part of the area in the image can correspond to the same scene as at least a part of the area in the electronic map. For example, the image may be captured by the imaging device for a certain corridor on a floor, and the electronic map may be a map of the floor. For another example, the image may be captured by an imaging device for a certain floor, and the electronic map is also a map of the floor.

It should be noted that the electronic map may be regular or irregular in shape, the electronic maps with different shapes may be processed in the same or similar manner, and in some embodiments, in order to facilitate network partitioning of the electronic map with an irregular shape, the electronic map with an irregular shape may be complemented to obtain an electronic map with a regular shape, and then the electronic map with a regular shape is subjected to grid partitioning.

In some embodiments, the shape of the electronic map may be a rectangle, and the dividing of the electronic map may be dividing the electronic map horizontally and/or vertically to obtain a plurality of grids. In other embodiments, the shape of the electronic map may be an ellipse, a circle, a polygon other than a rectangle, a combined shape, or the like, and the thermodynamic diagram generation device may perform horizontal division and/or vertical division on the non-rectangular electronic map to obtain a plurality of meshes, or may complement the non-rectangular electronic map to obtain a rectangular map, and perform horizontal division and/or vertical division on the complemented rectangular map to obtain a plurality of meshes.

In some embodiments, each of the plurality of grids may be a rectangular grid, the rectangular grid may be a square grid or a rectangular grid, and one edge of the rectangular grid may correspond to at least one pixel point. For example, in some embodiments, each edge of the square grid may correspond to 5 pixels. In other embodiments, each mesh of the plurality of meshes may be a triangle, a pentagon, a hexagon, or other regular or irregular shaped mesh. In still other embodiments, there may be multiple different types of grids in the multiple grids. For example, there is a portion of the grid in the plurality of grids that is: a rectangle of a first size, and another part of the grid is: a rectangle of a second size, the first size and the second size being different. For another example, there are some of the meshes in the plurality of meshes that are rectangular and some of the meshes that are triangular.

And S103, obtaining the number of human body relevant points matched with each grid in the multiple grids based on the human body information.

The human-related points may include at least one of: at least one vertex of the body frame, a body keypoint. When there are N human bodies in one image, the number of human body relevant points may be a multiple of N, for example, the number of human body relevant points may be N, 2N, 3N, or 4N, and so on.

For example, in the case where the human body information of the human body includes position information of four vertices of the human body frame in the image, the number of vertices matched by each mesh may be determined as the number of human body-related points matched by each mesh. For example, if the number of vertices falling into a certain mesh in the target period is S, the number of human-related points matched by the mesh is also S, and S is an integer greater than or equal to 0.

And S104, generating a thermodynamic diagram based on the number of the human body relevant points matched with each grid.

In the case where the individual bodies in the image are all bodies determined from the image, the thermodynamic diagram may represent the crowd density of all persons in the region of space corresponding to the electronic map over the target period.

When the thermodynamic diagram generation device obtains the number of M human body related points (the M value is the same as the number of meshes), the number of M human body related points may be divided to obtain a plurality of sets of data. The division mode may include an average distribution division mode or a normal distribution division mode, so as to obtain at least two distribution intervals, and then attributing the number of the relevant points of each human body to one of the at least two distribution intervals. For example, the number of M human body correlation points ranges from 0 to 99, and the obtained at least two distribution intervals may be: 0 to 19, 20 to 39, 40 to 59, 60 to 79 and 80 to 99. For another example, a normal distribution corresponding to the number of M person-related points may be determined, and then at least two distribution intervals may be determined based on the normal distribution. In some embodiments, the areas corresponding to the determined at least two distribution intervals may be the same in the coordinate system of the normal distribution.

In some embodiments, the thermodynamic diagram may be obtained by rendering the grid matched with the number of each human-body-related point to a distribution interval, where the number of each human-body-related point belongs to the distribution interval. For example, in the case where at least two distribution intervals are five, the colors of the grid in the thermodynamic diagram are five. In other embodiments, instead of determining to which distribution interval the number of human-related points belongs, the thermodynamic diagram generating device may determine respective rendering colors of different grids according to the difference between the numbers of human-related points matched by each grid, for example, in a case where the number of human-related points matched by one grid is larger, the color rendered for the grid is also darker. Accordingly, the smaller the number of human-related points matched by a grid, the lighter the color rendered for the grid.

Fig. 2 is a schematic implementation flow diagram of another thermodynamic diagram generation method provided in an embodiment of the present disclosure, and as shown in fig. 2, the method is applied to a thermodynamic diagram generation device, and the method includes:

s201, acquiring human body information of each human body in the image.

S202, acquiring a plurality of grids obtained by dividing the electronic map corresponding to the image.

S203, acquiring target attribute information aiming at least one of the human face and the human body.

The target attribute information may include at least one of: gender information, age group information, occupation range information, height range information, weight range information, dressing style range information, and the like. Wherein the target attribute information of the human body may include at least one of: occupation range information, height range information, weight range information, dressing style range information and the like. The target attribute information of the face may include: at least one of sex information, age group information, and the like is specified. The specified sex information may be male or female.

A method of acquiring target attribute information for at least one of a human face and a human body is described herein: acquiring at least one of attribute information of each human body and attribute information of each human face in the image; determining a plurality of attribute information for obtaining a target population based on the obtained attribute information; in response to a trigger operation on at least one of the plurality of displayed attribute information, attribute information that matches the trigger operation is determined as target attribute information.

In some embodiments, a plurality of attribute information may be presented on the thermodynamic diagram generation device, so that the thermodynamic diagram generation device may be caused to obtain the target attribute information based on a user's trigger operation on the thermodynamic diagram generation device. In other embodiments, a plurality of attribute information may be displayed on the terminal device, so that the terminal device may obtain the target attribute information and send the target attribute information to the thermodynamic diagram generating device based on a trigger operation of the terminal device by a user. The terminal device may include a display device, and the terminal device may be a mobile phone, a computer, a tablet computer, or the like.

By the method, the target attribute information of at least one of the human body and the human face is determined, namely the target attribute information of at least one of the human body and the human face is obtained according to the triggering operation of the user on at least one of the plurality of attribute information displayed, so that the obtained target attribute information of at least one of the human body and the human face meets the requirements of the user, the generated thermodynamic diagram is displayed according to the target population distribution condition with the target attribute information of at least one of the human body and the human face, and the thermodynamic diagram can be displayed in a differentiated mode according to the differentiation requirements of the user.

In some embodiments, the thermodynamic diagram generation device may receive at least one of attribute information of each human body and attribute information of each human face in an image transmitted by the electronic device at each time. For example, the electronic device may acquire images at respective times, analyze each acquired image to obtain at least one of attribute information of each human body and attribute information of each human face in each image, and transmit at least one of the obtained attribute information of each human body and attribute information of each human face to the thermodynamic diagram generation device.

The electronic device in the embodiments of the present disclosure may be the image capturing device in the embodiments described above, or the image analysis device, or the electronic device may be a combination of the image capturing device and the image analysis device in the embodiments described above. In the case where there is no person in an image captured by the image capturing apparatus at a certain time, the image capturing apparatus will not determine human body information of the human body.

In other embodiments, the thermodynamic diagram generation device may receive an image sent by the electronic device at each moment, and position information of at least one of a human body frame and a human face frame in the image on the image; determining at least one of each human body image and each human face image corresponding to the received position information in the image; analyzing at least one of each human body image and each face image to obtain at least one of attribute information of each human body and attribute information of each face. For example, the electronic device may acquire each image at each time, analyze each image to obtain position information of at least one of a human body frame and a human face frame in each image on the image, and send each image and the position information to the thermodynamic diagram generation device.

In still other embodiments, the thermodynamic diagram generation device may receive at least one of individual human body images and individual face images of images transmitted by the electronic device at various times; analyzing at least one of each human body image and each face image to obtain at least one of attribute information of each human body and attribute information of each face. For example, the electronic device may acquire each image at each time, analyze each image to obtain at least one of each body image and each face image in each image, and transmit the obtained at least one of each body image and each face image to the thermodynamic diagram generation device.

It is to be noted that the human body image or the face image in the embodiment of the present disclosure may be a rectangular image, the rectangular image may include not only a human body part in a human body frame or a face part in a face frame, but also a background part and/or partial features of other people, or the human body image may be a human body cutout and the face image may be a face cutout. In addition, in the case where the electronic apparatus includes at least two cameras, in the case where the thermodynamic diagram generation apparatus receives images or human body information respectively transmitted by the at least two cameras at the same time, there may be a case where coincidence data exists, and the thermodynamic diagram generation apparatus may retain only one coincidence data. For example, in the case where the human bodies corresponding to the two human body frames are the human bodies of the same person, the thermodynamic diagram generation device will retain one human body frame.

The attribute information of the human body may include at least one of: professional information, height information, weight information, dressing style information, etc. The attribute information of the face may include at least one of: gender information, age information, etc.

For example, in some embodiments, the thermodynamic diagram generation device may receive each image sent by the electronic device, and analyze each image to obtain at least one of attribute information of each human body and attribute information of each human face in each image.

In the implementation process, the same person may exist in different images, the attribute information of the human body of the same person is the same, and the attribute information of the human face of the same person is the same.

S204, determining the person with the target attribute information from the human body information to obtain a target crowd comprising the person with the target attribute information.

For example, in the case where the target attribute information includes attribute information indicating that the sex information is female, the target population may be a female population. In the case where the target attribute information includes attribute information indicating that the sex information is female and the age group information is 25 to 40 years old, the target population may be a female population of 25 to 40 years old.

S205, determining a first number of human body relevant points respectively matched with each grid based on the human body information of the target crowd.

For example, in the case that the human body information of the target population includes position information of four vertices of the human body frame of the target population in the image, the number of vertices of the human body frame of the target population matched by each mesh may be determined as the first number of human body related points matched by each mesh.

And S206, generating a thermodynamic diagram based on the first quantity.

In the embodiment of the disclosure, the target crowd with the target attribute information is determined, so that the thermodynamic diagram generated based on the human body information in the target crowd can represent the target crowd density in the space region corresponding to the electronic map in the target time period, and further, the distribution condition of the target crowd density in the scene can be accurately determined through the thermodynamic diagram.

The embodiment corresponding to fig. 2 describes how to directly generate the thermodynamic diagram for characterizing the target population density in the spatial region within the target time period, and in other embodiments, after the thermodynamic diagram for characterizing the population density in all spatial regions corresponding to the electronic map within the target time period is displayed, at least one attribute information may be determined as the target attribute information in response to a triggering operation on at least one attribute information of the displayed plurality of attribute information; then, acquiring target crowds with target attribute information in each image shot in a target time period, and acquiring human body information of each human body in the target crowds; thirdly, determining a first number of the relevant points of each human body in the target crowd matched with each grid based on the human body information of each human body in the target crowd; and then updating the displayed thermodynamic diagrams representing the densities of all the people in the space region in the target time period based on the first number of the relevant points of each person in the target crowd matched with each grid to obtain the thermodynamic diagrams representing the densities of the target people in the space region in the target time period, and displaying the updated thermodynamic diagrams through the thermodynamic diagram generating device or the terminal device.

Fig. 3 is a schematic implementation flow diagram of another thermodynamic diagram generation method provided by an embodiment of the present disclosure, and as shown in fig. 3, the method is applied to a thermodynamic diagram generation device, and the method includes:

s301, acquiring the serial number information of each human body in the images shot at the historical time and the time information of each human body starting to appear.

The historical time may be a time prior to the current time. Different human bodies have different serial number information, the serial number information is used for identifying the human bodies, and the human bodies corresponding to the same human bodies on different images are the same.

S302, based on the serial number information of each human body, the time information of each human body appearing at the beginning and the configured time interval, the shooting time information of each human body in each image shot at the historical moment is determined.

The time information of the beginning of the appearance of each human body can be as follows: time information that each human body has just appeared in the image. The time duration corresponding to the time interval may be the set time duration.

And S303, responding to the input operation of the displayed optional time period, and determining the human body information of each human body corresponding to the target time period matched with the input operation on the basis of the shooting time information.

In some embodiments, the target period may correspond to a time period of no more than 24 hours.

And S304, acquiring a plurality of grids obtained by dividing the electronic map corresponding to the image.

S305, obtaining the number of human body relevant points matched with each grid in the multiple grids based on the human body information.

And S306, generating a thermodynamic diagram based on the number of the human body relevant points matched with each grid.

In the embodiment of the disclosure, the shooting time information of each human body in each image shot at the historical moment is determined based on the serial number information of each human body, the time information of each human body appearing at the beginning and the configured time interval, so that the human body information of each human body in the crowd corresponding to the target time interval input by the user is located based on the shooting time information of each human body, the obtained thermodynamic diagram can correspond to the target time interval input by the user, and the user can know the crowd density distribution in the target time interval through the thermodynamic diagram.

In some embodiments, after the thermodynamic diagram is obtained and displayed, in response to a trigger operation on the target grid in the displayed thermodynamic diagram, the crowd attribute information corresponding to the target grid may be displayed;

the target mesh may be at least one mesh. The crowd attribute information corresponding to the target grid comprises: the human body matched with the target grid corresponds to at least one of the following:

the human body identification, the human body attribute information, the human body image, the human face image, at least one time interval of all crowd peaks and valleys, at least one time interval of crowd peaks and valleys of different sexes, at least one time interval of crowd peaks and valleys of different age groups, at least one time interval of crowd peaks and valleys of different professions and the human traffic.

In some scenes, under the condition that people who watch the exhibition stand or a certain display screen need to be known, the camera device can be arranged on the exhibition stand or the display screen, so that the appointed crowd with the front face in the crowd is determined through the image shot by the camera device, and the crowd distribution of watching the exhibition stand or the certain display screen can be analyzed.

Fig. 4 is a schematic implementation flow diagram of a further thermodynamic diagram generation method provided by an embodiment of the present disclosure, and as shown in fig. 4, the method is applied to a thermodynamic diagram generation device, and the method includes:

s401, acquiring human body information of each human body in the image.

S402, obtaining a plurality of grids obtained by dividing the electronic map corresponding to the image.

S403, from the human body information, the human body information of each human body in the designated group is determined, and the designated group includes a person having a frontal face.

For example, if the crowd determined in one image includes 5 persons but the crowd having a frontal face includes 2 persons, the thermodynamic diagram generation device may determine these 2 persons as the specified crowd in the image.

Embodiments of determining whether a person has a frontal face may include whether features of both eyes and mouth of the face are recognized from the image, and if so, determining that the person has a frontal face.

S404, determining a second number of the human body relevant points matched with each grid based on the human body information of each human body in the designated crowd.

For example, in a case where the human body information of the specified person group includes position information of four vertices of the human body frame of the specified person group in the image, the number of vertices of the human body frame of the specified person group matched by each mesh may be determined as the second number of human body related points matched by each mesh.

And S405, generating a thermodynamic diagram based on the second quantity.

Wherein the thermodynamic diagram in S405 characterizes the crowd density of the viewing target object. The target object may be a camera or an article placed together with the camera device, for example, a display stand or some display screen.

In the embodiment of the disclosure, the human body information of each human body in the designated crowd including the person with the front face is determined from the human body information, and then the thermodynamic diagram is generated based on the human body information of each human body in the designated crowd, so that the thermodynamic diagram with the crowd density of the front face can be obtained.

In other embodiments, after displaying the thermodynamic diagram for representing all the people group density in the space region corresponding to the electronic map in the target time period, in response to the triggering operation of the triggering control for representing the specified people group density of the watching target object, the human body information of each human body in the specified people group with the front face is determined from the human body information of each human body in all the people group; determining a second number of human body relevant points matched with each grid based on the human body information of each human body in the designated crowd; and then updating the displayed thermodynamic diagrams representing all the crowd densities in the space region in the target time period based on the second number of the human body related points matched by each grid to obtain the thermodynamic diagrams representing the specified crowd densities of the watching target object in the target time period, and displaying the updated thermodynamic diagrams through the thermodynamic diagram generating device or the terminal device.

Fig. 5 is a schematic flow chart of an implementation of a thermodynamic diagram generation method according to another embodiment of the present disclosure, as shown in fig. 5, in an embodiment of the present disclosure, human body information of each human body includes: position information of each human body relevant point on the image; the method is applied to the thermodynamic diagram generation device and comprises the following steps:

s501, obtaining human body information of each human body in the image.

In some embodiments, prior to S501, the thermodynamic diagram generation device may perform the following steps: acquiring first user identification information input in a displayed user identification input box; a first electronic device identification corresponding to the first user identification information is determined. Thus, S501 may be implemented by: and receiving the position information of each human body relevant point on the image in the image sent by the electronic equipment corresponding to the first electronic equipment identifier at each moment.

The thermodynamic diagram generating device may have a display device, and the display device may display a user identification input box, and the thermodynamic diagram generating device may obtain first user identification information through first user identification information input to the user identification input box by a user, and further determine a first electronic device identification associated with the first user identification information. The first electronic device identifier or a second electronic device identifier described below may include an image capturing device identifier or an image analysis device identifier.

The first subscriber identity information or the second subscriber identity information may comprise at least one of: a Universal Unique Identifier (UUID), a cloud background address, a background port number, and the like. In the embodiment of the present disclosure, the first user identification information or the second user identification information described below may be personal identification information or merchant identification information.

By the method, the user can input the first user identification information to the thermodynamic diagram generating device, so that the thermodynamic diagram generating device can determine the associated first electronic equipment identification based on the first user identification information input by the user, and further can acquire the position information of each human body relevant point on the image in the image sent by the electronic equipment corresponding to the first electronic equipment identification, so that the thermodynamic diagram generating device only visualizes the data corresponding to the first user identification information, and the user can also pay attention to the crowd density distribution relevant to the first user identification information, thereby not only reducing the risk of information leakage, but also improving the convenience for the user to acquire required information.

In other embodiments, prior to S501, the thermodynamic diagram generation device may perform the following steps: receiving second user identification information sent by the terminal equipment; determining a second electronic equipment identifier corresponding to the second user identification information; thus, S501 may be implemented by: and receiving the position information of each human body relevant point on the image in the image sent by the electronic equipment corresponding to the second electronic equipment identification at each moment. In this manner, the thermodynamic diagram generation device, after obtaining the thermodynamic diagram, may transmit the thermodynamic diagram to the terminal device to cause the terminal device to display the thermodynamic diagram.

The terminal device can be provided with a certain application program, the terminal device can display the user identification input box through the triggering operation of the user on the application program, and the terminal device obtains second user identification information through second user identification information input to the user identification input box by the user. The terminal device may send second user identification information to the thermodynamic diagram generating device, so that the thermodynamic diagram generating device may determine a second electronic device identification associated with the second user identification information.

In some implementation scenarios, a certain merchant may input the second user identification information of the merchant through the terminal device, where the second user identification information of the merchant may be self-registered by the merchant or assigned by the thermodynamic diagram generation device, and then the merchant inputs the target time period in the input box of the input time period displayed on the thermodynamic diagram display window. After the terminal device obtains the second user identification information and the target time period of the merchant, the terminal device may send the second user identification information and the target time period of the merchant to the thermodynamic diagram generation device, so that the thermodynamic diagram may obtain the second electronic device identification associated with the merchant corresponding to the second user identification of the merchant, and further obtain the human body information of each human body in the image shot by the camera device associated with the merchant in the target time period.

And S502, acquiring a plurality of grids obtained by dividing the electronic map corresponding to the image.

S503, based on the position information of the human body related points on the image, the position information of the human body related points on the electronic map is determined.

In some embodiments, the thermodynamic diagram generation device may acquire a mapping relationship between a picture taken by the electronic device and the electronic map; the shooting parameters of the picture and the image are the same. Thus, S503 can be implemented by: and determining the position information of each human body relevant point on the electronic map based on the position information of each human body relevant point on the image and the mapping relation.

For example, the picture and the image may both be taken by one or at least two cameras using fixed positions and viewing angles, or the picture and the image may both be a mosaic or a combination of at least two images taken by at least two cameras using fixed positions and viewing angles, respectively.

In this way, the thermodynamic diagram generation device can acquire the mapping relationship between the picture and the electronic map, and then determine the position information of each human body relevant point on the electronic map based on the mapping relationship and the position information of each human body relevant point on the image, so that the determined position information of each human body relevant point on the electronic map is accurate.

In some embodiments, the mapping relationship between the picture and the electronic map may be obtained by: responding to the calibration operation of a first position in the picture and the calibration operation of a second position in the electronic map, and determining first position information of the first position in the picture and second position information of the second position in the electronic map; generating a mapping relation between the picture and the electronic map based on the first position information and the second position information; the first position and the second position correspond to the same position in the real world.

In some embodiments, the first location and the second location may be both one location, the first location may be a location near the center of the picture, and the second location may be a location near the center of the electronic map, and then the mapping relationship between the picture and the electronic map may be generated based on the one location included in the first location and the one location included in the second location.

In other embodiments, the first location may include at least two locations, and the second location may also include at least two locations, and the first location may include the same number of at least two locations as the second location; then, based on at least two positions included in the first position and the number of at least two positions included in the second position, determining multiple groups of position information, wherein each group of position information comprises a position in the picture and a position in the electronic map, and the two positions included in each group of position information correspond to the same position in the real world; then, based on the plurality of sets of position information, a mapping relation between the picture and the electronic map can be generated.

In order to improve the accuracy of the determined mapping relationship, the at least two positions included in the first position may be disposed as scattered as possible, or may be disposed as near as possible to a position where people are likely to appear, any three positions of the at least two positions included in the first position may not be on a straight line, and the at least two positions included in the first position should be selected as possible from positions where positions are not likely to change in an actual scene, such as the ground.

In this embodiment, by the user performing the calibration operation on the first position and the second position, the mapping relationship between the picture and the electronic map is generated based on the first position and the second position, and the mapping relationship can be easily and accurately determined.

S504, determining the number of the human body relevant points matched with each grid based on the position information of the human body relevant points on the electronic map.

And S505, generating a thermodynamic diagram based on the number of the human body relevant points matched with each grid.

In the embodiment of the disclosure, the position information of each human body relevant point on the electronic map is determined based on the position information of each human body relevant point on the image, so that the number of human body relevant points in each grid in a plurality of grids obtained by dividing the electronic map can be accurately determined, and the obtained thermodynamic diagram can accurately determine the crowd density distribution in the scene in the target time period.

In some embodiments, the thermodynamic diagram generation device may further perform the steps of: sending configuration information to the electronic equipment; the configuration information indicates: and the electronic equipment sends the time interval of the position information of each human body relevant point on the image and whether the position information is continuously reported or not.

And receiving the position information of each human body relevant point in the image, which is sent by the electronic equipment at a time interval, on the image under the condition that the configuration information indicates continuous reporting.

Under the condition that the configuration information indicates that the information is not continuously reported, receiving the position information of each human body on the image, which is sent by the electronic equipment at the current moment; receiving position information of each human body on the image, which is sent by the electronic equipment at a designated moment after at least one time interval; and under the condition of not continuously reporting, the similarity between the images acquired before and after at least one time interval is smaller than a set threshold value.

The position information of each human body on the image, which is sent by the electronic device at the current time, may be the determined position information of each human body on the image at the current time; the position information of each human body on the image, which is transmitted by the electronic device at the designated time, may be the position information of each human body on the image at the determined designated time.

In the embodiment of the disclosure, the thermodynamic diagram generating device can indicate whether the electronic device continuously reports the position information of each human body related point on the image to the thermodynamic diagram generating device by sending the configuration information to the electronic device, so that the electronic device is indicated to continuously report the position information of each human body related point on the image under the condition that the service busy degree of the thermodynamic diagram generating device is low, the determined thermodynamic diagram can more accurately reflect the crowd density distribution under a real scene, and the electronic device is indicated to report the position information of each human body related point on the image under the condition that the service busy degree of the thermodynamic diagram generating device is high, so that the operating efficiency of the thermodynamic diagram generating device is improved.

In the embodiment of the present disclosure, the main process of generating the thermodynamic diagram may include the following four steps:

step one, uploading an electronic map at a background. In the step, basic map information can be added, an electronic map is uploaded, and each floor of each branch can correspond to one electronic map; the branch office may occupy one or at least two floors.

And step two, the calibration tool acquires the map and the camera equipment under each branch organization and calibrates the camera in the camera equipment.

First, the user can fill in basic information of at least one of an account, an address, a port and the like corresponding to the background. Then, the camera shooting device is determined from the camera shooting device list, an electronic map corresponding to the determined camera shooting device is selected, each camera of the determined camera shooting device is calibrated, at least one coordinate point in a picture shot by the camera is mapped to at least one coordinate point in the electronic map, and a mapping relation is determined based on the at least one coordinate point in the picture and the at least one coordinate point in the electronic map. The process can be tested and calibrated for many times, and the more accurate the process is, the better the process is. And then the determined camera equipment reports data (including human body data and/or human face data). The reported data may be at least one of coordinates of a human body frame and coordinates of a human face frame with a fixed time interval, the time interval may be configured to be 1000ms by default, and the thermodynamic diagram generating device is reported at least one of the coordinates of the human body frame and the coordinates of the human face frame, and the coordinate serial number together, and the thermodynamic diagram generating device may calculate a timestamp of each coordinate according to at least one of time information, the time interval, and the coordinate serial number at which each human body starts to appear. The thermodynamic diagram can be preferentially generated by adopting human body data, the human face data is only used for screening, and if no human body exists, the human face data is used for generating the thermodynamic diagram.

In some embodiments, the human data may include content of at least one of: the system comprises a human body identification, a branch mechanism identification, a camera equipment identification, time information of each human body, a human body sectional drawing, time information of each human body appearing last, a time interval, an identification of a human body frame corresponding to each image, a lower right corner x coordinate of the human body frame corresponding to each image, a lower right corner y coordinate of the human body frame corresponding to each image, an upper left corner x coordinate of the human body frame corresponding to each image, an upper left corner y coordinate of the human body frame corresponding to each image and a unique merchant identification.

The time information of the face and/or the human body appearing at the beginning is the time when the face and/or the human body is detected for the first time in the face and/or the human body data. The time information of the last appearance of the face and/or the human body is the time when the face and/or the human body is detected in the face and/or the human body data for the last time. The time interval between the time point of the first detection of the face and/or the human body and the time point of the last detection of the face and/or the human body is not limited, and the detection of the face and/or the human body can be interrupted.

In some embodiments, the face data may include at least one of: the system comprises a unique merchant identifier, a unique branch mechanism identifier, a unique camera equipment identifier, a face identifier, time information of face starting to appear, time information of face appearing last time, an average value of age results of face attributes obtained for multiple times, an average value of gender results of face attributes obtained for multiple times, a target object watched by the face, a watching starting timestamp, a watching ending timestamp, face matting, quality scores of face matting, a time interval, an identifier of a face coordinate frame, an upper left corner x coordinate of the face frame, an upper left corner y coordinate of the face frame, a lower right corner x coordinate of the face frame, and a lower right corner y coordinate of the face frame. The identification of the face coordinate frame may be discontinuous, and may be interrupted although the detected face is interrupted.

And step three, generating grid data. The thermodynamic diagram generation device divides the electronic map into rectangular grids, also called planar grids (planGrid), and allocates a planGrid identifier to each planGrid. The rectangular planGrid is composed of n (height) multiplied by m (width) pixel points. The value of n and m ranges from 1 to 10. n and m default to 5, i.e. a 5 x 5 rectangle. The planGrid consists of at least two coordinate points located within the rectangle. The planegid is the basic spatial unit of the thermodynamic analysis.

And step four, generating thermodynamic diagram statistics. In a time period (corresponding to the target time period), the coordinates of how many human frames are in a planGrid, that is, the heat value of the planGrid in the query period. And after calculating the heat power values of all the planGrid, according to the N heat power intervals, obtaining the distribution range of the heat power distribution intervals according to average distribution or normal distribution, and attributing each planGrid to one of the N heat power distribution intervals. The number of thermal intervals defaults to 5 (other values may be configured).

The thermal analysis needs to use human body data, and the human face data is used for human face attribute screening based on human face and human body association. Based on the coordinates of the face frame associated with the coordinate points and the face identification, screening according to the age and gender of the face corresponding to the face identification can be supported, but the data participating in the screening only comprises the coordinate points associated with the face data and having the face attribute data. After screening according to age and gender, the distribution range of each heating power interval can be recalculated according to the number of the heating power intervals and the heating power values of all the screened heating power intervals, and then the heating power interval to which each heating power interval belongs is determined.

Fig. 6 is a schematic interface diagram of uploading an electronic map according to an embodiment of the present disclosure, and as shown in fig. 6, after triggering operations are performed on service management, map management, and a new map in sequence and basic information of the map is input, a part of the uploaded map is displayed, through which a user can upload the electronic map, where the uploaded electronic map may include at least one of a building plan and a display map. The presentation map may be a User Interface (UI) presentation map. After the process of uploading the map is completed, the hot area (corresponding to the grids in the above embodiment) may be drawn based on the uploaded map.

Fig. 7 is a schematic interface diagram of a map list provided in an embodiment of the present disclosure, and as shown in fig. 7, the interface of the map list is displayed after triggering operations are sequentially performed on a data center and map management. The maps in the map list may include electronic maps of one or at least two floors under one or at least two branches. The electronic map is displayed in the map list, and basic information and operation information of the electronic map can also be displayed. The basic information includes: at least one of a map Identification (ID), a map name, a building type, a floor where the building is located, a branch where the building belongs, and an update time. The operation information includes an editing operation and a deleting operation. The user can trigger the button of the new map displayed in the interface to upload a new electronic map and the basic information of the electronic map.

Fig. 8 is a schematic diagram of a merchant identifier configuration window provided in the embodiment of the present disclosure, as shown in fig. 8, when a user triggers a configuration operation (for example, when setting is triggered) on configuration information of a camera device, the merchant configuration window shown in fig. 8 may be displayed, where the merchant configuration window may indicate information such as a merchant UUID and a cloud background address, for example, information such as a merchant UUID and a cloud background address is displayed in fig. 8, and the merchant configuration window may include the merchant UUID, the background cloud address, a background port number, and the like. The merchant UUID represents the unique account identifier, the merchant UUID, the background cloud address and the background port number of a certain merchant are configured in the window, and a subsequent merchant can acquire at least one of a camera list corresponding to the merchant and a corresponding thermodynamic diagram and the like by inputting the merchant UUID, the background cloud address and the background port number of the merchant.

Fig. 9 is a schematic diagram of a calibration result uploading manner provided by an embodiment of the present disclosure, and as shown in fig. 9, when a last camera in a camera list does not upload a calibration result, a user may select information of the last camera, and trigger a displayed upload calibration result button by the user, so that the calibration result is uploaded. As shown in fig. 9, information of at least two cameras may be displayed. For example, the information of the at least two cameras displayed may correspond to a certain merchant UUID. The information for each camera may include at least one of: the device comprises a device type, a device name, a device code, an Internet Protocol (IP) address, an installation position, a calibration state, an uploading state and a calibration control, wherein the calibration control is used for displaying a calibration interface under the triggering condition so that a user calibrates the camera through the calibration interface.

The device types may be classified according to the shape of the camera, for example, the device types may include: the camera system comprises a bolt camera, a hemispherical camera, an integrated camera, a pinhole camera, a fisheye camera and the like. Alternatively, the device types may be classified by camera imaging component, for example, the device types may include: a Charge Coupled Device (CCD) image sensor camera and a Complementary Metal Oxide Semiconductor (CMOS) image sensor camera. Alternatively, the device types may be classified by resolution, for example, the device types may include: high Definition (HD) 720P cameras, HD 960P cameras, HD 1080P cameras, and the like. In the embodiment shown in fig. 9, the device types may include a hemispherical camera and an integral camera.

In some embodiments, the device name may be a user-defined camera name, e.g., camera 1, camera 2, camera 3, etc. In other embodiments, the device name may be product name or model information of the camera, which may be obtained on the camera or from a specification of the camera. In still other embodiments, the device name may be determined from information such as the geographic location of the camera setting and/or the name of the merchant, for example, the device name may be a northwest camera at an artistic intersection or a clothing store camera. The different device names may be the same or different. In some cases, devices of the same name may be manufactured by the same manufacturing process. The device names shown in fig. 9 may include cameras 1 to 5.

The device code can be used for uniquely identifying the device, the device codes of different devices are different, and the device code can be acquired on the camera or acquired from the specification of the camera. For example, in the embodiment shown in fig. 9, the device code may include 0001 to 0008.

Fig. 10 is a schematic diagram of obtaining a mapping relationship through camera calibration according to an embodiment of the present disclosure, and when a calibration control corresponding to a camera whose device code is 0008 in fig. 9 is triggered, a calibration interface shown in fig. 10 may be displayed, where the calibration interface includes a picture shot by the camera and an electronic map corresponding to the picture. The user can generate the calibration result by triggering the calibration operation of the five positions corresponding to the real world in the electronic map corresponding to the picture and the building plan based on the video input and performing the triggering operation on the generated calibration result displayed in fig. 10. After calibration is completed, the calibration state corresponding to the camera whose device code is 0008 in fig. 9 may be set to be calibrated. Then, the user may select information of the camera with the device code of 0008, and trigger the uploading of the calibration result shown in fig. 9, so that the thermodynamic diagram generation device obtains the calibration result of the camera with the device code of 0008. In the case that a certain point is calibrated incorrectly, the user can trigger the displayed recalibration button to clear the point with the calibration error.

Fig. 11 is a schematic diagram illustrating a thermodynamic diagram provided by an embodiment of the present disclosure, as shown in fig. 11, after a triggering operation for data center, regional heating power, and in an interface shown in fig. 11, distribution of male population density in the regional heating power of a region in 2019, 09, 13, a day and a whole day (00:00: 00:00 to 24:00: 00).

The scheme provides a mode based on visual means, the cameras are calibrated in advance, thermodynamic diagrams are generated comprehensively according to the stay time and the number of people indexes generated by the human face and the human body data, the thermodynamic condition of an actual area can be evaluated objectively, and the mode is more accurate compared with the mode of generating the thermodynamic diagrams by using face data of multiple cameras. According to the embodiment of the disclosure, the heat degree is evaluated from two indexes of time and people number, so that the determined thermodynamic diagram can better conform to the thermodynamic condition in a real scene.

An application scenario of the embodiment of the present disclosure is an offline business scenario, a single camera or multiple cameras may be deployed to analyze the crowd density distribution of a certain area or store, and if the application is performed in front of different exhibition items, the attention degree of the exhibition items may also be analyzed through the stay time and the accumulated number of people.

Based on the foregoing embodiments, the present disclosure provides a thermodynamic diagram generation apparatus, which includes units and modules included in the units, and may be implemented by a processor in a terminal device; of course, it may be implemented by a specific logic circuit.

Fig. 12 is a schematic structural diagram of a thermodynamic diagram generation apparatus according to an embodiment of the present disclosure, and as shown in fig. 12, the thermodynamic diagram generation apparatus 1200 may be a processor or a chip or a thermodynamic diagram generation device, and the thermodynamic diagram generation apparatus 1200 includes: an obtaining unit 1201, configured to obtain human body information of each human body in an image; acquiring a plurality of grids obtained by dividing an electronic map corresponding to an image; a determining unit 1202, configured to obtain, based on the human body information, the number of human body relevant points matched with each grid in the multiple grids; a generating unit 1203 is configured to generate a thermodynamic diagram based on the number of the human body related points matched by each grid.

In some embodiments, the determining unit 1202 is further configured to obtain target attribute information for at least one of a human face and a human body; determining a person having target attribute information from the human body information to obtain a target group including the person having the target attribute information; determining a first number of human body relevant points respectively matched with each grid based on the human body information of the target crowd; the generating unit 1203 is further configured to generate a thermodynamic diagram based on the first number.

In some embodiments, the determining unit 1202 is further configured to obtain at least one of attribute information of each human face and attribute information of each human face in the image; determining a plurality of attribute information for obtaining a target population based on the obtained attribute information; in response to a trigger operation on at least one of the plurality of displayed attribute information, attribute information that matches the trigger operation is determined as target attribute information.

In some embodiments, the determining unit 1202 is further configured to perform one of:

receiving at least one of attribute information of each human body and attribute information of each human face in an image sent by electronic equipment at each moment;

receiving an image sent by the electronic equipment at each moment and position information of at least one of a human body frame and a human face frame in the image on the image; determining at least one of each human body image and each human face image corresponding to the received position information in the image; analyzing at least one of each human body image and each face image to obtain at least one of attribute information of each human body and attribute information of each face;

receiving at least one of each human body image and each human face image in the images sent by the electronic equipment at each moment; analyzing at least one of each human body image and each face image to obtain at least one of attribute information of each human body and attribute information of each face.

In some embodiments, the obtaining unit 1201 is further configured to obtain serial number information of each person in the images captured at the historical time, and time information when each person starts to appear; determining the shooting time information of each human body in each image shot at the historical moment based on the serial number information of each human body, the time information of each human body starting to appear and the configured time interval; in response to an input operation for the displayed selectable period, human body information of each human body corresponding to the target period matching the input operation is determined based on the shooting time information.

In some embodiments, the thermodynamic diagram generation apparatus 1200 further includes: the display unit is used for responding to the trigger operation of the target grid in the displayed thermodynamic diagram and displaying the crowd attribute information corresponding to the target grid; the crowd attribute information corresponding to the target grid comprises: the human body matched with the target grid corresponds to at least one of the following: the human body identification, the human body attribute information, the human body image, the human face image, at least one time interval of all crowd peaks and valleys, at least one time interval of crowd peaks and valleys of different sexes, at least one time interval of crowd peaks and valleys of different age groups, at least one time interval of crowd peaks and valleys of different professions and the human traffic.

In some embodiments, the determining unit 1202 is further configured to determine human body information of each human body in a designated group of people from the human body information, the designated group of people including people with frontal faces; determining a second number of human body relevant points matched with each grid based on the human body information of each human body in the designated crowd; the generating unit 1203 is further configured to generate a thermodynamic diagram based on the second number.

In some embodiments, the body information of each body includes: position information of each human body relevant point on the image; the determining unit 1202 is further configured to determine, based on the position information of each human body related point on the image, the position information of each human body related point on the electronic map; and determining the number of the human body relevant points matched with each grid based on the position information of the human body relevant points on the electronic map.

In some embodiments, the obtaining unit 1201 is further configured to obtain first user identification information input in the displayed user identification input box; a determining unit 1202, further configured to determine a first electronic device identifier corresponding to the first user identifier information; the obtaining unit 1201 is further configured to receive, in the image sent by the electronic device corresponding to the first electronic device identifier at each time, position information of each human body relevant point on the image.

In some embodiments, the obtaining unit 1201 is further configured to receive second user identification information sent by the terminal device; a determining unit 1202, further configured to determine a second electronic device identifier corresponding to the second user identifier information; the obtaining unit 1201 is further configured to receive, in an image sent by the electronic device at each time and corresponding to the second electronic device identifier, position information of each human body related point on the image; the thermodynamic diagram generation apparatus 1200 further includes: and the sending unit is used for sending the thermodynamic diagram to the terminal equipment.

In some embodiments, the obtaining unit 1201 is further configured to obtain a mapping relationship between a picture taken by the electronic device and the electronic map; the shooting parameters of the picture and the image are the same; the determining unit 1202 is further configured to determine the position information of each human body relevant point on the electronic map based on the position information of each human body relevant point on the image and the mapping relationship.

In some embodiments, the obtaining unit 1201 is further configured to determine, in response to a calibration operation on a first location in the picture and a calibration operation on a second location in the electronic map, first location information of the first location in the picture and second location information of the second location in the electronic map; generating a mapping relation between the picture and the electronic map based on the first position information and the second position information; the first position and the second position correspond to the same position in the real world.

In some embodiments, the sending unit is further configured to send the configuration information to the electronic device; the configuration information indicates: the electronic equipment sends the time interval of the position information of each human body relevant point on the image and whether the position information is continuously reported or not; the obtaining unit 1201 is further configured to receive, under the condition that the configuration information indicates continuous reporting, position information, on the image, of each human-related point in the image sent by the electronic device at a time interval; under the condition that the configuration information indicates that the information is not continuously reported, receiving the position information of each human body on the image, which is sent by the electronic equipment at the current moment; receiving position information of each human body on the image, which is sent by the electronic equipment at a designated moment after at least one time interval; and under the condition of not continuously reporting, the similarity between the images acquired before and after at least one time interval is smaller than a set threshold value.

The above description of the apparatus embodiments, similar to the above description of the method embodiments, has similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the apparatus of the present disclosure, reference is made to the description of the embodiments of the method of the present disclosure.

It should be noted that, in the embodiment of the present disclosure, if the thermodynamic diagram generation method described above is implemented in the form of a software functional module and is sold or used as a standalone product, it may also be stored in a computer storage medium. Based on such understanding, the technical solutions of the embodiments of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a terminal device to execute all or part of the methods of the embodiments of the present disclosure.

Fig. 13 is a schematic diagram of hardware entities of a thermodynamic diagram generation device according to an embodiment of the present disclosure, and as shown in fig. 13, the hardware entities of the thermodynamic diagram generation device 1300 include: a processor 1301 and a memory 1302, wherein the memory 1302 stores a computer program operable on the processor 1301, and the processor 1301 executes the program to implement the steps of the method of any of the embodiments described above.

The Memory 1302 stores a computer program that can be executed on the processor, and the Memory 1302 is configured to store instructions and applications executable by the processor 1301, and can also buffer data (e.g., image data, audio data, voice communication data, and video communication data) to be processed or already processed by each module in the processor 1301 and the thermodynamic diagram generation apparatus 1300, and can be implemented by a FLASH Memory (FLASH) or a Random Access Memory (RAM).

The steps of the thermodynamic diagram generation method of any one of the above are implemented when the processor 1301 executes a program. The processor 1301 generally controls the overall operation of the thermodynamic diagram generation apparatus 1300.

The disclosed embodiments provide a computer storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the steps of the thermodynamic diagram generation method of any of the above embodiments.

Here, it should be noted that: the above description of the apparatus, storage medium and device embodiments, similar to the description of the method embodiments above, has similar advantageous effects as the method embodiments. For technical details not disclosed in the embodiments of the apparatus, storage medium and device of the present disclosure, reference is made to the description of the embodiments of the method of the present disclosure.

The thermodynamic diagram generation apparatus, chip or processor described above may include integration of any one or more of: an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an embedded neural Network Processing Unit (NPU), a controller, a microcontroller, and a microprocessor. It is understood that the electronic device implementing the above processor function may be other, and the embodiments of the present disclosure are not particularly limited.

The computer storage medium/Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read Only Memory (EPROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a magnetic Random Access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM), and the like; but may also be various terminals such as mobile phones, computers, tablet devices, personal digital assistants, etc., that include one or any combination of the above-mentioned memories.

It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment of the present disclosure" or "a previous embodiment" or "some implementations" or "some embodiments" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Thus, the appearances of the phrase "in one embodiment" or "in an embodiment" or "the presently disclosed embodiment" or "the foregoing embodiments" or "some implementations" or "some embodiments" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in various embodiments of the present disclosure, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present disclosure. The above-mentioned serial numbers of the embodiments of the present disclosure are merely for description and do not represent the merits of the embodiments.

Without being specifically described, the thermodynamic diagram generation device executes any step in the embodiments of the present disclosure, and the processor of the thermodynamic diagram generation device may execute the step. Unless otherwise specified, the disclosed embodiments do not limit the order in which the thermodynamic diagram generation apparatus performs the steps described below. In addition, the data may be processed in the same way or in different ways in different embodiments. It should be further noted that any step in the embodiments of the present disclosure may be performed independently by the thermodynamic diagram generation device, that is, when the thermodynamic diagram generation device performs any step in the above embodiments, it may not depend on the performance of other steps.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", may explicitly or implicitly include one or more of the described features. In the description of the present disclosure, "a plurality" means two or more unless specifically limited otherwise.

In the several embodiments provided in the present disclosure, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all the functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

The methods disclosed in the several method embodiments provided in this disclosure may be combined arbitrarily without conflict to arrive at new method embodiments.

Features disclosed in several of the product embodiments provided in this disclosure may be combined in any combination to yield new product embodiments without conflict.

The features disclosed in the several method or apparatus embodiments provided in this disclosure may be combined in any combination to arrive at a new method or apparatus embodiment without conflict.

Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media that can store program codes, such as a removable Memory device, a Read Only Memory (ROM), a magnetic disk, or an optical disk.

Alternatively, the integrated units of the present disclosure may be stored in a computer storage medium if they are implemented in the form of software functional modules and sold or used as independent products. Based on such understanding, the technical solutions of the embodiments of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present disclosure. And the aforementioned storage medium includes: a removable storage device, a ROM, a magnetic or optical disk, or other various media that can store program code.

In the embodiments of the present disclosure, the descriptions of the same steps and the same contents in different embodiments may be mutually referred to. In the embodiment of the present disclosure, the term "and" does not affect the order of the steps, for example, the thermodynamic diagram generation device executes a and executes B, where the thermodynamic diagram generation device executes a first and then executes B, or the thermodynamic diagram generation device executes B first and then executes a, or the thermodynamic diagram generation device executes B while executing a.

It is to be noted that the drawings in the embodiments of the present disclosure are only for illustrating schematic positions of the respective devices on the thermodynamic diagram generation apparatus and do not represent actual positions in the thermodynamic diagram generation apparatus, the actual positions of the respective devices or the respective areas may be changed or shifted according to actual conditions (for example, the structure of the thermodynamic diagram generation apparatus), and the scale of different parts in the thermodynamic diagram generation apparatus in the drawings does not represent the actual scale.

As used in the disclosed embodiments and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.

It should be noted that, in the embodiments of the present disclosure, all the steps may be executed or some of the steps may be executed, as long as a complete technical solution can be formed.

The above description is only an embodiment of the present disclosure, but the scope of the present disclosure is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the present disclosure, and all the changes or substitutions should be covered by the scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims

1. A thermodynamic diagram generation method, comprising:

acquiring human body information of each human body in the image;

acquiring a plurality of grids obtained by dividing an electronic map corresponding to the image;

obtaining the number of human body relevant points matched with each grid in the multiple grids based on the human body information;

and generating a thermodynamic diagram based on the number of the human body related points matched by each grid.

2. The method of claim 1, wherein the obtaining the number of human-related points matched by each grid in the plurality of grids based on the human information comprises:

acquiring target attribute information aiming at least one of a human face and a human body;

determining a person having the target attribute information from the human body information to obtain a target crowd including the person having the target attribute information;

determining a first number of human body relevant points respectively matched with each grid based on the human body information of the target crowd;

generating a thermodynamic diagram based on the number of the human body relevant points matched by each grid, wherein the generating comprises the following steps: generating the thermodynamic diagram based on the first quantity.

3. The method of claim 2, wherein the obtaining target attribute information for at least one of a human face and a human body comprises:

acquiring at least one of attribute information of each human body and attribute information of each human face in the image;

determining a plurality of attribute information for obtaining the target population based on the acquired attribute information;

in response to a trigger operation on at least one of the plurality of displayed attribute information, determining attribute information matching the trigger operation as the target attribute information.

4. The method according to claim 3, wherein the acquiring at least one of the attribute information of each human body and the attribute information of each human face in the image comprises one of:

5. The method according to any one of claims 1 to 4, wherein the acquiring human body information of each human body in the image comprises:

acquiring serial number information of each human body in an image shot at a historical moment and time information of each human body appearing at the beginning;

determining the shooting time information of each human body in each image shot at the historical moment based on the serial number information of each human body, the time information of each human body starting to appear and the configured time interval;

in response to an input operation for the displayed selectable period, human body information of each human body corresponding to a target period matching the input operation is determined based on the shooting time information.

6. The method of any of claims 1 to 5, wherein the method further comprises:

responding to a trigger operation of a target grid in the displayed thermodynamic diagram, and displaying the crowd attribute information corresponding to the target grid;

the crowd attribute information corresponding to the target grid comprises: the human body matched with the target grid corresponds to at least one of the following:

7. The method according to any one of claims 1 to 6, wherein the obtaining the number of the human-related points matched by each grid in the plurality of grids based on the human body information comprises:

determining human body information of each human body in a designated crowd from the human body information, wherein the designated crowd comprises people with front faces;

determining a second number of human body relevant points matched with each grid based on the human body information of each human body in the designated crowd;

generating a thermodynamic diagram based on the number of the human body relevant points matched by each grid, wherein the generating comprises the following steps:

generating the thermodynamic diagram based on the second quantity.

8. The method according to any one of claims 1 to 7, wherein the human body information of each human body includes: position information of the human body relevant points on the image;

the obtaining of the number of the human body relevant points matched with each grid in the multiple grids based on the human body information includes:

determining the position information of the human body related points on the electronic map based on the position information of the human body related points on the image;

and determining the number of the human body related points matched with each grid based on the position information of the human body related points on the electronic map.

9. The method of claim 8, wherein the method further comprises:

acquiring first user identification information input in a displayed user identification input box;

determining a first electronic equipment identifier corresponding to the first user identifier information;

the acquiring human body information of each human body in the image comprises the following steps:

and receiving the position information of the human body relevant points on the image, which is sent by the electronic equipment corresponding to the first electronic equipment identifier at each moment.

10. The method of claim 8 or 9, wherein the method further comprises:

receiving second user identification information sent by the terminal equipment;

determining a second electronic equipment identifier corresponding to the second user identification information;

receiving position information of each human body relevant point on the image, which is sent by the electronic equipment corresponding to the second electronic equipment identifier at each moment;

the method further comprises the following steps:

and sending the thermodynamic diagram to the terminal equipment.

11. The method according to claim 9 or 10, wherein the method further comprises:

acquiring a mapping relation between a picture shot by the electronic equipment and the electronic map; the shooting parameters of the picture and the image are the same;

the determining the position information of the human body related points on the electronic map based on the position information of the human body related points on the image comprises the following steps:

and determining the position information of the human body relevant points on the electronic map based on the position information of the human body relevant points on the image and the mapping relation.

12. The method of claim 11, wherein the obtaining of the mapping relationship between the picture taken by the electronic device and the electronic map comprises:

in response to the calibration operation of a first position in the picture and the calibration operation of a second position in the electronic map, determining first position information of the first position in the picture and second position information of the second position in the electronic map;

generating the mapping relation between the picture and the electronic map based on the first position information and the second position information; the first position and the second position are the same position in the corresponding real world.

13. The method of any of claims 9 to 12, wherein the method further comprises:

sending configuration information to the electronic device; the configuration information indicates: the electronic equipment sends the time interval of the position information of each human body relevant point on the image and whether the position information is continuously reported or not;

under the condition that the configuration information indicates continuous reporting, receiving position information of each human body relevant point on the image, which is sent by the electronic equipment at the time interval, in the image;

under the condition that the configuration information indicates that the position information of each human body on the image is not continuously reported, the position information of each human body sent by the electronic equipment at the current moment is received; receiving the position information of each human body on the image, which is sent by the electronic equipment at a specified moment after at least one time interval;

and under the condition of not continuously reporting, the similarity between the images acquired before and after at least one time interval is smaller than a set threshold value.

14. A thermodynamic diagram generation apparatus comprising:

the acquisition unit is used for acquiring human body information of each human body in the image; acquiring a plurality of grids obtained by dividing an electronic map corresponding to the image;

the determining unit is used for obtaining the number of the human body related points matched with each grid in the grids based on the human body information;

and the generating unit is used for generating a thermodynamic diagram based on the number of the human body related points matched with each grid.

15. A thermodynamic diagram generation device comprising: a memory and a processor, wherein the processor is capable of,

the memory stores a computer program operable on the processor,

the processor, when executing the computer program, implements the steps of the method of any one of claims 1 to 13.

16. A computer storage medium storing one or more programs, the one or more programs being executable by one or more processors to perform the steps of the method of any one of claims 1 to 13.