CN112036345A - Method for detecting number of people in target place, recommendation method, detection system and medium - Google Patents

Abstract

The application provides a detection method, a recommendation method, a detection system and a medium for the number of people in a target place. The method for detecting the number of people in the target place comprises the following steps: acquiring an environment image of a target place; determining a target detection area in the environment image; determining a facial human head target frame and a non-facial human head target frame in the target detection area; and determining the number of people entering and exiting the target place in any time period according to the facial head target frame and the non-facial head target frame of each target detection area in the time period. The method and the device realize accurate identification of the head target frame in the target detection area, and can accurately determine the number of people passing in and out of the target place in any time period.

Description

Detection method, recommended method, detection system and medium of the number of people in the target place

technical field

The application relates to the technical field of intelligent systems, and in particular, the application relates to a detection method, a recommendation method, a detection system and a medium for the number of people in a target place.

Background technique

Currently, in many scenarios, it is necessary to count the number of people in a certain place or area. For example, when a user chooses a place to use, he usually needs to know the number of people in line, the number of people entering and leaving, and the usage of resources in a certain place, so as to make better decisions. Select and save time. However, there is currently no more accurate method for counting the number of people in a certain place or area, which causes great inconvenience to users when it is necessary to select idle resources of a place, and also causes a waste of some resources.

SUMMARY OF THE INVENTION

Aiming at the shortcomings of the existing methods, the present application proposes a detection method, a recommended method, a detection system and a medium for the number of people in a target place, so as to solve the problem that the existing technology cannot accurately count the number of people in a certain place or area and the resources cannot be reasonable. exploited technical issues.

In the first aspect, an embodiment of the present application provides a method for detecting the number of people in a target place, including:

Obtain an environmental image of the target site;

Determine the target detection area in the environmental image;

Determine the facial head target frame and the non-face head target frame in the target detection area;

According to the face head target frame and the non-face head target frame of each target detection area in any time period, the number of people entering and leaving the target place in this time period is determined.

Optionally, according to the facial head target frame and the non-face head target frame of each target detection area in any time period, determine the number of people entering and leaving the target place in the time period, including:

For each head target frame in the face head target frame and the non-face head target frame, determine whether the head target frame meets the following conditions at the same time in any time period: the head target frame overlaps with the reference marks in the environment image; each frame The intersection ratio of the head target frame of the frame and the head target frame of the previous frame is greater than the intersection ratio threshold; the head target frame of each frame is in the specified direction of the head target frame of the previous frame;

If the head target frame satisfies the above conditions at the same time within the time period, then determine that the movement direction of the head target frame is entering or leaving the target place;

According to the number of head target boxes entering or leaving the target place within the time period, the number of people entering and leaving the target place within the time period is determined.

Optionally, the method for detecting the number of people in the target place provided by the embodiment of the present application further includes:

According to the number of face head target boxes or the number of people entering and leaving the target place in the first time period, the current number of people in line at the target place is determined.

Optionally, determine the facial head target frame and the non-face head target frame in the target detection area, including:

Crop out the sub-environment image containing the target detection area in the environment image;

Determine each head target frame in the sub-environment image according to the head detection algorithm;

From each head target frame of the sub-environment image, determine the head target frame located within the target detection area;

According to the face recognition algorithm, the face head target frame and the non-face head target frame are identified in each head target frame in the target detection area.

Optionally, the facial human head target frame and the non-face human head target frame are identified in each human head target frame in the target detection area according to the face recognition algorithm, including:

For each head target frame in the target detection area, identify whether the current head target frame and the first number of head target frames adjacent to the current head target frame are all face head target frames according to the face recognition algorithm;

If the current head target frame and the first number of head target frames adjacent to the current head target frame are both face head target frames, then it is determined that the current head target frame is the face head target frame;

If the current head target frame is a face head target frame, and the first number of head target frames adjacent to the current head target frame are all non-face head target frames, then determine that the current head target frame is a non-face head target frame;

If the current head target frame and the first number of head target frames adjacent to the current head target frame are both non-face head target frames, then it is determined that the current head target frame is a non-face head target frame;

If the current head target frame is a non-face head target frame, and the first number of head target frames adjacent to the current head target frame are all face head target frames, then the current head target frame is determined to be a face head target frame.

In a second aspect, an embodiment of the present application provides a resource recommendation method, including:

For multiple target places, obtain the current number of people in line, the number of people entering and leaving in the second time period, the location information of the site, and the request information of the user terminal for each target place; the current number of people in line is the detection provided by the first aspect of the embodiment of this application An optional solution of the method determines the current number of people in queue; the number of people entering and leaving is the number of people entering and leaving determined by the detection method provided by the first aspect of the embodiment of the present application; the request information includes user terminal location information;

Determine the recommended score for each target venue according to the current number of people in line at each venue, the number of people entering and leaving in the second time period, venue location information and user location information;

According to the recommendation score, at least one target place to be recommended is determined and sent to the user terminal.

Optionally, according to the current number of people queuing in each place, the number of people entering and leaving in the second time period, the location information of the venue, and the user location information, determine the recommended score for each target venue, including:

Determine the resource usage rate of each target site according to the number of people entering and leaving each target site in the second time period;

According to the location information of the user terminal and the location information of each target location, determine the distance between the user terminal and each target location;

According to the current queuing number of each target place, the speed of resource usage, and the distance between the user and each target place, the recommendation score of each target place is determined.

Optionally, the resource recommendation method provided in the embodiment of the present application further includes:

For each target location to be recommended, at least one route from the current location of the user terminal to the current location of the target location is determined according to location location information and user terminal location information, and the route information of at least one route is sent to the user terminal.

In a third aspect, an embodiment of the present application provides a detection system, including: an image acquisition device and a server;

The image acquisition device is arranged at the target place, and the image acquisition device is connected to the server in communication;

The image acquisition device is used for: collecting the environmental image of the target place, and sending the environmental image to the server;

The server is configured to execute to implement the detection method provided by the first aspect of the embodiments of the present application.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, implements the detection method provided in the first aspect of the embodiment of the present application, or the second embodiment of the present application. Aspects of the resources provided by the recommended method.

The technical solutions provided in the embodiments of the present application have at least the following beneficial effects:

1) The embodiment of the present application can determine the target detection area and the facial head target frame and the non-face head target frame based on the environmental image of the target place, so as to realize the accurate identification of the head target frame in the target detection area; The number of face head target frames and non-face head target frames can accurately determine the number of people entering and leaving the target place in any time period, providing more accurate reference data for users to select the target place, so that users can quickly make more suitable for themselves. Selection, reduce the waste of user selection time and resources;

2) The embodiment of the present application can accurately determine the current number of people queuing in the target place based on the number of accurately identified face and head target frames; in the case where the face and head target frame is not identified, it can be based on the previous first time period. The number of people entering and leaving the target place can more accurately estimate the current number of people queuing in the target place, and provide more accurate reference data for users to select the target place, which is convenient for users to quickly make more suitable choices for themselves, and reduce the time and resources for users to choose. waste;

3) In this embodiment of the present application, the recommended score of each place can be determined based on the number of people in the target place (the current number of people in queue and the number of people entering and leaving in the second time period), the location information of the place, and the location information of the user terminal. , recommending a suitable target place to the user terminal as a reference, so that the user can select a suitable target place more quickly according to his own situation, which provides great convenience for the user and saves the user's time.

Additional aspects and advantages of the present application will be set forth in part in the following description, which will become apparent from the following description, or may be learned by practice of the present application.

Description of drawings

The above and/or additional aspects and advantages of the present application will become apparent and readily understood from the following description of embodiments taken in conjunction with the accompanying drawings, wherein:

1 is a schematic flowchart of a method for detecting the number of people in a target place provided by an embodiment of the present application;

2 is a schematic diagram of an environment image area, a sub-environment image area, and a target detection area in an embodiment of the present application;

3 is a schematic flowchart of another method for detecting the number of people in a target place provided by an embodiment of the present application;

FIG. 4 is a schematic flowchart of a resource recommendation method provided by an embodiment of the present application;

FIG. 5 is a schematic flowchart of another resource recommendation method provided by an embodiment of the present application;

6 is a schematic structural framework diagram of a detection system provided by an embodiment of the present application;

7 is a schematic structural framework diagram of another detection system provided by an embodiment of the present application;

FIG. 8 is a schematic structural framework diagram of a server according to an embodiment of the present application.

Detailed ways

The application is described in detail below, and examples of embodiments of the application are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar components or components having the same or similar functions throughout. Also, detailed descriptions of known technologies are omitted if they are not necessary for illustrating features of the present application. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, but not to be construed as a limitation on the present application.

It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It should also be understood that terms, such as those defined in a general dictionary, should be understood to have meanings consistent with their meanings in the context of the prior art and, unless specifically defined as herein, should not be interpreted in idealistic or overly formal meaning to explain.

It will be understood by those skilled in the art that the singular forms "a", "an", "the" and "the" as used herein can include the plural forms as well, unless expressly stated otherwise. It should be further understood that the word "comprising" used in the specification of this application refers to the presence of stated features, integers, steps, operations, elements and/or components, but does not preclude the presence or addition of one or more other features, Integers, steps, operations, elements, components and/or groups thereof. It will be understood that when we refer to an element as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Furthermore, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combination of one or more of the associated listed items.

The technical solutions of the present application and how the technical solutions of the present application solve the above-mentioned technical problems will be described in detail below with specific examples.

The embodiment of the present application provides a method for detecting the number of people in a target place, as shown in FIG. 1 , the detection method includes:

S101, acquiring an environmental image of a target place.

Optionally, an environmental image of the target site collected by a camera device set up inside or outside the target site can be obtained; the environmental image can be an internal or external environment image of the target site, depending on the actual situation of the target site and the camera’s Depends on the discharge location.

The embodiment of the present application does not limit the target place, which can be any place or area that needs to count the number of people, such as public places such as public toilets, restaurants, airports, and railway stations.

S102, a target detection area in the environment image is determined.

The target detection area can be determined according to the actual situation of the target site. For example, if the target detection area is a public toilet, the door area of the public toilet in the environmental image can be used as the target detection area; if the target detection area is a restaurant, the entrance waiting area in the environmental image can be used (restaurants usually have waiting areas) as the target detection area.

For target locations involving queuing and queuing number determination, the target detection area may include the tail of the queue within the normal field of view.

S103, determining a face head target frame and a non-face head target frame in the target detection area.

Optionally, crop out a sub-environment image including the target detection area in the environmental image; determine each human head target frame in the sub-environment image according to the human head detection algorithm; The human head target frame within the detection area is detected; the facial head target frame and the non-face head target frame are identified in each head target frame in the target detection area according to the face recognition algorithm.

In an example, FIG. 2 shows an environment image 201, and the target detection area in the environment image may be the area within the trapezoidal frame 202 in FIG. The center of the detection area) is the center, and a rectangular frame 203 is determined as a sub-environment image containing the target detection area.

In the example shown in FIG. 2 , the sub-environment image including the trapezoidal frame 202 is cropped according to the range of the rectangular frame 203, which can facilitate the input of the human head detection algorithm in the form of an image to realize the human head detection in the target detection area. The sub-environment image size (eg 512 pixels) is smaller than the original environment image, which reduces unnecessary interference during processing and speeds up detection.

Optionally, from each head target frame of the sub-environment image, determine the head target frame located within the target detection area, including:

For each head target frame, determine the extreme value range of the center coordinates of the head target frame according to the coordinates of the vertex and boundary of the target detection area; determine whether the center coordinates of the head target frame are within the extreme value range; if the center of the head target frame If the coordinates are within the coordinate extreme value range, it is determined whether the center coordinates of the head target frame are within the boundary coordinates of the head target frame; if the center coordinates of the head target frame are within the boundary coordinate range, it is determined that the head target frame is located in the target detection area.

Each coordinate in this embodiment of the present application may be a coordinate in a plane coordinate system established in the environment image, and may be represented by (x, y).

In an example, the coordinates of the boundary of the target detection area can be represented by a straight line formula between two adjacent vertices, according to the straight line between the four vertices of the target detection area and the two adjacent vertices as shown in FIG. The formula, for the center coordinates (x1, y1) of the human head target frame, the maximum and minimum values of 1x and y1 can be determined respectively, as the coordinate extreme value range, to determine whether the center coordinate (x1, y1) is in the coordinate extreme value range. If the center coordinates (x1, y1) are within the extreme value range of the coordinates, further determine whether the center coordinates (x1, y1) are within the range surrounded by the four boundary lines of the human head target frame, if the center coordinates (x1, y1) Within the range enclosed by the four boundary lines of the head target frame, the head target frame to which the center coordinate (x1, y1) belongs is used as the head target frame in the target detection area to keep count, if the center coordinate (x1, y1) is not Within the range enclosed by the four boundary lines of the head target frame, the head target frame to which the center coordinate (x1, y1) belongs is excluded, and the head target frame is not considered when counting.

Optionally, the facial human head target frame and the non-face human head target frame are identified in each human head target frame in the target detection area according to the face recognition algorithm, including:

For each head target frame in the target detection area, identify whether the current head target frame and the first number of head target frames adjacent to the current head target frame are all face head target frames according to the face recognition algorithm;

If the current head target frame and the first number of head target frames adjacent to the current head target frame are both face head target frames, the current head target frame is determined to be the face head target frame; if the current head target frame is the face head target frame , and the first number of head target frames adjacent to the current head target frame are all non-face head target frames, then it is determined that the current head target frame is a non-face head target frame; If the first number of adjacent head target frames are all non-face head target frames, then the current head target frame is determined to be a non-face head target frame; if the current head target frame is a non-face head target frame and is adjacent to the current head target frame The first number of head target frames are all face head target frames, then it is determined that the current head target frame is the face head target frame.

Optionally, when identifying whether each head target frame (such as the current head target frame or the adjacent head target frame) is a face head target frame according to the face recognition algorithm, the head target frame can be determined according to the face recognition algorithm. Whether the facial feature data is greater than the face threshold, if so, preliminarily determine that the head target frame is a face head target frame, and then according to the preliminary determination result of the adjacent head target frame, make a final determination whether the head target frame is a face head target frame .

The first quantity in this embodiment of the present application may be set according to actual needs, and the selection range of the first quantity of head target boxes may be determined according to actual conditions. For example, if the current head target frame is located in the area between the two dotted lines as shown in FIG. 2 , the adjacent first data head target frame can also be selected in the area between the two dotted lines. For target places with obvious queuing areas, in this way, adjacent head target frames with more consistent face orientations can be selected. mobile phone), it can more accurately determine whether the current head target frame is the face head target frame, reducing or even avoiding erroneous judgments.

Optionally, the human head detection algorithm in this embodiment of the present application may be the CenterNet algorithm, and the face recognition algorithm may be the SeetaFace algorithm.

S104: Determine the number of people entering and leaving the target place in the time period according to the facial head target frame and the non-face head target frame in each target detection area in an arbitrary time period.

The arbitrary period of time may be the first period of time or the second period of time hereinafter.

Optionally, for each head target frame in the face head target frame and the non-face head target frame, determine whether the head target frame meets the following conditions at the same time in any time period: the head target frame and the reference mark in the environment image have overlapping parts. ; The intersection ratio IoU of the human head target frame of each frame and the human head target frame of the previous frame is greater than the intersection and union ratio threshold; the human head target frame of each frame is in the specified direction of the human head target frame of the previous frame.

If the head target frame meets the conditions at the same time within the time period, the moving direction of the head target frame is determined to be entering or leaving the target place; according to the number of head target frames entering or leaving the target place within the time period, determine the movement direction of the head target frame within the time period. The number of people entering and leaving the target site.

The reference marks in the embodiments of the present application may be set in the environment image according to actual requirements. In an example, the reference marks may be the straight line A and the straight line B shown in FIG. 2 .

The intersection and union ratio threshold in the embodiment of the present application can be set according to actual needs, for example, 0.5. If the IoU is greater than 0.5, it can be considered that the currently judged head target frame of this frame and the head target frame of the previous frame are the same person's head target frame; If the IoU is less than or greater than 0.5, it can be considered that the currently judged head target frame of the frame and the head target frame of the previous frame are not the head target frame of the same person, and the currently judged frame head target frame can be used as a new head target frame. , and re-determine the above conditions.

The previous frame in this embodiment of the present application may be any frame within a frame number range before the current frame, and the frame number range may be set according to the reference mark. In the example shown in FIG. Set the distance between lines. If the distance between line A and line B is small, you can set the frame number range to a smaller range. If the distance between line A and line B is large, you can set the frame number range to a smaller range. The frame number range is set to a larger range.

The designated direction in the embodiment of the present application can be determined according to the actual situation. Taking FIG. 2 as an example, when determining whether the moving direction of the human head target frame is to enter the target place, the designated direction is the direction from straight line A to straight line B. If the current frame Compared with the previous frame, if the center of the human head target frame moves from straight line A to straight line B, it is considered that the moving direction of the human head target frame is the direction of entering the target place; when determining whether the moving direction of the human head target frame is to leave the target place, specify The direction is the direction from the straight line B to the straight line A. If the center of the human head target frame moves from the straight line B to the straight line A in the current frame compared with the previous frame, the moving direction of the human head target frame is considered to be the direction away from the target location.

In an optional embodiment, when it is determined that the moving direction of the human head target frame is entering or leaving the target place, the moving direction of the human head target frame can be further determined by a target tracking algorithm on the basis of the above method, so that the number of people entering and the The number of people leaving is more accurate.

In another optional implementation manner, a target tracking algorithm can be used instead of the above method to determine the moving direction of the human head target frame.

Optionally, in the process of determining the moving direction of the head target frame by the target tracking algorithm, specifically, input each head target frame in the target detection area into the target tracking algorithm, and different head target frames will have different ID (Identity). Document, identification number), the same head target frame will have the same ID tracking continuously, and the movement direction of the head target frame can be judged according to the moving direction of the center of the target frame before and after the frame marked by the same ID.

The target tracking algorithm in this embodiment of the present application may be a Kalman algorithm or a KCF (Kernel Correlation Filter, kernel correlation filter algorithm) algorithm. The target tracking algorithm has a high accuracy rate, and can be accurate even in scenes with many people and complex walking. rate without counting errors.

Optionally, as shown in FIG. 3 , the detection method provided by the embodiment of the present application, on the basis of the above steps S101 to S104, further includes the following steps:

S105, according to the number of face head target frames or the number of people entering and leaving the target place in the first time period, determine the current number of people in line at the target place.

In an optional embodiment, when the number of face and head target frames in the target detection area is greater than 0, the current number of people in line at the target place is determined according to the number of the face and head target frames, and the specific methods are as follows:

h=hf+hw Expression (1)

In expression (1), h represents the current number of people in line at the target location, hf represents the number of face head target boxes in the target detection area, and hw represents the accommodating number of people in the area between the starting position of the target location and the target detection area. The area corresponding to hw is the area that cannot be collected by the image acquisition device but there may still be people in line.

Optionally, when h determined according to expression (1) is greater than a preset number of people threshold, the number of people threshold is taken as the value of h. The number of people threshold can be set as the maximum number of people that can be accommodated in the photographable area of the image acquisition device, which can be set according to empirical values.

In another optional embodiment, when the number of face and head target frames in the target detection area is less than or equal to 0, the current number of people in line at the target place is determined according to the number of people entering and leaving the target place in the first time period.

The time range of the first time period can be set according to actual needs. In an example, the first time period can be set to be within 20 minutes before the current time, and the difference between the number of people entering and the number of people leaving the target place within 20 minutes before the current time is calculated. , as the current queuing number of the target place.

When the face and head target frame in the target detection area is not currently detected (for example, when the current queue is short and has not been queued to the shooting area or is not currently queued), only the detection results of the target detection area cannot be used to measure the target location. For the queuing situation, based on the number of people entering and leaving in the first time period before the current moment, the current number of people queuing at the target place can be estimated more accurately.

Based on the same inventive concept, an embodiment of the present application provides a resource recommendation method, as shown in FIG. 4 , the resource recommendation method includes:

S401 , for a plurality of target places, obtain the current number of people in line, the number of people entering and leaving in the second time period, the location information of the places, and the request information of the user terminal for each target place.

The current queuing number is the current queuing number determined by the aforementioned detection method of the embodiment of the present application; the number of inbound and outgoing persons is the number of inbound and outbound persons determined by the aforementioned detection method of the embodiment of the present application; the request information of the user terminal includes the location information of the user terminal.

The second time period can be set according to actual needs, for example, it can be set within 10 minutes before the current time

S402: Determine the recommendation score of each target place according to the current number of people in line, the number of people entering and leaving in the second time period, the location information of the place, and the user's location information.

Optionally, according to the number of people entering and leaving each target place in the second time period, determine the resource usage speed of each target place; The distance of the target place; according to the current number of people queuing at each target place, the speed of resource usage, and the distance between the user and each target place, the recommended score of each target place is determined.

In an optional implementation manner, the resource usage speed of each target place can be represented by the number of people leaving per unit time (for example, per minute). Specifically, the resource usage speed of the target place can be determined as follows:

In expression (2), v represents the resource usage speed of the target site, t represents the duration of the second time period (which can be assigned according to actual needs), and h[-t:] represents the target site in the second time period before the current of the number of departures.

In an optional embodiment, the recommendation score of each target location can be determined in the following manner:

In expression (3), score represents the recommendation score of the target site, v represents the resource usage speed of the target site, h represents the current number of people in line at the target site, s represents the distance between the user terminal and the target site, and k is a constant (can be set according to actual needs).

Expression (3) can combine the three factors of the resource use speed v of the target place, the current number of people in the queue h, and the distance s between the user terminal and the target place to determine the recommendation score, so that the recommendation scheme determined according to the recommendation score is more efficient. Meet actual user needs.

S403, according to the recommendation score, determine at least one target place to be recommended and send it to the user terminal.

Optionally, in descending order of recommendation scores, at least one target place is selected and arranged as a target place to be recommended and sent to the user terminal. In an example, in descending order of recommendation scores, the first three target places are selected as the target places to be recommended and sent to the user terminal, so as to achieve the purpose of recommending the target places to the user.

Optionally, as shown in FIG. 5 , the resource recommendation method provided by the embodiment of the present application, on the basis of the above steps S401 to S403, further includes the following steps:

S404, for each target site to be recommended, according to site location information and user terminal location information, determine at least one route from the current location of the user terminal to the current location of the target site, and send the route information of the at least one route to the user terminal.

The user can query the received route information through the query function of the user terminal, and select a suitable route to the target place according to the route information.

In an optional implementation manner, the route information of the at least one route sent to the user terminal includes: scenic spot information on the at least one route. The scenic spot information can help the user to choose a route. If the user is interested in a scenic spot on a certain route, he can choose a route passing through the scenic spot.

Based on the same inventive concept, an embodiment of the present application provides a detection system. As shown in FIG. 6 , the detection system includes: an image acquisition device 610 and a server 620 ; the image acquisition device 610 is set at the target place, and the image acquisition device 610 and the server 620 communication connection.

The image collection device 610 is used for: collecting an environment image of the target place, and sending the environment image to the server 620; the server 620 is used for executing the method for detecting the number of people in the target place provided by the embodiment of the present application.

Optionally, the image capture device 610 can be arranged near the entrance of the target place, the lens can be directed to the outside of the target place to capture the environmental image outside the target place, and can also be directed to the inside of the target place to capture the environmental image inside the target place, or Depending on the specific location of the waiting area of the target place, it is sufficient to photograph the queuing crowd at the target place; one or more image capturing devices 610 may be arranged near the entrance of each target place.

In the example shown in FIG. 2 , the lens of the image capture device 610 faces the outside of the target place. In order to capture the end of the queue, the image capture device 610 is installed near the front line of the box 201 (ie, near the entrance).

In an optional implementation manner, as shown in FIG. 7 , the detection system provided in this embodiment of the present application further includes: a user terminal 630 ; the user terminal 630 is connected in communication with the server 620 .

The user terminal 630 is configured to: send request information to the server 620 in response to the query operation for the target place, and receive at least one target place to be recommended sent by the server 620 .

When the user terminal 630 receives the query operation for the target place, it allows its own location information to be acquired by the server 620 by default, and when sending the request information to the server 620, it carries its own location information in the request information and sends it to the server 620 .

Optionally, the user terminal 630 is further configured to: receive the route information of at least one route from the current position of the user terminal 630 to the current position of the target place sent by the server 620 .

Optionally, the user terminal 630 is further configured to: display the received target location and route information.

The user can query the desired target place and route information in real time through the user terminal 630, and select an appropriate target place and route according to his own situation.

There may be one or more user terminals in this embodiment of the present application.

The server 620 in this embodiment of the present application may include: a memory and a processor, and the memory and the processor are electrically connected.

A computer program is stored in the memory, and the computer program is executed by the processor to implement any method for detecting the number of people in a target place or any method for recommending resources provided by the embodiments of the present application.

Those skilled in the art can understand that the server provided by the embodiments of the present application may be specially designed and manufactured for the required purpose, or may also include known devices in a general-purpose computer. These devices have computer programs stored in them that are selectively activated or reconfigured. Such a computer program may be stored in a device (eg, computer) readable medium or in any type of medium suitable for storing electronic instructions and separately coupled to a bus.

In an optional embodiment of the present application, a server is provided. As shown in FIG. 8 , the server 620 includes: a memory 621 and a processor 622 , and the memory 621 and the processor 622 are electrically connected, such as through a bus 623 .

Optionally, the memory 621 is used to store the application code for executing the solution of the present application, and the execution is controlled by the processor 622 . The processor 622 is configured to execute the application program code stored in the memory 621 to implement any method for detecting the number of people in a target place or any method for recommending resources provided by the embodiments of the present application.

The memory 621 can be a ROM (Read-Only Memory, read-only memory) or other types of static storage devices that can store static information and instructions, and can be a RAM (Random Access Memory, random access memory) or can store information and instructions. Other types of dynamic storage devices can also be EEPROM (Electrically Erasable Programmable Read Only Memory, Electrically Erasable Programmable Read Only Memory), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other CD-ROM storage, CD-ROM storage ( including compact discs, laser discs, compact discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or capable of carrying or storing desired program code in the form of instructions or data structures and capable of being stored by a computer any other medium taken, but not limited to this.

The processor 622 may be a CPU (Central Processing Unit, central processing unit), a general-purpose processor, a DSP (Digital Signal Processor, data signal processor), an ASIC (Application Specific Integrated Circuit, an application-specific integrated circuit), an FPGA (Field-Programmable Gate Array) , field programmable gate array) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logical blocks, modules and circuits described in connection with this disclosure. The processor 622 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

The bus 623 may include a path to transfer information between the aforementioned components. The bus may be a PCI (Peripheral Component Interconnect, Peripheral Component Interconnect Standard) bus or an EISA (Extended Industry Standard Architecture, Extended Industry Standard Architecture) bus. The bus can be divided into address bus, data bus, control bus and so on. For ease of presentation, only one thick line is used in FIG. 8, but it does not mean that there is only one bus or one type of bus.

Optionally, server 620 may also include transceiver 624 . The transceiver 624 may be used for the reception and transmission of signals. The transceiver 624 may allow the server 620 to communicate wirelessly or by wire with other devices to exchange data. It should be noted that, in practical applications, the transceiver 624 is not limited to one.

Optionally, the server 620 may further include an input unit 625 . The input unit 625 may be used to receive input numbers, characters, images and/or sound information, or generate key signal input related to user settings and function control of the server 620 . The input unit 625 may include, but is not limited to, one or more of a touch screen, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, joysticks, cameras, pickups, and the like.

Optionally, the server 620 may further include an output unit 626 . The output unit 626 may be used to output or display the information processed by the processor 622 . The output unit 626 may include, but is not limited to, one or more of a display device, a speaker, a vibration device, and the like.

While FIG. 8 shows the server 620 having various devices, it should be understood that not all of the illustrated devices are required to be implemented or available. More or fewer devices may alternatively be implemented or provided.

Based on the same inventive concept, the embodiments of the present application provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, any object provided by the embodiments of the present application is realized The method of detecting the number of people in the venue or the method recommended by any resource.

The computer-readable medium includes, but is not limited to, any type of disk (including floppy disk, hard disk, optical disk, CD-ROM, and magneto-optical disk), ROM, RAM, EPROM (Erasable Programmable Read-Only Memory, Erasable Programmable Read-Only Memory) memory), EEPROM, flash memory, magnetic or optical cards. That is, a readable medium includes any medium that stores or transmits information in a form that can be read by a device (eg, a computer).

An embodiment of the present application provides a computer-readable storage medium suitable for any of the above-mentioned methods for detecting the number of people in a target place or any method for recommending resources, and details are not described herein again.

By applying the embodiments of the present application, at least the following beneficial effects can be achieved:

1) The embodiment of the present application can determine the target detection area and the facial head target frame and the non-face head target frame based on the environmental image of the target place, so as to realize the accurate identification of the head target frame in the target detection area; The number of face head target frames and non-face head target frames can accurately determine the number of people entering and leaving the target place in any time period, providing more accurate reference data for users to select the target place, so that users can quickly make more suitable for themselves. Select, reduce the waste of user selection time and resources.

2) When the embodiment of the present application determines the number of people entering and leaving the target place in any time period based on the number of the face head target frame and the non-face head target frame, it can be based on whether the head target frame and the reference mark coincide or not, and the two frames before and after the head target frame. The intersection ratio and the relative direction of the head target frame in the two frames before and after can accurately identify the moving direction of each head target frame, and then determine the number of people entering and leaving the target place.

3) The embodiment of the present application can accurately determine the number of people currently queuing at the target place based on the number of accurately identified face and head target frames; in the case where the face and head target frame is not identified, it can be based on the previous first time period. The number of people entering and leaving the target place can more accurately estimate the current number of people queuing in the target place, and provide more accurate reference data for users to select the target place, which is convenient for users to quickly make more suitable choices for themselves, and reduce the time and resources for users to choose. waste.

4) When determining whether each head target frame is a facial head target frame or a non-human head target frame in the embodiment of the present application, the type of the first number of head target frames adjacent to the current head target frame can be referred to, so that the current head target frame is The type of the target frame is determined to be consistent with the type of the adjacent human head target frame, so as to avoid possible erroneous recognition when a certain head target frame is identified alone, so that the recognition result is more accurate.

5) This embodiment of the present application can determine the recommended score of each place based on the number of people in the target place (the current number of people in queue and the number of people entering and leaving in the second time period), the location information of the place, and the location information of the user terminal. , recommending a suitable target place to the user terminal as a reference, so that the user can select a suitable target place more quickly according to his own situation, which provides great convenience for the user and saves the user's time.

Those skilled in the art can understand that various operations, methods, steps, measures, and solutions in the process discussed in this application may be alternated, modified, combined or deleted. Further, other steps, measures, and solutions in the various operations, methods, and processes that have been discussed in this application may also be alternated, modified, rearranged, decomposed, combined, or deleted. Further, steps, measures and solutions in the prior art with various operations, methods, and processes disclosed in this application may also be alternated, modified, rearranged, decomposed, combined or deleted.

In the description of the present application, it should be understood that the terms "first" and "second" are only used for description purposes, and cannot be interpreted as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. In the description of this application, unless stated otherwise, "plurality" means two or more.

It should be understood that although the various steps in the flowchart of the accompanying drawings are sequentially shown in the order indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order and may be performed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution sequence is also It does not have to be performed sequentially, but may be performed alternately or alternately with other steps or at least a portion of sub-steps or stages of other steps.

The above are only part of the embodiments of the present application. It should be pointed out that for those skilled in the art, without departing from the principles of the present application, several improvements and modifications can also be made. It should be regarded as the protection scope of this application.

Claims (10)

1. A method for detecting the number of people in a target place is characterized by comprising the following steps:

acquiring an environment image of a target place;

determining a target detection area in the environment image;

determining a facial human head target frame and a non-facial human head target frame in the target detection area;

and determining the number of people entering and exiting the target place in any time period according to the facial head target frame and the non-facial head target frame of each target detection area in the time period.

2. The method according to claim 1, wherein the determining the number of people entering and exiting the target location in any time period according to the target frame of the facial head and the target frame of the non-facial head of each target detection area in the time period comprises:

for each of the facial human head target frame and the non-facial human head target frame, determining whether the human head target frame simultaneously satisfies the following conditions within any time period: the human head target frame and a reference mark in the environment image are provided with a superposition part; the intersection ratio of the human head target frame of each frame and the human head target frame of the previous frame is greater than an intersection ratio threshold value; the human head target frame of each frame is in the appointed direction of the human head target frame of the previous frame;

if the head target frame meets the conditions in the time period, determining the moving direction of the head target frame as entering or leaving the target place;

and determining the number of the entering persons and the number of the leaving persons of the target place in the time period according to the number of the head target frames entering or leaving the target place in the time period.

3. The detection method according to claim 1, further comprising:

and determining the current queuing number of the target place according to the number of the face head target frames or the number of the people entering or exiting the target place in the first time period.

4. The detection method according to any one of claims 1 to 3, wherein the determining of the facial human head target frame and the non-facial human head target frame in the target detection region comprises:

cutting out a sub-environment image containing the target detection area from the environment image;

determining each human head target frame in the sub-environment image according to a human head detection algorithm;

determining a human head target frame positioned in the target detection area range from the human head target frames of the sub-environment images;

and recognizing a facial human head target frame and a non-facial human head target frame in each human head target frame in the target detection area according to a human face recognition algorithm.

5. The detection method according to claim 4, wherein the identifying of the facial head target frame and the non-facial head target frame in each head target frame in the target detection area according to a face recognition algorithm comprises:

for each human head target frame in the target detection area, identifying whether the current human head target frame and a first number of human head target frames adjacent to the current human head target frame are equal-face human head target frames or not according to the face recognition algorithm;

if the current human head target frame and a first number of human head target frames adjacent to the current human head target frame are both facial human head target frames, determining that the current human head target frame is a facial human head target frame;

if the current human head target frame is a facial human head target frame and the first number of human head target frames adjacent to the current human head target frame are all non-facial human head target frames, determining that the current human head target frame is a non-facial human head target frame;

if the current human head target frame and a first number of human head target frames adjacent to the current human head target frame are non-facial human head target frames, determining that the current human head target frame is a non-facial human head target frame;

and if the current human head target frame is a non-facial human head target frame and the first number of human head target frames adjacent to the current human head target frame are all facial human head target frames, determining that the current human head target frame is a facial human head target frame.

6. A resource recommendation method, comprising:

for a plurality of target places, acquiring the current queuing number of people, the number of people who enter and exit in a second time period, place position information and request information of a user terminal of each target place; the current queuing number is the current queuing number determined by the detection method of any one of claims 3-5; the number of people who pass in and out is determined by the detection method of any one of claims 1-5; the request information comprises user terminal position information;

determining a recommended score of each target place according to the current queuing number of people, the number of people who enter and exit in the second time period, the place position information and the user position information of each place;

and determining at least one target place to be recommended to send to the user terminal according to the recommendation score.

7. The resource recommendation method according to claim 6, wherein the determining a recommendation score for each of the target sites according to the current number of people in line for each of the sites, the number of people coming in and going out in the second time period, the site location information, and the user location information comprises:

determining the resource use speed of each target place according to the number of people who enter and exit each target place in the second time period;

determining the distance between the user terminal and each target place according to the position information of the user terminal and the position information of each target place;

and determining the recommendation score of each target place according to the current queuing number of people, the resource using speed and the distance between the user and each target place.

8. The resource recommendation method according to claim 6 or 7, further comprising:

and for each target place to be recommended, determining at least one route from the current position of the user terminal to the current position of the target place according to the place position information and the position information of the user terminal, and sending the route information of the at least one route to the user terminal.

9. A detection system, comprising: an image acquisition device and a server;

the image acquisition device is arranged at a target place and is in communication connection with the server;

the image acquisition device is used for: acquiring an environment image of a target place, and sending the environment image to the server;

the server is used for executing the method for detecting the number of people entering or leaving the target place according to any one of claims 1-5.

10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, implements the method for detecting the number of people coming in and out of a target place according to any one of claims 1 to 5 or the method for recommending resources according to any one of claims 6 to 8.

Images