JP2019023939A - Wearable terminal - Google Patents

Abstract

To solve the problem in which: a user cannot grasp the congestion state of a place where a monitoring camera is not installed.SOLUTION: A congestion degree estimation server 10 receiving photographed images 12a and image information 12b from a plurality of wearable terminals 20 estimates the number of people and the area of sidewalks from the photographed images 12a through image analysis to calculate the degree of congestion, and records the degree of congestion in a congestion degree table 12c together with positions at which the photographed images 12a are photographed. The congestion degree estimation server then maps the degree of congestion recorded in the congestion degree table 12c on a map in a map database 14 to create a point group congestion degree map 12d and an area congestion degree map 12e. These pieces of data are transmitted according to requests from the wearable terminals 20.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a congestion degree estimation system.

  For example, Patent Document 1 discloses a system that analyzes an image obtained by photographing with a plurality of monitoring cameras connected to a network and grasps a congestion state.

JP2011-008454 A

  In the invention described in Patent Document 1, it is not possible to grasp the congestion situation in a place where a surveillance camera is not installed.

  The congestion degree estimation system according to claim 1 is a congestion degree estimation system including a plurality of wearable terminals and a server, and the wearable terminal includes a photographing unit for photographing a subject, a position detection unit for calculating a current position, An image obtained by photographing by the photographing unit, and a terminal communication unit that transmits the current position calculated by the position detection unit to the server, and the server communicates with a plurality of wearable terminals, An image transmitted from a plurality of wearable terminals and received by the server communication unit and a storage unit associated with the current position and stored, and an image stored in the storage unit are analyzed to calculate the number of people and the area of the sidewalk. Server control that calculates the degree of congestion of pedestrians on the sidewalk from the number of people and the area of the sidewalk, and associates the calculated degree of congestion with the current position and transmits it by the server communication unit Provided with a door.

  According to the present invention, it is possible to grasp a congestion situation in a place where a surveillance camera is not installed.

The block diagram which shows the structure of the congestion degree estimation system in 1st Embodiment. Figure showing an example of the congestion table Figure showing an example of an area congestion map The figure which shows an example of the display in a display part The figure which shows an example of the change of the display in a display part. Flow chart showing regular processing by congestion level estimation server Flowchart representing processing when congestion level estimation server receives communication Flow chart showing processing when gaze detection unit of wearable terminal detects gaze Flow chart showing processing when wearable terminal receives communication The block diagram which shows the structure of the congestion degree estimation system in 2nd Embodiment. Flowchart representing processing when congestion level estimation server receives communication

(First embodiment)
Hereinafter, a first embodiment of the congestion degree estimation system will be described with reference to FIGS. In this specification, the degree of congestion refers to the number of people existing per 1 m ² , and indicates a state of congestion as the degree of congestion increases.
FIG. 1 is a block diagram showing the configuration of the congestion degree estimation system 1. The congestion level estimation system 1 includes a congestion level estimation server 10 and a plurality of wearable terminals 20, which are connected by a network line X.
The congestion degree estimation server 10 includes a server control unit 11, a server storage unit 12, a server communication unit 13, a map database 14, and a face image database 15.
The server control unit 11 includes a CPU, a ROM, and a RAM (not shown), stores a program (to be described later) in the ROM, and develops and executes the program on the RAM. The RAM is also used for temporarily storing calculation results in the execution of a program to be described later.

The server storage unit 12 includes a magnetic disk (not shown), and the server storage unit 12 includes a captured image 12a, image information 12b, a congestion degree table 12c, a point cloud congestion degree map 12d, and an area congestion degree map. 12e and processing target conditions are stored.
The captured image 12 a is an image captured by the wearable terminal 20 and received from the wearable terminal 20 by the server communication unit 13. The image information 12b is various information related to the captured image 12a by the wearable terminal 20, and is transmitted from the wearable terminal 20 together with the captured image 12a. The image information 12b includes, for example, a shooting position, a shooting time, a direction in which the shooting unit 24 of the wearable terminal 20 faces at the time of shooting (hereinafter referred to as “shooting direction”), and the network line X of the wearable terminal 20 that has transmitted the shot image 12a. Identification information, i.e., an IP address.

The congestion degree table 12c stores the position where a certain photographed image 12a is photographed, the congestion degree obtained by image analysis of the photographed image 12a by the server control unit 11, and the degree of congestion for each gender and age group. For example, as shown in FIG.
FIG. 2 shows an example of the congestion degree table 12c. In order from the left, the latitude and longitude at which a certain photographed image 12a was photographed, the total congestion degree regardless of gender and age group calculated from the certain photographed image 12a, Congestion of men under 20 years, congestion of men between 20 and 60 years old, congestion of men over 60 years of age, congestion of women under 20 years of age, congestion of women between 20 and 60 years old, 60 It shows the degree of congestion for women over the age, and the degree of congestion for those whose age and gender are unknown. Information for one line in FIG. 2 is obtained from one captured image 12a.

The point cloud congestion level map 12d is an image in which the congestion level information described in the congestion level table 12c is displayed as a point on the map stored in the map database 14, for example, the level of the congestion level is displayed as a point. Expressed by shading, size, and brightness. In addition, when classified and displayed for each sex and age group, the degree of congestion classified into a plurality of colors can be displayed with a good list.
The area congestion degree map 12e divides the map stored in the map database 14 into predetermined areas, and visually displays the average congestion degree for each area calculated from the congestion degree table 12c. For example, the image shown in FIG. It is.
FIG. 3 shows an example of the area congestion degree map 12e, in which the area is divided into meshes, and A, B, C,... From the north in the north-south direction, 1, 2, 3,. -Names are given, and each area is called A1 or C5 depending on the combination. In FIG. 3, the height of the congestion level is represented by the height of the bar graph, and the breakdown is displayed in a different manner for each type according to sex and age group.
The processing target condition is a condition of the captured image 12a to be processed periodically by a program described later by the server control unit 11. For example, the shooting time is within 15 minutes from the present, and the latitude and longitude are XX prefectures. △ Being within the city.

Returning to FIG. 1, the description will be continued.
The server communication unit 13 communicates with a plurality of wearable terminals 20 via the network line X. The server communication unit 13 always waits for external communication, and notifies the server control unit 11 when communication is received.
The map database 14 includes a magnetic disk (not shown), and the map database 14 stores a map including at least building positions, topography, and main station data. Therefore, by referring to the map database 14, it is possible to determine whether the position expressed by a certain latitude and longitude is indoors or outdoors, that is, whether the position is inside the building. Further, the user can grasp the position from the topography and the station. The map database 14 further stores information on the width of a general outer line and the interval between guard race posts.

The face image database 15 is composed of a magnetic disk (not shown), and the face image database 15 stores samples of facial feature amounts classified by gender and age group. This sample is created from an enormous number of facial images with clear gender and age groups. Therefore, when there is a face image whose gender and age group are unknown, the feature amount is calculated from the face image, and compared with the feature amount sample stored in the face image database 15, the sex and age The layer can be determined.
The wearable terminal 20 includes a terminal control unit 21, a terminal communication unit 22, a display unit 23, a photographing unit 24, a terminal storage unit 25, a line-of-sight detection unit 26, a GPS receiver 27, and an electronic compass 28. For example in the form of glasses.

The terminal control unit 21 includes a CPU, a ROM, and a RAM (not shown), stores a program (to be described later) in the ROM, and develops and executes the program on the RAM. In addition, the terminal control unit 21 sends a shooting command to the shooting unit 24 at regular intervals, for example, every 5 minutes, a command to calculate the current position to the GPS receiver 27, and a command to acquire the shooting direction to the electronic compass 28. Then, the image output from the imaging unit 24, the current position output from the GPS receiver 27, and the imaging direction of the imaging unit 24 output from the electronic compass 28 are transmitted to the congestion degree estimation server 10 together with the current time.
The terminal communication unit 22 communicates with the congestion degree estimation server 10 via the network line X. The terminal communication unit 22 always waits for communication from the outside, and notifies the terminal control unit 21 when the communication is received.

  The display unit 23 includes a head-mounted display (not shown), and displays data input from the terminal control unit 21 and an operation setting icon. For example, when the area congestion degree map 12e is input from the terminal control unit 21, the display unit 23 performs the display shown in FIG. FIG. 4 shows an example of the legend L of the area congestion degree map 12e, the operation setting icon V, and the area congestion degree map 12e displayed on the display unit 23. When the user of the wearable terminal 20 gazes at the operation setting icon V shown in FIG. 4, the gaze is detected by the line-of-sight detection unit 26, and the terminal control unit 21 executes a program described later, whereby the display on the display unit 23 is displayed. Change. For example, when the line-of-sight detection unit 26 detects a gaze on any item in the legend L by the user, the item on the terminal control unit 21 is output. And the terminal control part 21 displays only the selected item on the display part 23. FIG. FIG. 5 shows an example in which only selected items of the area congestion degree map 12e are displayed on the display unit 23. In the example of FIG. 4, all the age groups of men are displayed, but in the example of FIG. 5, only the selected age group of 60 years or older is displayed.

The imaging unit 24 includes a camera (not shown). The photographing unit 24 photographs a subject in response to a command from the terminal control unit 21 and outputs an image obtained by photographing to the terminal control unit 21. In this specification, an image is a concept including both a still image and a series of still images taken continuously, that is, a moving image. When receiving a real-time moving image output command from the terminal control unit 21, the imaging unit 24 continuously shoots until receiving an output stop command, and the obtained real-time moving image is transmitted to the terminal control unit 21. Output.
The terminal storage unit 25 is configured by a flash memory (not shown). The terminal storage unit 25 includes data received from the congestion level estimation server 10, such as a congestion level table 12c, a point cloud congestion level map 12d, or an area congestion level. The degree map 12e is stored.

  The line-of-sight detection unit 26 includes an infrared camera (not shown), and outputs the coordinates of the display unit 23 being watched by the user to the terminal control unit 21. The line-of-sight detection unit 26 shoots the user's eyeball with an infrared camera, and detects the direction of the user's line of sight and wink using a known line-of-sight detection method. For example, a method for detecting the line of sight from the center of the pupil and the central position of the corneal curvature is known. The line-of-sight detection unit 26 can detect that the eyes are closed because the black-eye portion disappears from the image obtained by photographing with the infrared camera because the user's eyes are photographed with the infrared camera. The time when the eyes are closed is used to discriminate between the blink that is performed unconsciously and the wink that is performed consciously. To do. Then, it is determined that the eye is closed when the eye is closed for less than 0.5 seconds.

The line-of-sight detection unit 26 determines that the user is gazing at a certain point when the direction of the user's line of sight is constant over a certain period of time and the user is not blinking. Then, when it is determined that the user is gazing at the display unit 23 from the known position of the display unit 23 and the direction of the user's line of sight, the line-of-sight detection unit 26 pays attention to the terminal control unit 21. The coordinates of the display unit 23 is output. Further, when a wink is detected by the user after detecting a gaze, the line-of-sight detection unit 26 outputs the wink detection to the terminal control unit 21 following the coordinates of the display unit 23.
The GPS receiver 27 receives radio waves from a plurality of satellites, calculates the current location, and outputs the current location to the terminal control unit 21 in response to a request from the terminal control unit 21. The electronic compass 28 includes a triaxial geomagnetic sensor, and outputs the orientation of the imaging direction of the imaging unit 24 to the terminal control unit 21 in response to a request from the terminal control unit 21.
The map database 29 is the same as the map database 14 of the congestion degree estimation server 10.

The operation of the first embodiment will be described.
(1) Periodic operation of the server The server control unit 11 of the congestion degree estimation server 10 executes a program whose operation is represented in the flowchart of FIG. 6 at regular time intervals, for example, every 10 minutes, and the congestion degree table 12c, a point cloud congestion degree map 12d, and an area congestion degree map 12e are newly created.
In step S102, the server control unit 11 deletes the congestion degree table 12c, the point cloud congestion degree map 12d, and the area congestion degree map 12e stored in the server storage unit 12, and proceeds to step S104.

In step S <b> 104, the server control unit 11 refers to all the image information 12 b stored in the server storage unit 12 and extracts a captured image 12 a corresponding to the processing target condition stored in the server storage unit 12. . Then, a list of the extracted captured images 12a is created as a processing target list, stored in the RAM of the server control unit 11, and the process proceeds to step S106. The processing target condition is that, for example, the photographing time is within 15 minutes from the present, and the latitude and longitude are within the range of XX prefecture ΔΔ city.
In step S106, the server control unit 11 sets the captured image 12a described at the top of the processing target list as a processing target, and proceeds to step S108. As will be described later, the captured image 12a described in the processing target list becomes a processing target in order from the top of the list.

In step S108, the server control unit 11 refers to the image information 12b including the photographing position where the photographed image 12a to be processed is photographed and the map database 14, and determines whether or not the photographing position is outdoors. If it is determined that the shooting position is outdoors, the process proceeds to step S110. If it is determined that the shooting position is not outdoors, the process proceeds to step S124. This is because the purpose is to calculate the degree of congestion on the sidewalk.
In step S110, the server control unit 11 performs image processing on the captured image 12a that is the processing target, and that the vicinity of the recognized person's foot is a sidewalk, the color of the sidewalk is approximately uniform, The sidewalk area is extracted from the fact that the color has a clear contrast. Then, an object having a known size or a known length photographed in the photographed image 12a is used, for example, by using information on the width of the outer line and the interval between the guard rail columns stored in the map database 14. The area of the sidewalk is calculated, stored in the RAM, and the process proceeds to step S112.

In step S112, the server control unit 11 performs image processing on the captured image 12a to be processed, and estimates the gender and age group for all persons photographed in the captured image 12a using the face image database 15. Proceed to step S114. The face image database 15 stores “samples of facial feature values” created from a large number of face images whose gender and age are clear. Therefore, the gender and the age group can be estimated by calculating the feature amount of the face included in the photographed image 12a and comparing the correlation with the sample stored in the face image database 15. However, if the face cannot be recognized from the captured image 12a to be processed, such as when facing backward or facing downward, the sex and age group cannot be estimated in step S112.
In step S114, the server control unit 11 determines whether or not the gender and age group of all persons photographed in the processing target captured image 12a have been estimated by the image processing in step S112. If it is determined that all have been determined, the process proceeds to step S122. If it is determined that there is a person who cannot be estimated by one person, the process proceeds to step S116.

  In step S116, the server control unit 11 uses another captured image 12a (hereinafter referred to as a reference image) captured at a position within a predetermined range from the position where the captured image 12a to be processed is captured, in step S112. Then, the gender and age group of a person whose sex and age group could not be estimated (hereinafter referred to as a discrimination target person) are estimated. The reference image is a photographed image 12a obtained by photographing the wearable terminal 20 that photographed the photographed image 12a to be processed, or another wearable terminal 20, and the photographing position and the photographing time stored in the image information 12b. And extracted from the server storage unit 12 according to the shooting direction. In order to recognize the person to be discriminated from the extracted reference image, the clothes of the person to be discriminated in the captured image 12a to be processed are used in addition to the shooting position, shooting time, and shooting direction. Then, the gender and age group of the discrimination target person are estimated from the face image database 15 for the discrimination target person image in the reference image. However, when a discrimination target person can be extracted from a plurality of reference images, the gender and the age group are estimated with respect to the discrimination target person images in the plurality of reference images. Thereafter, the process proceeds to step S118.

In step S118, the server control unit 11 determines whether or not the genders and age groups of all discrimination target persons have been estimated by the process in step S116. If it is determined that the genders and age groups of all discrimination target persons have been estimated, the process proceeds to step S122. If it is determined that the genders and age groups of any discrimination target persons have not been estimated, the process proceeds to step S120.
In step S120, the server control unit 11 uses the captured image 12a to be processed and the reference image to identify a person who is walking alongside the person to be discriminated, and the gender and age group of the person to be discriminated are determined as the object to be discriminated. It is estimated that it is the same as the person walking side by side with the person, and the process proceeds to step S122. This is because friends of close gender and age often walk side by side. In step S120, when the sex and age group are unknown, the sex and age are treated as unknown.

  In step S122, the server control unit 11 divides the number of people detected in step S112, that is, the number of people photographed in the captured image 12a to be processed, by the area of the sidewalk calculated in step S108 to obtain the number of people per unit area. That is, the degree of congestion is calculated. Further, the number of people by sex and age group estimated in steps S112 to S120 is divided by the area of the sidewalk calculated in step S108 to calculate the degree of congestion by sex and age group. The server control unit 11 acquires the latitude and longitude at which the captured image 12a was captured from the image information 12b of the captured image 12a to be processed, records the latitude and longitude along with the calculated congestion level in the congestion level table 12c, and proceeds to step S124. In the example shown in FIG. 2, every time step S122 is executed, the congestion degree table 12c increases by one row. When the processing is completed for all the captured images 12a to be processed, the congestion degree table 12c is completed.

In step S124, the server control unit 11 determines whether or not the current captured image 12a to be processed is the last image described in the processing target list created in step S104. If it is determined that the image is the last image, the process proceeds to step S126. If it is determined that the image is not the last image, the next image described in the process target list is set as the process target, and the process returns to step S108.
In step S126, as preparation for creating the area congestion degree map 12e, the server control unit 11 calculates an average value for each predetermined area for the congestion degree described in the congestion degree table 12c, and proceeds to step S128. The predetermined area is, for example, a mesh-like 50 m square area cut along the east-west direction and the north-south direction, and it is determined which area belongs to the latitude and longitude described in the congestion degree table 12c. For example, if an area includes only the three points shown in FIG. 2, the total congestion levels are 3.2, 2.1, and 2.2, so the total congestion level of the area is an average value. 2.5. As described above, since the processing has already been completed for all the captured images 12a to be processed, the congestion degree table 12c is completed when the processing of step S126 is started.

  In step S128, the server control unit 11 writes the information described in the congestion degree table 12c as point data in the corresponding position of the map stored in the map database 14, and creates the point cloud congestion map 12d. Save in the server storage unit 12. In addition, the area congestion degree map 12e is created using the average value of the congestion degree for each area calculated in step S126, and is stored in the server storage unit 12. Thereafter, the flowchart of FIG. 6 ends. In the point cloud congestion map 12d, the degree of congestion may be expressed by the brightness of a point or by the size of a point. In addition, the colors displayed for each gender and age group may be differentiated, or a different point cloud congestion map 12d may be created for each gender and age group. The area congestion degree map 12e may express the degree of congestion for each area by color shading, or may distinguish the colors displayed for each sex and age group. Furthermore, you may display by the stacked bar graph displayed so that identification according to the classification according to sex and age group was possible.

(2) Server operation in response to a request from the wearable terminal The congestion degree estimation server 10 uploads information related to the degree of congestion or a download request for the captured image 12a, a distribution request for a real-time moving image, and a captured image from the wearable terminal 20. Receive request communication. The server communication unit 13 always waits for communication from the outside, and when the communication is received, the received data is output to the server control unit 11. When receiving data output from the server communication unit 13, the server control unit 11 determines processing with reference to the data received by the server communication unit 13 as follows.

FIG. 7 is a flowchart showing the operation of a program executed by the server control unit 11 when the congestion degree estimation server 10 receives communication from the wearable terminal 20. In the description of this flowchart, the wearable terminal 20 that has performed communication that triggered the execution of the program whose operation is represented by this flowchart is referred to as a “processing request terminal”.
In step S202, the server control unit 11 determines whether or not the communication is an upload request based on whether or not the received data includes image data. If it is determined that the received data includes image data, the process proceeds to step S204. If it is determined that the received data does not include image data, the process proceeds to step S206.

  In step S204, the server control unit 11 stores the image data included in the received data in the server storage unit 12 as a captured image 12a. Further, data other than the image data of the received data, that is, the shooting position, the shooting time, the shooting direction, and the identification information in the network line X of the wearable terminal 20 that has transmitted the data as the image information 12b, The association is stored in the server storage unit 12, and the flowchart of FIG. 7 ends.

  In step S206, the server control unit 11 determines whether the received data is a request for a captured image 12a or a real-time moving image or a request for information regarding the degree of congestion. This is determined based on whether the received data includes information specifying the position, for example, latitude and longitude, or the name of the area. If the received data includes information specifying the position, it is determined that the request is for a captured image 12a or a real-time moving image, and the process proceeds to step S208. If the received data does not include information specifying the position, the process proceeds to step S207 as a request for information on the degree of congestion. Hereinafter, a position designated by information designating a position included in the received data is referred to as “designated position”.

In step S207, since the received data is a request for one of the congestion degree table 12c, the point cloud congestion map 12d, and the area congestion map 12e, the data corresponding to the request is sent from the server storage unit 12. The data is read and transmitted to the processing request terminal, and the flowchart of FIG. 7 is terminated.
In step S208, the server control unit 11 determines whether or not real-time moving image designation is added to the received data. If it is determined that the designation of the real-time moving image is added, the process proceeds to step S210, and if it is determined that the designation of the real-time moving image is not added, the process proceeds to step S220.
In step S210, the server control unit 11 refers to the image information 12b stored in the server storage unit 12, and wears the wearable terminal 20 having the “photographing position closest to the designated position” (hereinafter, “real-time moving image distribution terminal”). ") Is searched for the network line X, and the process proceeds to step S212. For example, the IP address of the real-time moving image distribution terminal is acquired, and the process proceeds to step S212.

In step S212, the server control unit 11 requests a real-time moving image from the real-time moving image distribution terminal using the identification information of the real-time moving image distribution terminal searched in step S210, and proceeds to step S214.
In step S214, upon receiving from the real-time moving image distribution terminal, the server control unit 11 starts transmission processing of the real-time moving image to the processing request terminal, and proceeds to step S216. Thereafter, transmission of the moving image received from the real-time moving image distribution terminal to the processing requesting terminal is continued until transmission is stopped in step S218.

In step S216, the server control unit 11 waits for a predetermined time and proceeds to step S218. As described above, transmission of the real-time moving image received from the real-time moving image distribution terminal to the processing requesting terminal continues during the standby time in step S216.
In step S218, the server control unit 11 ends the reception of the real-time moving image from the real-time moving image distribution terminal and the transmission of the real-time moving image to the process requesting terminal, and ends the flowchart of FIG.
In step S220, the server control unit 11 refers to the image information 12b, selects the captured image 12a that is captured within a predetermined distance from the specified position and within a predetermined time from the current time, and proceeds to step S222. move on.

  In step S222, the server control unit 11 transmits the captured image 12a selected in step S220 to the process requesting terminal, and ends the flowchart of FIG.

(3) Operation of Wearable Terminal The line-of-sight detection unit 26 of the wearable terminal 20 always detects the movement of the user's line of sight. When the line-of-sight detection unit 26 detects that the user gazes at the map or the operation setting icon V on the display unit 23 while the congestion degree data is displayed on the display unit 23 as illustrated in FIG. 4, the terminal control unit 21. The coordinates of the display unit 23 that the user is gazing at and the presence or absence of the wink after the gazing are output.

FIG. 8 is a flowchart showing the operation of a program that is executed when the terminal control unit 21 receives an input from the line-of-sight detection unit 26.
In step S <b> 302, the terminal control unit 21 uses the user's gaze coordinates input from the line-of-sight detection unit 26 and the data displayed on the display unit 23, and the user is watching the point on the map. It is determined whether or not. If it is determined that the point is on the map, the process proceeds to step S304. If it is determined that the point is not on the map, the process proceeds to step S314.
In step S <b> 304, the terminal control unit 21 determines whether information indicating that the user winks is input from the line-of-sight detection unit 26. If it is determined that the information indicating winking has been input, the process proceeds to step S306. If it is determined that the information indicating winking has not been input, the process proceeds to step S308.

In step S306, the terminal control unit 21 transmits the position where the user is gazing to the congestion degree estimation server 10 together with the designation of the real-time moving image, and proceeds to step S310. The terminal control unit 21 specifies the geographical position that the user is watching from the display on the display unit 23 and the coordinates on the display screen that the user is watching as the latitude and longitude, or the name of the area.
In step S308, the terminal control unit 21 transmits the geographical position that the user is watching to the congestion degree estimation server 10, and the process proceeds to step S310. However, unlike step S306, the real-time moving image is not designated. The position where the user was gazing is specified as the latitude and longitude or the name of the area from the display on the display unit 23 and the coordinates on the display screen where the user was gazing.

In step S310, the terminal control unit 21 receives the real-time moving image, the captured image 12a, the point cloud congestion degree map 12d, or the area congestion degree map 12e from the congestion degree estimation server 10, and proceeds to step S312.
In step S312, the terminal control unit 21 displays the data received from the congestion degree estimation server 10 on the display unit 23, and ends the flowchart of FIG.
In step S314, the terminal control unit 21 specifies any one of the operation setting icons V1 to V4 that the user is watching from the coordinates that the user is watching, and sets the marker M to the icon that was watching. Then, the display on the display unit 23 is updated, and the process proceeds to step S316. However, one marker M is set for the icon V1 or the icon V2, and one marker M is set for the icon V3 or the icon V4.

In step S316, the terminal control unit 21 determines which one of the map V1 and the table V2, which are reception setting icons, is selected in the display after the display update of the display unit 23 in step S314, that is, in which of the markers M is set. Judge whether it has been. If it is determined that the map V1 is selected, the process proceeds to step 318, and if it is determined that the table V2 is selected, the process proceeds to step S324.
In step S318, the terminal control unit 21 determines which of the dot V3, which is the display setting icon, and the area V4 is selected in the display after the display update of the display unit 23 in step S314, that is, in which of the markers M is set. Judge whether it has been. If it is determined that the dot V3 is selected, the process proceeds to step 322. If it is determined that the area V4 is selected, the process proceeds to step 320.

In step S320, the terminal control unit 21 transmits a request for the area congestion degree map 12e, which is mapping data for area display, to the congestion degree estimation server 10, and the process proceeds to step S310.
In step S322, the terminal control unit 21 transmits a request for the point cloud congestion degree map 12d, which is point display mapping data, to the congestion degree estimation server 10, and the process proceeds to step S310.
In step S324, the terminal control unit 21 transmits a request for the congestion degree table 12c to the congestion degree estimation server 10, and the process proceeds to step S326.
In step S326, the terminal control unit 21 receives the congestion level table 12c from the congestion level estimation server 10, and proceeds to step S328.

In step S328, the terminal control unit 21 determines which one of the dot V3 and the area V4, which are display setting icons, is selected, that is, which marker M is set. If it is determined that the dot V3 is selected, the process proceeds to step 334. If it is determined that the table V2 is selected, the process proceeds to step S330.
In step S330, as in step S126 of FIG. 6, the terminal control unit 21 calculates an average value for each predetermined area for the congestion degree described in the congestion degree table 12c as preparation for creating the area congestion degree map 12e. Then, the process proceeds to step S332. The predetermined area is, for example, a mesh-like 50 m square area cut along the east-west direction and the north-south direction, and it is determined which area belongs to the latitude and longitude described in the congestion degree table 12c.

In step S332, the terminal control unit 21 writes the information described in the congestion degree table 12c received from the congestion degree estimation server 10 as point data at the corresponding position of the map stored in the map database 29. A group congestion degree map 12d is created. And it is made to display on the display part 23, and the flowchart of FIG. 8 is complete | finished.
In step S334, the terminal control unit 21 creates an area congestion degree map 12e based on the data created in step S330 and displays it on the display unit 23, and ends the flowchart of FIG.

The terminal communication unit 22 of the wearable terminal 20 always waits for external communication, and transmits a request for a real-time moving image to the terminal control unit 21.
FIG. 9 is a flowchart showing the operation of a program executed by the terminal control unit 21 when communication reception is transmitted from the terminal communication unit 22.
In step S402, the terminal control unit 21 starts photographing by the photographing unit 24, transmits the photographed real-time moving image from the terminal communication unit 22 to the congestion degree estimation server 10 that transmitted the request, and proceeds to step S404. After execution of step S402, the moving image captured by the imaging unit 24 is continuously transmitted to the congestion degree estimation server 10 until the connection is disconnected in step S406.

In step S404, the terminal control unit 21 waits for a predetermined time, for example, 10 seconds, and proceeds to step S406. However, even during a predetermined time, the user of the wearable terminal 20 may proceed to step S406 by an explicit input from the line-of-sight detection unit 26.
In step S406, the terminal control unit 21 ends the transmission of the moving image to the congestion degree estimation server 10 and the shooting by the shooting unit 24, and the flowchart of FIG. 9 ends.

(Summary of operation)
In the first embodiment, the congestion degree estimation server 10 and the wearable terminal 20 perform the following operations.
The wearable terminal 20 transmits the captured image 12a obtained by photographing by the photographing unit 24 at regular time intervals to the congestion degree estimation server 10 together with information on the photographing position.
The congestion level estimation server 10 that receives the captured image 12a and the image information 12b from the plurality of wearable terminals 20 calculates the congestion level by calculating the number of people and the area of the sidewalk from the captured image 12a by image analysis, and the captured image 12a It records on the congestion degree table | surface 12c with the image | photographed position. Then, the congestion level recorded in the congestion level table 12c is mapped to the map of the map database 14, and a point cloud congestion level map 12d and an area congestion level map 12e are created. The congestion degree estimation server 10 transmits the congestion degree table 12c, the point cloud congestion degree map 12d, or the area congestion degree map 12e as requested.

The wearable terminal 20 receives the congestion level table 12c from the congestion level estimation server 10 according to the setting of the operation setting icon V, creates the point cloud congestion level map 12d or the area congestion level map 12e, and displays it on the display unit 23. . Alternatively, the point cloud congestion map 12 d or the area congestion map 12 e is received from the congestion estimation server 10 and displayed on the display unit 23.
The congestion degree estimation server 10 transmits the created congestion degree table 12c, the point cloud congestion degree map 12d, or the area congestion degree map 12e in response to a request from the outside. Further, when a request for designating a position is received, a captured image 12a photographed near the designated position or a real-time moving image from the wearable terminal 20 near the designated position is transmitted.

  The wearable terminal 20 includes a line-of-sight detection unit 26. When the wearable terminal 20 detects that the user of the wearable terminal 20 is gazing at a point on the display unit 23, the line-of-sight detection unit 26 transmits gaze position information to the terminal control unit 21. . When the terminal control unit 21 determines that the user is gazing at a point on the map, the terminal control unit 21 transmits position information to the congestion degree estimation server 10, and the captured image 12a or the real-time moving image captured in the vicinity of the specified position is transmitted. Received from the congestion degree estimation server 10. When the terminal control unit 21 determines that the user is gazing at the operation setting icon V, the terminal control unit 21 sets the marker M on the icon V being gazed at, and requests information from the congestion degree estimation server 10 to the received data. Based on this, the point cloud congestion map 12d or the area congestion map 12e is displayed on the display unit 23.

In the first embodiment described above, the congestion degree estimation system 1 has the following operational effects.
(1) The congestion level estimation system 1 includes a plurality of wearable terminals 20 and a congestion level estimation server 10. The wearable terminal 20 uses a photographing unit 24 for photographing a subject, a GPS receiver 27 for calculating a current position, an image obtained by photographing by the photographing unit 24, and a current position calculated by the GPS receiver 27 in a server. A terminal communication unit 22 for transmission. The congestion degree estimation server 10 stores a server communication unit 13 that communicates with a plurality of wearable terminals 20, a captured image 12a that is transmitted from the plurality of wearable terminals 20 and received by the server communication unit 13 and a current position in association with each other. The server storage unit 12 and the captured image 12a stored in the server storage unit 12 are analyzed to calculate the degree of congestion calculated from the number of people and the area, and the calculated degree of congestion and the current position are transmitted by the server communication unit 13. And a server control unit 11.

  When the user moves while wearing the wearable terminal 20, another user using the congestion degree estimation system 1 can grasp the congestion situation in a place where the surveillance camera is not installed. In addition, since there is a high possibility that there is a user wearing the wearable terminal 20 in a place where the degree of congestion is high, more photographed images 12a can be obtained in a place where the degree of congestion is high, and the calculation accuracy of the degree of congestion is improved. .

(2) The congestion degree estimation server 10 further includes a map database 14 that stores a map. The server control unit 11 maps the calculated congestion degree on the map stored in the map database 14 at the position where the captured image 12a used for calculating the congestion degree is captured, and the calculated congestion degree is mapped. The server communication unit 13 transmits the map.
Therefore, the wearable terminal 20 does not need to include the map database 14, and a small storage area is sufficient. Moreover, since the process which maps the calculated congestion degree on a map is unnecessary, the calculation amount of the wearable terminal 20 can be reduced.

(3) When the server control unit 11 of the congestion degree estimation server 10 receives a transmission request for information specifying a position from the wearable terminal 20, the position specified from the captured image 12a stored in the server storage unit 12 The photographed image 12a having the current position within a predetermined distance range from the designated position is transmitted to the wearable terminal 20 that has transmitted the transmission request.
The wearable terminal 20 can receive the captured image 12a photographed in the vicinity of the designated position by transmitting a transmission request for information designating the position to the congestion degree estimation server 10, so that the state of the designated position is specifically described. I can know.

(4) When the server control unit 11 of the congestion degree estimation server 10 receives a transmission request for information specifying a position from the wearable terminal 20, the server control unit 11 is closest to the received position or currently within a predetermined distance range from the specified position. The wearable terminal 20 having the position is requested to transmit a real-time moving image. And the real-time moving image received from the said wearable terminal 20 is transmitted to the wearable terminal 20 which transmitted the transmission request.
The wearable terminal 20 can receive a real-time moving image photographed in the vicinity of the designated position by transmitting the position on the map to the congestion degree estimation server 10, and can thus know in detail the current state of the designated position. .

(5) The wearable terminal 20 includes a line-of-sight detection unit 26 that detects an input by the user's eyes and inputs position information by movement of the eyes. When the line-of-sight detection unit 26 detects the gaze of a point on the map displayed on the display unit 23 by the user, the server control that designates the gaze position and transmits an information transmission request to the congestion degree estimation server 10. And a unit 11.
Therefore, the user of the wearable terminal 20 can easily transmit the position on the map to the congestion degree estimation server 10 by only the movement of the eyes without using a hand, and can receive and browse the image at the designated position.

(6) The server control unit 11 estimates the gender and the age group for all persons photographed in the captured image 12a using the face image database 15, and calculates the degree of congestion for each gender and age group.
For this reason, the user of wearable terminal 20 identifies the gender and age group that are the targets of market research or advertising, and makes the target area an area where the degree of congestion of the target person is high and the degree of congestion other than the target person is low. , Can improve the efficiency of market research and advertising.

(7) The wearable terminal 20 further includes an electronic compass 28 that detects the shooting direction of the shooting unit 24. The terminal communication unit 22 of the wearable terminal 20 includes the captured image 12a captured by the capturing unit 24, the current position detected by the GPS receiver 27, and the capturing direction of the capturing unit 24 detected by the electronic compass 28. It transmits to the estimation server 10. The server control unit 11 of the congestion degree estimation server 10 combines the photographed image 12a, the current position, and the photographing direction received from the plurality of wearable terminals 20 in the congestion degree calculation process, and the same photographed in the plurality of photographed images 12a. A person is identified, and the gender and age group of the person are estimated using one or more of the received images 12a.
For this reason, only a rear view is taken in a certain photographed image 12a, and even if it is impossible to discriminate gender and age group, the same person can be identified from other photographed images 12a using the photographing position, time, direction, clothes, etc. By discriminating and discriminating the gender and age group, it is possible to reduce the number of people whose sex and age group are unknown as the whole system. Further, by using the captured image 12a captured from a plurality of angles, it is possible to improve the estimation accuracy of the sex and the age group.

(Modification 1)
In the first embodiment, only the wearable terminal 20 communicates with the congestion degree estimation server 10, but even if other communication devices connected to the network line X communicate with the congestion degree estimation server 10. Good.
Other communication devices do not transmit the captured image 12a to the congestion degree estimation server 10, but transmit a request for information transmission to the congestion degree estimation server 10 by designating a certain position using a general-purpose input device such as a mouse and a keyboard. The captured image 12a or the real-time moving image near the position may be received. Further, the congestion degree table 12c, the point cloud congestion degree map 12d, or the area congestion degree map 12e may be requested from the congestion degree estimation server 10 and received.
According to the first modification, information taken by the wearable terminal 20 and processed or relayed by the congestion degree estimation server 10 can be used from various information communication devices.

(Modification 2)
In the first embodiment, the wearable terminal 20 periodically shoots and transmits a captured image 12a, that is, a still image, to the congestion degree estimation server 10. However, the wearable terminal 20 captures a moving image instead of a still image and collects the congestion degree estimation server. 10 may be transmitted. Wearable terminal 20 may newly take a picture when receiving a request for a real-time moving image, and may send photographed image 12 a obtained by photographing to congestion degree estimation server 10.

(Modification 3)
In the first embodiment, when the congestion degree estimation server 10 receives the designation of the position and the designation of the real time, the congestion degree estimation server 10 requests the real time moving image only for a certain wearable terminal 20, but the request target is limited to this. Not. Even if the congestion degree estimation server 10 requests real-time moving images from a plurality of wearable terminals 20 that are closest to the specified position or have shooting positions within a predetermined range, for example, 10 meters from the specified position. Good. Then, the real-time moving images received from the plurality of wearable terminals 20 may be reduced, and the plurality of real-time moving images may be simultaneously transmitted to the processing requesting terminal. For example, the four real-time moving images received from the four wearable terminals 20 may be reduced, and the four real-time moving images may be stored on one screen and transmitted to the processing requesting terminal. Moreover, you may transmit to the process request | requirement terminal, switching the several real-time moving image received sequentially. Further, when switching sequentially, the time for receiving a real-time moving image from one wearable terminal 20 may be short.
According to the third modification, the processing requesting terminal can receive real-time moving images photographed by the plurality of wearable terminals 20, so that the information on the designated position can be known in more detail. In addition, by shortening the time of a moving image distributed from one wearable terminal 20, it is difficult to specify the wearable terminal 20 that distributes the moving image and the person who is photographed by the wearable terminal 20. , Can protect privacy.

(Modification 4)
In the first embodiment, the wearable terminal 20 receives input from the user of the wearable terminal 20 only by the line-of-sight detection unit 26, but the information input means from the user is not limited to this. The wearable terminal 20 includes a touch sensor or a button, and the terminal control unit 21 receives an input of coordinates on the display screen using the touch sensor or the button by the user when executing the program whose operation is illustrated in FIG. You may handle similarly to the detection of the gaze by the detection part 26. FIG.
According to the fourth modification, the user of the wearable terminal 20 can input position information by various methods.

(Modification 5)
In the first embodiment, the age group is divided into three categories, but the age group category is not limited to this. The age group may be divided into two categories less than those of the first embodiment, may be four or more categories more than those of the first embodiment, or may be an age group, that is, an age category. Moreover, the division of only sex may be sufficient without the division of an age group.
In the first embodiment, in the example of the area congestion degree map 12e shown in FIG. 3, the level of congestion is expressed by the height of the bar graph, but the expression method is not limited to this, and the expression is expressed by color shading. May be. In FIG. 3, the male congestion level is displayed, but the female congestion level may also be displayed, or only a specific gender and age group may be displayed.

In addition, in the area congestion degree map 12e shown in FIG. 3, since the bar graph has a large width, the surface portion on which the topography, railroad tracks, administrative boundaries, etc. are drawn is not displayed at all, but the width of the bar graph is supplemented. Alternatively, the surface portion may be displayed in a translucent display.
In the first embodiment, it is assumed that the time of photographing is included in data received from the wearable terminal 20 by the congestion degree estimation server 10. However, if the received data does not include the shooting time, the time when the congestion degree estimation server 10 receives the data may be set as the shooting time, and the time may be stored as the image information 12b.
In the first embodiment, the processing target condition is stored in the server storage unit 12 of the congestion degree estimation server 10, but this may be rewritten from the outside. For example, it may be rewritable by communication from the wearable terminal 20.

(Second Embodiment)
With reference to FIGS. 10-11, 2nd Embodiment of the congestion degree estimation system by this invention is described. In the following description, the same components as those in the first embodiment are denoted by the same reference numerals, and different points will be mainly described. Points that are not particularly described are the same as those in the first embodiment. This embodiment is different from the first embodiment in that, in addition to the operation in the first embodiment, a search is performed using an image obtained by photographing the wearable terminal.
The search target is a person, a user's property, a pet, or the like specified by the image, and the image is transmitted from the wearable terminal 20 to the congestion degree estimation server 10 as the search target image 12f. The congestion degree estimation server 10 searches the photographed image 12a including the subject of the search target image 12f as the subject, and transmits the image information 12b of the photographed image 12a to the wearable terminal 20, whereby the user of the wearable terminal 20 becomes the search target. You can get there.

FIG. 10 is a block diagram of the congestion degree estimation system 1 according to the second embodiment. The main difference of the configuration of the congestion degree estimation system 1 in the second embodiment from the first embodiment is that the search target image 12f and the search result contact 12g are further stored in the server storage unit 12. Is a point.
The search target image 12 f is an image received from the wearable terminal 20 by the congestion degree estimation server 10. The photographed image 12a is also received from the wearable terminal 20 in the same manner as the search target image 12f, but the photographed image 12a is transmitted together with the photographing position, photographing time, etc., whereas only the image is transmitted as the retrieval target image 12f. Therefore, the congestion degree estimation server 10 can determine which image to handle. As will be described later, the congestion degree estimation server 10 searches for a photographed image 12a in which a subject photographed in an image stored as the search target image 12f is photographed.

  In the search result contact 12g, an identifier on the network of the wearable terminal 20 that has transmitted the search target image 12f, for example, an IP address is stored in association with the search target image 12f. The congestion level estimation server 10 cannot immediately find the captured image 12a including the search target image 12f even if it receives the search target image 12f, and therefore transmits the information for the purpose of transmitting information when it is discovered in the future. The destination is stored as a search result contact 12g.

The operation in the second embodiment will be described.
The program shown in the flowchart of FIG. 11 replaces the program shown in the flowchart of FIG. 7 in the first embodiment, and when the server control unit 11 receives data output from the server communication unit 13 in the second embodiment. The processing procedure to be executed is shown.

In step S502, the server control unit 11 determines whether the received image is the search target image 12f. The search target image 12f is an image similar to the photographed image 12a. However, unlike the photographed image 12a, the search target image 12f can be distinguished from the photographed image 12a because there is no additional information such as a photographing position. When determining that the search target image 12f has been received, the server control unit 11 proceeds to step S504, and when determining that the search target image 12f has not been received, the server control unit 11 proceeds to step S202A. Note that the processing in step S202A and subsequent steps is partly different from that in FIG. 7 and will be described later.
In step S504, the server control unit 11 searches for all the captured images 12a stored in the server storage unit 12 for images including the subject of the received search target image 12f as a subject, and the process proceeds to step S506. .

In step S506, the server control unit 11 determines whether or not the search target image 12f is included in any one of the captured images 12a stored in the server storage unit 12 by the search in step S504. If it is determined that any of the captured images 12a includes the search target image 12f, the process proceeds to step S508. If any of the captured images 12a is determined not to include the search target image 12f, the process proceeds to step S510. .
In step S508, the server control unit 11 sends the image information 12b of the captured image 12a determined to include the search target image 12f by the search in step S504 and the search target image 12f to the wearable terminal 20 that has transmitted the search target image 12f. Then, the process proceeds to step S510.

In step S <b> 510, the server control unit 11 stores the received search target image 12 f in the server storage unit 12. Further, the identifier on the network of the wearable terminal 20 that has transmitted the search target image 12f, for example, the IP address is stored in the search result contact 12g in association with the search target image 12f, and the flowchart of FIG. 11 is ended.
In step S202A, the server control unit 11 determines whether or not the communication is an upload request based on whether or not the received data includes image data. If it is determined that the received data includes image data, the process proceeds to step S514. If it is determined that the received data does not include image data, the process proceeds to step S512.
In step S512, the server control unit 11 performs the processing in step S206 and subsequent steps in FIG. 7 and ends the flowchart in FIG.

In step S514, the server control unit 11 searches the search target image 12f stored in the server storage unit 12 for a search target image 12f that matches a part of the image data included in the received data, and proceeds to step S516. move on.
In step S516, the server control unit 11 determines whether the image data included in the received data includes the subject of any of the search target images 12f stored in the server storage unit 12, based on the result of the process in step S514. Determine whether. If it is determined that any of the search target images 12f is included, the process proceeds to step S518. If it is determined that any of the search target images 12f is not included, the process proceeds to step S204A.

In step S518, the server control unit 11 searches the image information 12b of the captured image 12a determined to include the search target image 12f by the search in step S504, and the search target image 12f associated with the search target image 12f. The result is transmitted to the wearable terminal 20 described in the contact 12g, and the process proceeds to step S204A.
In step S204A, the server control unit 11 saves the image data included in the received data as the captured image 12a in the server storage unit 12, and saves other than the image data of the received data as the image information 12b in the server storage unit 12. Then, the flowchart of FIG.
The server control unit 11 of the congestion degree estimation server 10 executes a program whose operation is represented by the flowchart of FIG. 6 at regular time intervals, and the congestion degree table 12c, the point cloud congestion degree map 12d, and the area congestion degree map The point that 12e is newly created is the same as in the first embodiment.

The operation of the wearable terminal 20 will be described.
The line-of-sight detection unit 26 of the wearable terminal 20 outputs a wink detection to the terminal control unit 21 when detecting the wink of the user, and the terminal control unit 21 that receives the wink captures and shoots the subject by the imaging unit 24. The obtained image is stored in the terminal storage unit 25. The terminal control unit 21 can transmit all or a part of any image stored in the terminal storage unit 25 to the congestion degree estimation server 10 by a button operation (not shown) by the user. This image is handled as the search target image 12f in the congestion degree estimation server 10.
When the captured image 12a including the search target image 12f is found by the congestion degree estimation server 10, the wearable terminal 20 captures the image information 12b of the captured image 12a, that is, the position, time, and image of the captured image 12a. The direction and the search target image 12f are received.

In the second embodiment, the congestion degree estimation system 1 performs the following operation in addition to the first embodiment.
Upon receiving the search target image 12f, the congestion degree estimation server 10 searches all the captured images 12a stored in the server storage unit 12, and searches the image information 12b of the captured image 12a including the search target image 12f as the search target. The image 12f is transmitted to the wearable terminal 20 that has transmitted the image 12f. When a new captured image 12a is received after receiving the search target image 12f, it is determined whether or not the captured image 12a includes the search target image 12f, and if so, the image information 12b of the captured image 12a is searched. The target image 12f is transmitted to the wearable terminal 20 that has transmitted the target image 12f.

In the second embodiment described above, the congestion degree estimation system 1 has the following operational effects.
(1) The server control unit 11 of the congestion degree estimation server 10 searches the captured image 12a including the search target image 12f, and uses the image information 12b of the captured image 12a including the search target image 12f as the transmission source of the search target image 12f. Send.
Therefore, the user of the congestion degree estimation system 1 can easily know the location of the lost child or the lost item by transmitting the child's photo or the lost item's photo as the search target image 12f.
(2) Upon receiving the search target image 12f, the server control unit 11 of the congestion degree estimation server 10 searches all the captured images 12a stored in the server storage unit 12, and the captured image 12a including the search target image 12f. The image information 12b is transmitted to the transmission source of the search target image 12f.
Therefore, the user of the congestion level estimation system 1 can know the past movement trajectory of the search target from the obtained information. Furthermore, future movement prediction can be performed using the obtained movement trajectory.

(3) When the server control unit 11 of the congestion degree estimation server 10 receives a new captured image 12a after receiving the search target image 12f, the server control unit 11 specifies the search target image 12f included in the captured image 12a, and the search target The received image information 12b of the captured image 12a is transmitted to the transmission source of the image 12f.
Therefore, the congestion degree estimation server 10 can search the search target image 12f as early as possible, and can transmit the latest information to the transmission source of the search target image 12f.

(Modification 6)
In the second embodiment, when the captured image 12a including the search target image 12f is specified, the image information 12b of the captured image 12a and the search target image 12f are transmitted. However, the data to be transmitted is limited to this. Not.
The latitude and longitude may be extracted from the image information 12b of the photographed image 12a, the position may be mapped to a map stored in the map database 14 as the photographed position of the photographed image 12a, and the map may be transmitted together. Further, the map may be divided into areas of a predetermined size, and the shooting positions of the shot images 12a including the search target image 12f may be displayed so as to be identifiable depending on the number included in each area. For example, an area where a large number of captured images 12a including the search target image 12f are captured may be displayed brighter.
According to the sixth modification, the location of the search target can be easily grasped. In particular, when a pet is a search target, the movement is not limited to one place, and the movement is often repeated. Therefore, the detection is facilitated by grasping the area where the frequency is high.

The above-described embodiments and modifications may be combined.
Although various embodiments and modifications have been described above, the present invention is not limited to these contents. Other embodiments conceivable within the scope of the technical idea of the present invention are also included in the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 ... Congestion degree estimation system 10 ... Congestion degree estimation server 11 ... Server control part 12 ... Server storage part 12a ... Captured image 12b ... Image information 12c ... Congestion degree table 12d ... Point cloud congestion degree map 12e ... Area congestion degree map 12f ... Search target image 12g ... Search result contact 13 ... Server communication unit 14 ... Map database 15 ... Face image database 20 ... Wearable terminal 21 ... Terminal control unit 22 ... Terminal communication unit 23 ... Display unit 24 ... Shooting unit 25 ... Terminal storage unit 26 ... Eye gaze detection unit 27 ... GPS receiver 28 ... Electronic compass 29 ... Map database

The present invention relates to a wearable terminal .

The wearable terminal according to the first aspect of the present invention is generated by a transmission unit that transmits a captured image obtained by photographing by a photographing unit together with photographing position information to a congestion degree information generation server, and the congestion degree information generation server, A display unit that receives and displays a congestion degree map based on the degree of congestion of the sidewalk calculated from the number of people and the area of the sidewalk calculated from the captured image and the shooting position information from the congestion degree information generation server; Prepare.
In the wearable terminal according to the second aspect of the present invention, the position information designated by the user is congested based on the number of people calculated from the photographed image and the area of the sidewalk and the degree of congestion of the sidewalk and the photographing position information. A transmission unit that transmits to a congestion degree information generation server that generates a degree map, and a display unit that receives and displays the captured image taken of the position corresponding to the position information from the congestion degree information generation server. .

Claims (1)

A congestion degree estimation system comprising a plurality of wearable terminals and servers,
The wearable terminal is
A shooting section for shooting the subject;
A position detector for calculating the current position;
An image obtained by photographing by the photographing unit, and a terminal communication unit that transmits the current position calculated by the position detecting unit to the server,
The server
A server communication unit that communicates with the plurality of wearable terminals;
A storage unit that stores the image and the current position associated with each other and transmitted from the plurality of wearable terminals and received by the server communication unit;
Analyzing the image stored in the storage unit to calculate the number of people and the area of the sidewalk, calculating the degree of congestion of pedestrians on the sidewalk from the calculated number of people and the area of the sidewalk, and calculating A congestion degree estimation system comprising: a server control unit that associates a congestion degree and the current position and transmits the association by the server communication unit.

Images