JP2019205035A - Parking monitoring system, parking monitoring method, and program - Google Patents

Abstract

To monitor whether a vehicle is parked in a facility parking lot for illegal purposes other than facility visit, and assist a facility operator in efficiently operating the parking lot.SOLUTION: In a parking monitoring system 5, a monitoring camera 10 installed so as to be able to image a parking lot 100 having a plurality of parking spaces and a PC 30 are connected so as to communicate with each other. The monitoring camera 10 repeatedly transmits a captured image of the parking lot 100 to the PC 30. When the PC 30 detects parking of a vehicle in any one of the plurality of parking spaces on the basis of the captured image sent from the monitoring camera 10, the PC 30 analyzes information on the detected vehicle. The PC 30 determines whether the detected parking of the vehicle is a violation parking that is not intended for entering a store 8 having a parking lot 100. The PC 30 displays the analysis result of the information on the detected vehicle and the determination result indicating whether the parking is a violation parking on a display unit 33.SELECTED DRAWING: Figure 1

Description

  The present disclosure relates to a parking monitoring system, a parking monitoring method, and a program for monitoring the presence or absence of illegal parking.

  Patent Document 1 discloses a parking lot monitor system that writes a parking number and a parking time as parking information on an IC card when a user has a hardware token (for example, an IC card) and parks a vehicle in a parking space. Has been. When the user monitors the vehicle, the parking lot monitoring system requests the video database server to distribute the video of the monitoring camera corresponding to the parking number of the parking information read from the IC card by the store terminal, and displays the live video of the monitoring camera. Or, the recorded video at the shooting time specified by the user is displayed. Thereby, the user can browse the live video regarding the user's vehicle parked in the parking lot or the recorded video at the shooting time specified by the user.

JP 2008-97072 A

  However, in the configuration of Patent Document 1, it is not assumed that the parking lot monitor system determines whether the user's vehicle is parked for the purpose of visiting the store. For this reason, for example, it was not possible to determine whether the user parked the vehicle in the store parking lot for visiting the store or parked in the parking lot for illegal purposes other than the store visit. Therefore, it is not possible to effectively control the parking of vehicles in parking lots for illegal purposes other than store visits, and there is a possibility of hindering the parking of vehicles such as customers who originally have business in the store. It was a hindrance to efficient parking management for operators.

  The present disclosure has been devised in view of the above-described conventional situation, monitors whether a vehicle is parked in a facility parking lot for illegal purposes other than the facility visit, and the facility operator manages the parking lot. An object of the present invention is to provide a parking monitoring system, a parking monitoring method, and a program that support efficient execution.

  The present disclosure is a parking monitoring system in which a camera installed so as to be able to image a parking lot having a plurality of parking spaces and a video processing device are connected so as to be communicable, wherein the camera captures an image captured from the parking lot. When repeatedly transmitting to the video processing device, the video processing device detects parking of a vehicle in any of the plurality of parking spaces based on the captured video sent from the camera, Analyzing information about the detected vehicle, determining whether parking of the detected vehicle is a violation parking that is not intended for visiting the facility having the parking lot, and information on the detected vehicle Provided is a parking monitoring system for displaying an analysis result and a determination result as to whether or not the parking is in violation on a monitor.

  Further, the present disclosure is a parking monitoring method in a parking monitoring system in which a camera and a video processing apparatus that are installed so as to be able to image a parking lot having a plurality of parking spaces are connected to be communicable, The captured image of the parking lot is repeatedly transmitted to the image processing device, and the image processing device parks the vehicle in any one of the plurality of parking spaces based on the imaged image sent from the camera. When the vehicle is detected, the information about the detected vehicle is analyzed, and it is determined whether the detected vehicle parking is a violation parking that is not intended for visiting the facility having the parking lot. There is provided a parking monitoring method for displaying on a monitor an analysis result of information on a vehicle that has been used and a determination result of whether or not the parking is in violation.

  In addition, the present disclosure is directed to the parking that is repeatedly sent from the camera to a video processing device that is a computer and is connected to be able to communicate with a camera installed so as to be able to image a parking lot having a plurality of parking spaces. When detecting parking of a vehicle in one of the plurality of parking spaces based on the received imaging image of the parking lot and receiving the captured image of the parking lot, the vehicle related to the detected vehicle Analyzing information, determining whether the detected parking of the vehicle is illegal parking not intended for visiting the facility having the parking lot, and analyzing the information about the detected vehicle A program for realizing the result and the step of displaying on the monitor the result of determination as to whether or not the parking is in violation is provided.

  According to the present disclosure, it is possible to monitor whether or not a vehicle is parked in the facility parking lot for an unauthorized purpose other than the facility visit, and it is possible to support the facility operator to efficiently operate the parking lot.

The figure which shows the example of an outline | summary of the parking monitoring system which concerns on Embodiment 1. FIG. Block diagram showing a hardware configuration example of a surveillance camera Block diagram showing a hardware configuration example of a PC Sequence diagram showing an operation procedure example of the parking monitoring system according to the first embodiment. The figure which shows the example of registration contents of a parking management table The figure which shows an example of the parking monitoring screen displayed on the display part of PC Sequence diagram showing an operation procedure example of the parking monitoring system according to the second embodiment The figure which shows an example of the search screen for searching a parking number order parking list The figure which shows an example of the search screen for searching a long-time parking list The figure which shows an example of the parking monitoring screen where the popup screen was displayed

  Hereinafter, an embodiment that specifically discloses a parking monitoring system and a parking monitoring method according to the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

(Embodiment 1)
FIG. 1 is a diagram illustrating a schematic example of a parking monitoring system 5 according to the first embodiment. The parking monitoring system 5 includes a plurality of monitoring cameras 10, a hub 50, a PC 30, a recorder 40, and a center server 70.

  Among the plurality of monitoring cameras 10, one monitoring camera 10 installed in the vicinity of the entrance in the store 8 has a posture (in other words, an optical axis direction of a built-in lens) by at least one of pan rotation and tilt rotation. ) And a PTZ (Pan Tilt Zoom) camera in which the zoom magnification can be changed by zoom processing. The surveillance camera 10 can image an arbitrary place in the store 8. Moreover, the other surveillance camera 10 can image the whole area of the parking lot 100 in front of the store through the automatic glass door disposed at the entrance of the store 8 or directly when the automatic glass door is opened.

  The parking lot 100 in front of the store 8 has, for example, four parking spaces. In FIG. 1, the parking space numbers are set to 1, 2, 3, 4 from the left side. In FIG. 1, vehicles c1, c2, and c4 are parked in the parking spaces of numbers 1, 2, and 4, respectively. Here, the surveillance camera 10 which is a PTZ camera changes the angle of view SA and images the parking lot 100 in front of the store. Furthermore, the surveillance camera 10 changes the pan angle, the tilt angle, and the zoom magnification, changes the field angle SA of the home position from the field angle SA1, SA2, SA4, and the rear part (or front part) of the vehicles c1, c2, c4. Can be enlarged and imaged. Moreover, the monitoring camera 10 changes the angle of view and images the inside of the store 8. The surveillance camera may be provided separately for a fixed camera that images the parking lot in front of the store and a fixed camera that images the inside of the store.

  The hub 50 collects the communication cables of the plurality of monitoring cameras 10 and the communication cable of the PC 30 and connects them to each other so that data communication is possible. The hub 50 may be connected to an external device such as a multifunction peripheral. When the number of monitoring cameras is one, the monitoring cameras may be directly connected to the PC, and in this case, the hub may be omitted.

  The recorder 40 records a captured image captured by the monitoring camera 10 in accordance with an instruction from the PC 30, reproduces the recorded captured image, and outputs it to the PC 30. The PC 30 displays the playback video output from the recorder 40. Further, the PC 30 can display the captured video output from the monitoring camera 10 in real time without recording it in the recorder 40.

  The PC (personal computer) 30 is a computer installed in the backyard of the store 8, for example. The PC 30 is connected to the monitoring camera 10 by wire or wirelessly, and determines whether or not there is illegal parking in the parking lot 100 based on a captured image captured by the monitoring camera 10 (hereinafter sometimes simply referred to as “image”). Analyze and display the analysis result superimposed on the video. The PC 30 is connected to the center server 70 via the network NW, and transmits the video captured by the monitoring camera 10 and information related to illegal parking to the center server 70 in association with each other.

  The center server 70 has the same internal configuration of the computer device as that of the PC 30 (see FIG. 3), further includes a monitor 71 and a storage 72, and the captured image transmitted from the PC 30 and information on illegal parking are displayed on the monitor 71. It is displayed and stored in the storage 72.

  FIG. 2 is a block diagram illustrating a hardware configuration example of the monitoring camera 10. The surveillance camera 10 as an example of the camera includes a CPU 11, a storage unit 12, an imaging unit 13, a video processing unit 14, a communication unit 15, a pan / tilt driving unit 16, an acceleration sensor 18, and an IR irradiation unit 19. It is the structure containing these.

  The pan / tilt drive unit 16 drives the imaging unit 13 in the pan direction and the tilt direction, and includes a tilt control unit 21, a pan control unit 22, a tilt motor 23, and a pan motor 24. The tilt control unit 21 controls the rotation angle of the tilt motor 23. The pan control unit 22 controls the rotation angle of the pan motor 24.

  The acceleration sensor 18 outputs a signal corresponding to the posture of the monitoring camera 10 (for example, the pan angle and tilt angle that determine the optical axis direction of the lens). The CPU 11 controls the attitude of the monitoring camera 10 based on the signal output from the acceleration sensor 18. As the acceleration sensor 18, for example, a semiconductor type using a semiconductor piezoresistive effect or a mechanical type that opens and closes a movable contact and a fixed contact by a rotating mass body is used.

  The imaging unit 13 includes a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) as an imaging device. The imaging unit 13 includes a focus lens that can adjust the focal length, a zoom lens that can change the zoom magnification, and a gain adjustment unit that can adjust the sensitivity of the imaging device.

  The video processing unit 14 performs various types of signal processing such as AD conversion, color correction, noise removal, and contour enhancement on the data signal of the captured video captured by the imaging unit 13.

  The storage unit 12 stores parameters (pan angle, tilt angle, zoom magnification) of the monitoring camera 10 as preset values. Here, the attitude of the surveillance camera 10 having an angle of view that allows the imaging unit 13 to image four parking spaces in the parking lot 100 as the imaging area is the home position. A parameter corresponding to the home position of the monitoring camera 10 is stored in the storage unit 12 as a preset value.

  The storage unit 12 includes, for example, a RAM (Random Access Memory) and a ROM (Read Only Memory), and temporarily stores programs and data necessary for executing the operation of the monitoring camera 10, information or data generated during the operation, and the like. save. The RAM is a work memory used when the CPU 11 operates, for example. The ROM stores a program and data for controlling the CPU 11 in advance, for example.

  The CPU 11 controls the operation of each unit of the monitoring camera 10. The CPU 11 functions as a control unit of the monitoring camera 10, performs control processing for overall control of operations of each unit of the monitoring camera 10, data input / output processing with each unit of the monitoring camera 10, and data calculation ( Calculation) processing and data storage processing are performed. The CPU 11 operates according to the execution of the program stored in the ROM in the storage unit 12. CPU11 reads the preset value memorize | stored in the memory | storage part 12, and controls the attitude | position of the monitoring camera 10 to the position corresponding to a preset value based on the signal output from the acceleration sensor 18. FIG. The CPU 11 transmits captured image data captured by the imaging unit 13 and subjected to signal processing by the video processing unit 14 to the PC 30 via the communication unit 15.

  The communication unit 15 is communicably connected to the PC 30 via a wired LAN (Local Area Network). Note that the communication unit may be communicably connected to the PC via a wireless LAN.

  The IR irradiation unit 19 irradiates the parking lot 100 in front of the store 8 with near infrared light (IR (infrared radiation) light). Thereby, the imaging part 13 can image each parking space of the parking lot 100 also at night. Here, a case has been shown in which IR light that is a non-visible light is radiated at a long distance, and the visible light may be irradiated instead of the IR light that is non-visible light.

  FIG. 3 is a diagram illustrating a hardware configuration example of the PC 30. The PC 30 operates as a video processing apparatus and includes a processor 31, a memory 32, a display unit 33, an operation unit 34, a recording unit 35, an input / output I / F 36, a communication I / F 37, and a speaker 38.

  The processor 31 is configured by using, for example, a central processing unit (CPU), a digital signal processor (DSP), or a field programmable gate array (FPGA), and controls the operation of each unit of the PC 30. The processor 31 functions as a control unit of the PC 30, performs control processing for overall control of operations of each unit of the PC 30, data input / output processing with each unit of the PC 30, data calculation (calculation) processing, and data The storage process is performed. The processor 31 operates according to programs and data stored in the memory 32.

  The memory 32 is configured by using, for example, a RAM and a ROM, and temporarily stores programs and data necessary for executing the operation of the PC 30, and information or data generated during the operation. The RAM is a work memory used when the processor 31 operates, for example. The ROM stores in advance a program and data for controlling the processor 31, for example.

  The display unit 33 (an example of a monitor) is configured using, for example, an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence), and displays a captured image captured by the monitoring camera 10, a search screen, or the like. The operation unit 34 is configured by, for example, a keyboard or a mouse, or a combination thereof, and receives an input operation by an administrator. The recording part 35 records the data regarding a parked vehicle other than temporarily recording the image | video imaged with the monitoring camera 10. FIG. Data on the parked vehicle is stored in the recording unit 35 as a parking management table Tb1 (see FIG. 5).

  A recorder 40 is connected to the input / output I / F (interface) 36. Note that the recorder 40 that records and reproduces video may be built in the PC 30. In this case, the PC 30 includes a large-capacity storage and video recording / playback software as the recorder 40.

  The communication I / F 37 is connected to the hub 50 and performs data communication with the plurality of monitoring cameras 10 connected to the hub 50. The speaker 38 emits a sound or the like that calls an administrator when the parking violation is determined.

  Next, an operation example of the parking monitoring system 5 according to the first embodiment will be described.

  FIG. 4 is a sequence diagram illustrating an example of an operation procedure of the parking monitoring system 5 according to the first embodiment. When the posture of the monitoring camera 10 is in the home position, the imaging unit 13 of the monitoring camera 10 faces the parking lot 100 in front of the store 8, and the angle of view SA of the imaging unit 13 is 4 provided in the parking lot 100. Including parking space for vehicles. The imaging unit 13 repeatedly images the parking lot 100 at a predetermined timing in accordance with an instruction from the CPU 11 (T1). Examples of the predetermined timing include a fixed time interval, a predetermined fixed time, a timing at which vehicle parking is detected, and the like. Whenever the image is repeatedly captured by the image capturing unit 13, the communication unit 15 transmits the image captured by the image capturing unit 13 to the PC 30 via the wired LAN (T2).

  The processor 31 of the PC 30 performs image processing including parking determination, vehicle type determination, and driver tracking based on the captured video received from the monitoring camera 10 via the communication I / F 37 (T3). The vehicle type is a convenient vehicle type based on the outer shape of the vehicle body, and is classified into, for example, a light vehicle, a normal vehicle, a large vehicle, and the like. The vehicle type may be classified in more detail such as a sedan, a hard top, a coupe, a station wagon, and the like.

  In the parking determination, the processor 31 determines that the vehicle is parked when there is an image (vehicle image) representing the vehicle in the image area corresponding to the parking space in the captured image of the monitoring camera 10. The presence / absence of a vehicle image is determined by whether or not the vehicle features are included in this image area. For example, if the image area includes a square frame corresponding to a window and a pair of frames corresponding to a headlamp or a tail lamp at the lower left and right of the image area, the vehicle features are included.

  In the vehicle type determination, the processor 31 performs template matching between a reference image of a vehicle having a vehicle type registered in advance and an image captured by the monitoring camera 10. The processor 31 determines the vehicle type when the similarity of the feature amount is high in the template matching. The processor 31 sets a frame (see frames w1, w3, and w4 in FIG. 6) surrounding the vehicle image whose vehicle type is determined, and moves the frame in accordance with the movement of the vehicle image.

  In driver tracking, the processor 31 performs template matching between a reference image of a person registered in advance and an image captured by the monitoring camera 10. The processor 31 determines a person when the similarity of feature amounts is high in template matching. The processor 31 sets a frame surrounding the person image for which the person is determined, and moves the frame in accordance with the movement of the person image.

  In the first embodiment, the processor 31 determines the vehicle and person in the image by template matching. However, the processor 31 may determine the vehicle and person in the image using artificial intelligence. For example, the processor 31 generates a learned model based on accumulated learning data of a vehicle image or a person image by machine learning such as deep learning, inputs a captured image to the learned model, and outputs it as an output. The presence or absence of the target may be determined, and a frame surrounding the target may be set.

  When it is determined that the vehicle is parked in the parking space as a result of the parking determination, the processor 31 transmits a new preset value to the monitoring camera 10 via the communication I / F 37 and instructs to change the attitude ( T4). The new preset value includes a pan angle, a tilt angle, and a zoom magnification in which the angle of view is set so that an image of the lower part of the rear (or front part) of the vehicle parked in the parking space can be captured.

  The CPU 11 of the monitoring camera 10 receives the preset value via the communication unit 15, and the tilt control unit 21 and the pan control unit 22 so that the attitude of the monitoring camera 10 becomes the tilt angle and the pan angle included in the preset value. Is controlled (T5). Further, the CPU 11 controls the imaging unit 13 so that the angle of view of the monitoring camera 10 becomes a zoom magnification included in the preset value. Thereby, the imaging part 13 can expand and image the license plate of the vehicle stopped in the parking space. The CPU 11 transmits the video imaged by the imaging unit 13 to the PC 30 via the communication unit 15 (T6).

  The processor 31 of the PC 30 determines the vehicle number written on the license plate based on the video transmitted from the monitoring camera 10 via the communication I / F 37 (T7). When determining the vehicle number, the processor 31 performs image processing such as edge enhancement processing on the image including the enlarged license plate, and extracts an image of the vehicle number. The processor 31 performs template matching based on the extracted number image of the vehicle number and the number image registered in the memory 32 in advance. That is, the processor 31 calculates the similarity of the feature amounts included in the respective number images, and specifies the number when these similarities are high. Note that the processor 31 is not limited to template matching, as in the case of a vehicle or a person, and may specify a number using artificial intelligence. For example, the processor 31 generates a learned model based on accumulated learning data of number images by machine learning such as deep learning, inputs a number image to the learned model, and specifies a number as an output thereof May be.

  The processes in steps T4 to T7 are repeated for the number of parking spaces. In this case, when receiving the captured image from the monitoring camera 10 in step T6, the PC 30 transmits the next preset value to the monitoring camera and waits for reception of the next captured image.

  After all the vehicle numbers have been determined, the processor 31 transmits the home position preset value to the monitoring camera 10 via the communication I / F 37 and instructs the monitoring camera 10 to return the posture to the initial value. (T8).

  The processor 31 determines whether there is illegal parking (T9). The violation parking is determined by whether or not the vehicle whose vehicle number is specified is longer than a certain time. That is, the processor 31 records the start time at which the vehicles having the same vehicle number are parked, and the time from the parking start time to the current or parking end time is a predetermined threshold or longer (for example, 20 minutes) or more. If it is, it is determined that the parking is illegal. The fixed time can be set to an arbitrary time. For example, the manager who manages the parking lot may change the fixed time to a value such as 5 minutes, 30 minutes, 1 hour or the like according to the situation.

  In addition, the processor 31 determines that the driver of the vehicle parked in the parking space does not go to the store side after getting off, that is, the driver's trajectory does not go to the store entrance side but goes to the opposite side. If it is, it may be determined that the parking is illegal. Further, the processor 31 may determine that the parking is in violation if the driver of the vehicle parked in the parking space does not get off the vehicle and stays in the vehicle as it is. For example, the driver may be taking a nap in the car or eating a bento without bringing it to the store. In this case, the processor 31 may determine that there is no driver's trajectory (that is, a flow line) and that there is no trajectory, and that it is illegal parking. In addition, the processor 31 determines that the driver of the vehicle parked in the parking space does not enter the store, smokes in front of the trash box installed near the entrance, or hangs out with several people. If it is, it may be determined that the parking is a violation.

  As described above, in the violation parking determination according to the first embodiment, the processor 31 may determine the violation parking when the driver of the vehicle parked in the parking space does not enter the store after getting off. Therefore, the processor 31 can determine violation parking even when parking for a short time of about 5 minutes instead of parking for a long time by using the trajectory (that is, the flow line) of the driver. In this case, the violation parking is determined based on the driver's trajectory.However, when an occupant other than the driver gets off the vehicle, the violation parking is determined based on the passenger's trajectory as well as the driver's trajectory. It may be done.

  The processor 31 transmits the violation parking information including the determination result of the violation parking to the center server 70 (T10). This violating parking information includes information on vehicles that are parked in violation, as well as information on vehicles that are parked normally, such as a vehicle that has not parked in violation, that is, a driver enters a store and purchases a product. When the violation parking information is transmitted to the center server 70, the parking monitoring system 5 returns to the process of the procedure T1.

  Note that the violation parking determination process in step T <b> 9 may be performed by the center server 70. In this case, the center server 70 receives an image captured by the monitoring camera 10 directly or via the PC 30 and makes a determination based on the received image.

  FIG. 5 is a diagram illustrating an example of registered contents of the parking management table Tb1. The processor 31 of the PC 30 updates the contents of the parking management table Tb1 accumulated in the recording unit 35 after determining whether or not there is a violation parking in step T9. In the parking management table Tb1, the history of parking information is registered in time series. As an example, the parking information includes items of a number, parking start time, parking time, vehicle type, driver information, number, number of parkings, and long-time parking (for example, 30 days). In FIG. 5, in the parking space of number 1, number: 1, parking start time: 18/02/20 18:00, parking time: 1 minute, vehicle type: ordinary car, driver information: entrance, number: A1-11 Parking number: 5 times, long time parking: 0 times are registered. In the parking space of No. 2, the number, parking start time, parking time, vehicle type, driver information, and vacant number are registered.

  In the parking space of number 3, number: 3, parking start time: 18/02/20 16:00, parking time: 120 minutes, vehicle type: ordinary car, driver information: other than entering the store, number: B1-12, number of parking : 20 times, long parking: 19 times are registered. Here, since the parking time 120 exceeds a certain time (for example, 20 minutes), the vehicle parked at the number 3 violates parking. Information relating to a vehicle that is in violation of parking is registered in such a manner that the character color is set to red (see the hatching in FIG. 5) and is identifiable. In the parking space of number 4, number: 4, parking start time: 18/02/20 17:50, parking time: 10 minutes, vehicle type: ordinary car, driver information: entry, number: C1-13, number of parking: 10 times, long parking: 0 times are registered.

  As described above, the processor 31 accumulates in the recording unit 35 the parking management table Tb1 in which the number of long-time parkings and information such as the vehicle number are associated with each other for 30 days (an example of a predetermined number of days). Here, the parking management table Tb1 is stored in the recording unit 35 of the PC 30, but may be stored in the storage 72 of the center server 70 when the center server 70 performs the violation parking determination.

  FIG. 6 is a diagram illustrating an example of the parking monitoring screen GM1 displayed on the display unit 33 of the PC 30. As illustrated in FIG. When the administrator performs a predetermined operation on the PC 30, the display unit 33 displays the parking monitoring screen GM1. The processor 31 of the PC 30 updates the display content of the parking monitoring screen GM1 after updating the parking management table Tb1 stored in the recording unit 35 after determining the presence or absence of illegal parking in step T9.

  The parking monitoring screen GM1 includes a camera display region r1 for identifying a monitoring camera for each store, a video display region r2 for displaying a captured video GZ1 by the monitoring camera 10, and a parking status display region r3 for displaying the current parking status. . The monitoring camera 10 installed at the entrance of the store 8 takes an image so that the entire area of the parking lot 100 can be seen from above.

  In the video display region r2, a captured video GZ1 that is a live video captured by the monitoring camera 10 is displayed. In the captured image GZ1, in addition to the parking lot 100, a part of the store 8 is shown on the front side and a part of a building (for example, a museum) is shown on the back side. In the parking lot 100, vehicles c1, c3, and c4 are parked in the parking spaces with numbers 1, 3, and 4. The number 2 parking space is empty. In addition, frames w1, w3, and w4 drawn so as to surround the vehicle parked in the parking spaces of numbers 1, 3, and 4 are superimposed on the captured video GZ1 and displayed on the display unit 33. Further, trajectories tr1, tr3, tr4 (an example of flow line information) traveled by the drivers getting off from the vehicles c1, c3, c4 are displayed superimposed on the captured image GZ1. In addition, the captured image GZ1 shows the appearance of the driver hm1 who gets off the vehicle c1 and enters the store 8. The trajectories tr1 and tr4 of the drivers of the vehicles c1 and c4 are all directed toward the entrance of the store 8.

  On the other hand, the trajectory tr3 of the driver of the vehicle c3 is toward the entrance of the building on the opposite side of the store 8. That is, the vehicle c3 parked at the number 3 is a vehicle that is intended for a purpose other than entering the store 8 and illegally parked. The driver's trajectory tr3 is superimposed on the captured image and displayed in an identifiable manner on the display unit 33, so that illegal illegal parking is performed and the driver moves for purposes other than entering the store 8 so that the presence of the driver is conspicuous. Become.

  Further, referring to the contents of the parking management table Tb1, the number of parking of the vehicle c3 (number: B1-12) in the past 30 days is 20 times. Among them, 19 parking is a long time. This vehicle c3 is clearly a habitual vehicle for parking violation. In the parking management table Tb1 displayed on the parking monitoring screen GM1, it is highlighted that the vehicle is a violation vehicle, so that the administrator can easily identify the vehicle. In addition, in the captured image GZ1, a frame w3 surrounding the vehicle c3 is highlighted in red so that the administrator can easily identify it.

  Here, the driver's trajectory is superimposed on the captured image. However, when an occupant other than the driver gets off, the occupant's trajectory may also be displayed in a superimposed manner, like the driver's trajectory. Moreover, although the period which counts the frequency | count of parking and the number of times of a long parking period showed the past 30 days as an example of a statistics period, it may be set not only in this period but in arbitrary periods. The parking monitoring screen GM1 is displayed on the display unit 33 of the PC 30, but may be displayed on the display unit of the center server 70.

  As described above, in the parking monitoring system 5 according to the first embodiment, the monitoring camera 10 and the PC 30 (an example of a video processing device) installed so as to be able to image the parking lot 100 having a plurality of parking spaces are connected to be communicable. The The monitoring camera 10 repeatedly transmits captured images of the parking lot 100 to the PC 30. When the PC 30 detects parking of a vehicle in any one of a plurality of parking spaces, based on the captured image sent from the monitoring camera 10, the PC 30 analyzes information on the detected vehicle. The PC 30 determines whether or not the detected parking of the vehicle is a violation parking that is not intended for entering the store 8 (an example of the facility) having the parking lot 100 (an example of the visit). PC30 displays the analysis result of the information regarding the detected vehicle, and the determination result whether it is violation parking or not on display unit 33 (an example of a monitor).

  Thereby, since the parking monitoring system 5 can monitor whether or not the vehicle is parked in the parking lot 100 for an unauthorized purpose other than entering the store 8, the operator of the facility efficiently operates the parking lot. Can help.

  Further, the PC 30 further analyzes the detected trajectories tr1, tr3, tr4 (an example of flow line information) of the vehicle driver based on the captured image sent from the monitoring camera 10. PC30 determines whether it is violation parking based on the analysis result of locus | trajectory tr1, tr3, tr4. Thereby, PC30 can use a driver's locus for judging whether it is violation parking. Therefore, the PC 30 can obtain the confirmation in the case of an illegal violation parking where the flow line of the driver does not directly face the store 8. Moreover, even if PC30 is short-time parking for about 5 minutes, the administrator can be sure that it is violation parking. Further, the PC 30 can determine that the parking is illegal even when there is no driver's trajectory (traffic line).

  Further, the PC 30 has a parking period from a parking start time to a parking end time of a vehicle parked in any parking space based on the captured image sent from the monitoring camera 10 for a certain time (an example of a predetermined threshold) or more. If it is determined, it is determined that the parking is a violation. Accordingly, the PC 30 can compare the period from the parking start time to the parking end time with a certain time in order to determine whether or not the parking is a violation. Therefore, the PC 30 can easily detect a violation vehicle that has been parked for a long time.

  Further, the PC 30 displays the captured image sent from the monitoring camera 10 on the display unit 33 (an example of a monitor). Thereby, the PC 30 can display the live video on the display unit 33. Administrators can respond to violation parking reliably and quickly by watching live video.

  Further, the PC 30 superimposes the driver trajectories tr1, tr3, tr4 on the captured image and displays them on the display unit 33. Thereby, the supervisor who is the manager or the employee of the store 8 can grasp the parking purpose of the driver. The administrator can take various actions as necessary (for example, reporting to a nearby police station).

  Further, the PC 30 displays the trajectory tr1, tr3, tr4 of the driver of the vehicle determined to be in violation parking on the display unit 33 so as to be identifiable on the captured image. Thereby, the PC 30 can superimpose and display the trajectories tr1, tr3, tr4 of the driver who has performed illegal parking on the live video. Administrators can instantly understand driver behavior.

  In addition, the PC 30 parks a long time (an example of a time equal to or greater than a predetermined threshold) for 30 days (an example of a predetermined number of days) for 30 days (an example of a predetermined number of days) as a result of analyzing information on a vehicle parked in any of a plurality of parking spaces. Parked vehicle data (an example of parked vehicle information) associated with the number of times is registered in the parking management table Tb1 and recorded in the recording unit 35. Thereby, PC30 can judge easily whether it is a customary vehicle of violation parking.

(Embodiment 2)
In the first embodiment, the case where illegal parking is detected is shown in which parking is performed for a long time or parking is not performed for the purpose of entering the store. In the second embodiment, an example will be described in which an administrator is immediately notified that a parking violation customary vehicle has been parked. An example in which a violating vehicle is searched will also be described.

  The parking monitoring system according to the second embodiment has substantially the same configuration as the parking monitoring system according to the first embodiment. About the same component as Embodiment 1, the description is abbreviate | omitted by using the same code | symbol. Note that the PC 30 may include a CPU (not shown) dedicated to search processing, which will be described later, in addition to the processor 31 that controls the overall operation.

  FIG. 7 is a sequence diagram illustrating an example of an operation procedure of the parking monitoring system 5 according to the second embodiment. Since steps T1 to T10 in the second embodiment are the same steps as those in the first embodiment, the description thereof is omitted by giving the same numbers.

  When the processor 31 of the PC 30 performs the parking determination, the vehicle type determination, and the driver tracking process in step T3, for example, a search screen that can be operated by the manager is displayed on the display unit 33, triggered by the presence of a parked vehicle (see FIG. T11). Note that the administrator may display the search screen regardless of the above process executed by the processor 31, that is, asynchronously.

  FIG. 8 is a diagram illustrating an example of a search screen GM2 for searching a parking list in order of the number of parking times. The search screen GM2 includes a camera display area r4 for specifying a surveillance camera for each store, a key display area r5 for the search key sk, and a search result display area r6. The search key sk is a soft key displayed on the screen as a part of the operation unit 34.

  The processor 31 starts a search when the administrator presses the search key sk on the search screen GM2 displayed on the display unit 33. The search target is data relating to the parked vehicle registered in the parking management table Tb1 shown in FIG. The search key sk can select any of the search conditions developed in the pull-down menu. As a search condition, the order of the number of parking times, a long-time parking list, and the like can be selected. It is also possible to select an AND search for these conditions as a search condition. In addition, as detailed search conditions, it is possible to narrow down the conditions by adding a parking time zone, a vehicle type, and the like.

  FIG. 8 shows a case where “order of parking number” is selected as the search key sk. In the search result display area r6, the number of parking times (30 days), the number, and the vehicle type are displayed in a list in descending order of the number of parking times. For example, in the first line, the number of parking times: 30 times, the number: D1-14, and the vehicle type: normal are displayed. In the second line, the number of parking times: 25, the number: E1-15, and the vehicle type: normal are displayed. In this search, a parked vehicle is extracted based on the number of parkings, so that both the illegally parked vehicle and the regular parked vehicle are reflected in the search result.

  FIG. 9 is a diagram illustrating an example of a search screen GM3 for searching a long-time parking list. Similar to the search screen GM2, the search screen GM3 includes a hit notification area r7 in addition to the camera display area r4 for specifying the surveillance camera for each store, the key display area r5 for the search key sk, and the search result display area r6. The hit notification area r7 is displayed adjacent to the search result display area r6. The hit notification area r7 includes a check box cb corresponding to each row of the long-time parking list displayed in the search result display area r6.

  The processor 31 starts a search when the administrator presses the search key sk on the search screen GM3 displayed on the display unit 33. As a search condition input to the search key sk, FIG. 9 shows a case where a long-time parking list is selected. In the search result display area r6, the number of parkings (30 days), the number, and the vehicle type are listed in descending order of the number of long-time parkings. For example, the number of parkings: 25, number: F1-16, vehicle type: normal is displayed in the first line. In the second row, the number of parking times: 20 times, the number: B1-12, and the vehicle type: normal are displayed. The same applies to the third and subsequent lines.

  For example, the manager finds an addicted parking addicted vehicle from the long-time parking list, and puts a check mark in the check box cb on the hit notification screen corresponding to the vehicle. Thereby, when the applicable vehicle parks in the parking lot 100 after the next time, the processor 31 of the PC 30 displays a pop-up screen pg (see FIG. 10). Here, a check mark is entered for the vehicle having the number: B1-11. In the parking management table Tb1, the processor 31 sets a flag (an example of flag information) for the parked vehicle data in which the check mark is entered.

  In addition, after the vehicle number is determined in step T7, the processor 31 notifies the search-dedicated CPU of the vehicle number and inquires whether the parking is a violation parking (T12). The search-dedicated CPU searches the parking management table Tb1 registered in the recording unit 35 based on the vehicle number, and determines whether the vehicle is a violation vehicle with a flag set. If the flag is not a violation vehicle, the search-only CPU does not respond to the inquiry or returns OK. On the other hand, if it is a violating vehicle, the search-only CPU gives a pop-up notification to the processor 31 (T13). Upon receiving the pop-up notification, the processor 31 superimposes and displays the pop-up screen pg on the parking management screen GM4 (T14).

  FIG. 10 is a diagram illustrating an example of the parking management screen GM4 on which the pop-up screen pg is displayed. For example, when a vehicle having the number B1-12 enters the parking lot 100 of the store 8, a pop-up screen pg is displayed on the parking management screen GM4. The pop-up screen pg includes information related to the parked vehicle of “hit notification parking position 3 long-time parking: B1-12 (long-time parking 20 times)”. As a result, the manager can quickly notice, for example, that an addicted parking addicted vehicle has been parked in the parking space.

  In the second embodiment, by displaying the pop-up screen pg, the illegal parking of the registered vehicle is highlighted, but instead of the pop-up screen, a specific mark is displayed or the background of the parking management screen is displayed. It may be highlighted by changing the color or blinking. An alarm sound may be emitted simultaneously with the highlighting.

  Moreover, although the processor 31 of the PC 30 transmits the vehicle number to the CPU dedicated to search and inquires about the existence of the registered violating vehicle, the vehicle number may be transmitted to the center server 70 to inquire about the existence of the violating vehicle. In this case, the center server 70 uses the parking management table Tb1 accumulated in the storage 72 to determine whether there is a violating vehicle.

  As described above, in the parking monitoring system 5 according to the second embodiment, the flag specified by the operation of the administrator (an example of the user) is included in the parked vehicle data (an example of the parked vehicle information) registered in the parking management table Tb1. (An example of flag information) can be set (that is, recorded in association with each other). When the PC 30 detects that the vehicle whose flag is set in the parked vehicle data is parked in the parking space, the PC 30 highlights the information related to the detected vehicle on the display unit 33.

  Thereby, when the vehicle designated as the target of the hit notification is parked, the PC 30 can prompt the manager to call attention immediately. In addition, the PC 30 can create a database of illegally parked vehicles by extracting only the parked vehicle information in which the flag is set from a lot of parking management information registered in the parking management table Tb1. It becomes possible to adapt to the vehicle.

  While various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is obvious for those skilled in the art that various modifications, modifications, substitutions, additions, deletions, and equivalents can be conceived within the scope of the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure. In addition, the constituent elements in the various embodiments described above may be arbitrarily combined without departing from the spirit of the invention.

  For example, in Embodiments 1 and 2 described above, as an example of a facility where the parking monitoring system 5 is arranged, a parking lot of a store such as a convenience store of a small store or a supermarket is targeted. Furthermore, parking lots in facilities such as museums, movie theaters, and parks may be targeted.

  The present disclosure is also applicable to a program that realizes the function of the PC 30 of the above-described embodiment to a device via a network or various storage media, and that is read and executed by a computer in the device.

  The present disclosure provides a parking monitoring system that monitors whether or not a vehicle is parked in a facility parking lot for illegal purposes other than the facility visit, and supports the facility operator to efficiently operate the parking lot, It is useful as a parking monitoring method and program.

5 Parking monitoring system 10 Monitoring camera 11 CPU
DESCRIPTION OF SYMBOLS 12 Memory | storage part 13 Image pick-up part 14 Image | video process part 15 Communication part 16 Pan tilt drive part 18 Acceleration sensor 19 IR irradiation part 30 PC
31 Processor 32 Memory 33 Display Unit 34 Operation Unit 35 Recording Unit 36 Input / Output I / F
70 Center server 100 Parking lot

Claims (10)

A parking monitoring system in which a camera and a video processing device installed so as to be capable of imaging a parking lot having a plurality of parking spaces are connected to be communicable,
The camera
Repeatedly transmitting the captured image of the parking lot to the image processing device;
The video processing device includes:
Based on the captured image sent from the camera, when detecting the parking of the vehicle in any one of the plurality of parking spaces, analyze the information about the detected vehicle,
Determining whether the detected parking of the vehicle is a violation parking not intended for visiting the facility having the parking lot;
Displaying on the monitor the analysis result of the information about the detected vehicle and the determination result of whether or not it is the illegal parking;
Parking monitoring system. The video processing device includes:
Based on the captured image sent from the camera, further analyze the detected flow line information of the driver of the vehicle,
Based on the analysis result of the flow line information of the driver, it is determined whether the parking is in violation.
The parking monitoring system according to claim 1. The video processing device includes:
If the parking period from the parking start time to the parking end time of the vehicle parked in any of the parking spaces is determined to be greater than or equal to a predetermined threshold based on the captured image sent from the camera, the parking is in violation. To determine,
The parking monitoring system according to claim 1 or 2. The video processing device includes:
Further displaying the captured image sent from the camera on the monitor;
The parking monitoring system according to claim 2. The video processing device includes:
The driver's flow line information is superimposed on the captured image and displayed on the monitor.
The parking monitoring system according to claim 4. The video processing device includes:
The traffic line information of the driver of the vehicle determined to be the illegal parking is superimposed on the captured image and displayed on the monitor so as to be identifiable.
The parking monitoring system according to claim 5. The video processing device includes:
Recorded in the recording unit is the parked vehicle information in which the analysis result of the information related to the vehicle parked in any of the plurality of parking spaces and the number of times of parking in which a time equal to or greater than a predetermined threshold is parked in a predetermined number of days.
The parking monitoring system according to claim 1. The parked vehicle information is
The flag information specified by the user's operation is further recorded in association with it,
The video processing device includes:
When it is detected that a vehicle corresponding to the parked vehicle information having the flag information is parked in any of the plurality of parking spaces, information on the detected vehicle is highlighted on the monitor.
The parking monitoring system according to claim 7. A parking monitoring method in a parking monitoring system in which a camera and a video processing device installed so as to be capable of imaging a parking lot having a plurality of parking spaces are connected to be communicable,
The camera
Repeatedly transmitting the captured image of the parking lot to the image processing device;
The video processing device includes:
Based on the captured image sent from the camera, when detecting the parking of the vehicle in any one of the plurality of parking spaces, analyze the information about the detected vehicle,
Determining whether the detected parking of the vehicle is a violation parking not intended for visiting the facility having the parking lot;
Displaying on the monitor the analysis result of the information about the detected vehicle and the determination result of whether or not it is the illegal parking;
Parking monitoring method. To a video processing device, which is a computer, connected so as to be able to communicate with a camera installed so as to be able to image a parking lot having a plurality of parking spaces,
Receiving a captured image of the parking lot repeatedly sent from the camera;
Analyzing the information on the detected vehicle when detecting parking of the vehicle in any of the plurality of parking spaces based on the received captured image of the parking lot;
Determining whether the detected parking of the vehicle is a violation parking that is not intended for visiting the facility having the parking lot;
The step of displaying on the monitor the analysis result of the information on the detected vehicle and the determination result of whether or not it is the violation parking,
program.

Images