KR102559603B1 - Total security and parking guidance system including parking guidance display unit - Google Patents

Abstract

a parking guidance device for photographing a parking area by at least one camera unit and displaying a parking state in a forward direction in a predetermined parking area group; an AI server recognizing a parking situation of the parking area based on the photographed image received from the at least one camera unit and generating parking information of the parking guidance device; And an artificial intelligence parking guidance system including a management server for generating forward parking information of the parking guidance device in the predetermined parking area group based on the parking information of the parking guidance device received from the AI server is disclosed.

Description

Total security and parking guidance system with built-in parking guidance display device {TOTAL SECURITY AND PARKING GUIDANCE SYSTEM INCLUDING PARKING GUIDANCE DISPLAY UNIT}

The present invention relates to a parking guidance system, and more particularly, to a parking guidance device that integrally provides parking area shooting, parking area full display, and forward parking status display in a predetermined parking area group, based on the parking area photographed image. Parking guidance in a predetermined parking area group based on the parking information for each parking guidance device received from the AI server, which recognizes the parking situation of the parking area with artificial intelligence and generates parking information for each parking guidance device. It relates to a parking guidance system including a management server for generating forward parking information of a device.

In general, when the parking space occupancy rate in a parking facility is low, that is, when the parking space is sufficient, it is easy to identify an empty parking space so that a vehicle entering the parking lot can park easily. It is difficult to identify the space, so the driver has no choice but to wander around the parking lot or wait until the parking space is vacant.

In the conventional parking management system, since the driver has to find an empty parking space and park the vehicle while the vehicle has entered the parking lot, it not only takes excessive time, but also pollutes the air by exhaust gas because it travels slowly in the parking lot, and in a narrow space. Contact accidents, etc.

In addition, there is a limit in guiding the space of a wide parking lot even when a parking attendant is disposed, and when a plurality of guides are disposed, there is a problem in that parking management costs such as excessive labor costs increase.

Recent parking management systems use means for automatically displaying or guiding parking. For example, there is a method of checking the number of vehicles entering and exiting a predetermined block or floor and integrally displaying the number of available parking spaces. However, since this method is based on monitoring the number of entering and exiting vehicles, there is a problem in that accuracy is low. In addition, there is a method of guiding a parked vehicle by installing a sensor for recognizing the presence or absence of parking in each parking space and blinking a guide light installed at the rear of the parking space according to a signal from the sensor. However, in this method, the guide light is installed in a stand type at the rear of the parking space, so when the vehicle height is high, recognition is impossible or visibility is reduced. There is a problem that becomes an obstacle to doing.

The present invention has been devised to cope with the above-described technical problems, and an object of the present invention is to substantially supplement various problems caused by limitations and disadvantages in the prior art, parking area shooting, parking area full display And a parking guidance device that integrally provides a parking status display in a forward direction in a predetermined parking area group. Based on the photographed image of the parking area, the parking situation of the parking area is recognized by artificial intelligence and parking information for each parking guidance device is generated. It is to provide a parking guidance system including a generating AI server and a management server for generating forward parking information of a parking guidance device in a predetermined parking area group based on the parking information for each parking guidance device received from the AI server.

According to one embodiment of the present invention, the parking guidance system includes a parking guidance device for photographing a parking area by at least one camera unit and displaying a parking state in a forward direction in a predetermined parking area group; an AI server recognizing a parking situation of the parking area based on the photographed image received from the at least one camera unit and generating parking information of the parking guidance device; And a management server for generating forward parking information of the parking guidance device in the predetermined parking area group based on the parking information of the parking guidance device received from the AI server.

According to an embodiment of the present invention, the parking information of the parking guidance device is flag bit information indicating whether or not parking is performed on each of a predetermined number of left and right parking surfaces for the parking area in charge of the parking guidance device.

According to one embodiment of the present invention, the predetermined parking area group is set to a plurality of parking guidance device identifiers included in the predetermined parking area group and a forward sequence number within the group of each parking guidance device identifier.

According to an embodiment of the present invention, the forward parking information includes the number of empty parking surfaces in the predetermined parking area group in a forward direction based on the parking guidance device.

According to an embodiment of the present invention, the parking guidance device includes at least one camera unit for photographing the parking area; a fullness display unit displaying a full or empty state of the parking area; a forward direction display unit for displaying a forward parking state in the predetermined parking area group; And a control unit for controlling the full empty display unit based on the parking information of the parking guidance device obtained from the AI server and controlling the forward direction display unit based on the forward parking information of the parking guidance device obtained from the management server. do.

According to an embodiment of the present invention, the at least one camera unit includes a first camera unit for photographing a predetermined number of left parking surfaces of the parking area; a second camera unit for capturing a predetermined number of right parking surfaces among the parking areas; and a third camera unit for capturing a passage surface in the parking area.

According to an embodiment of the present invention, the at least one camera unit is a camera unit composed of one fish-eye lens; The parking area is photographed with the fish-eye lens, and the captured parking area image is divided into images of a left parking surface, a right parking surface, and a path surface, respectively.

According to one embodiment of the present invention, the parking state in the forward direction indicates whether there are vacant parking surfaces in the forward direction based on the parking guidance device in the predetermined parking area group, and indicates the number of vacant parking surfaces. including numbers, etc.

According to an embodiment of the present invention, the AI server includes a setting unit for setting the parking area for the parking guidance device; a recognizing unit recognizing a parking situation of the parking area based on a photographed image received from the at least one camera unit; and a parking information setting unit configured to set the parking information for each of the parking guidance devices.

According to an embodiment of the present invention, the recognizing unit recognizes a vehicle object based on the photographed image, and determines whether parking is performed on a parking surface related to the recognized vehicle object; The parking information setting unit sets the parking information of the corresponding parking guidance device based on the determination result.

According to an embodiment of the present invention, the management server includes a setting unit for setting the parking area for the parking guidance device and setting the predetermined parking area group; and a group parking information generator for generating the forward parking information of the parking guidance device in the predetermined parking area group based on the parking information for each of the parking guidance devices received from the AI server.

According to an embodiment of the present invention, the parking guidance system includes an image storage server for acquiring and storing a photographed image from a corresponding camera unit of the parking guidance device for photographing the changed parking area when the parking situation of the parking area is changed. contains more

According to an embodiment of the present invention, the AI server further includes a parking situation change event determination unit for determining a parking situation change event of the parking area; The management server further includes a video storage server interface unit for transmitting a centralized recording request to the video storage server based on the parking situation change event obtained from the AI server; The video storage server includes a recording request receiving unit that receives the centralized recording request from the management server, an image receiving unit that acquires a captured image from a corresponding camera unit of the parking guidance device that photographs the changed parking area, and stores the captured image. It includes a storage unit that

According to an embodiment of the present invention, the parking situation change event determining unit determines that the parking situation change event occurs when the parking information of the parking guidance device is changed by the recognizing unit; The AI server further includes a parking situation change event transmission unit that transmits the parking situation change event including the camera unit identifier of the parking guidance device in which the parking information is changed to the management server.

According to an embodiment of the present invention, the parking guidance device further displays a reverse parking state in the predetermined parking area group; the management server further generates reverse parking information of the parking guidance device in the predetermined parking area group; The predetermined parking area group is set to a plurality of parking guidance device identifiers included in the predetermined parking area group, a forward sequence number within a group of each parking guidance device identifier, and a reverse sequence number within a group of each parking guidance device identifier. become; the forward parking information includes the number of vacant parking surfaces in the predetermined parking area group in a forward direction based on the parking guidance device; The reverse direction parking information includes the number of empty parking surfaces in the reverse direction based on the parking guidance device in the predetermined parking area group.

According to an embodiment of the present invention, the parking guidance device includes at least one camera unit for photographing the parking area; a fullness display unit displaying a full or empty state of the parking area; a forward direction display unit for displaying a forward parking state in the predetermined parking area group; a reverse direction display unit displaying a reverse parking state in the predetermined parking area group; And controlling the full empty display unit based on the parking information of the parking guidance device obtained from the AI server, controlling the forward direction display unit based on the forward parking information of the parking guidance device obtained from the management server, and controlling the management and a controller for controlling the reverse direction display unit based on the reverse parking information of the parking guidance device obtained from the server.

According to one embodiment of the present invention, the parking state in the forward direction indicates whether there are vacant parking surfaces in the forward direction based on the parking guidance device in the predetermined parking area group, and indicates the number of vacant parking surfaces. contain numbers and the like; The parking state in the reverse direction includes a direction light indicating whether there is an empty parking surface in the predetermined parking area group in a reverse direction based on the parking guidance device and a number indicating the number of empty parking surfaces.

According to an embodiment of the present invention, the management server includes a setting unit for setting the parking area for the parking guidance device and setting the predetermined parking area group; And a group parking information generator for generating the forward parking information and the reverse parking information of the parking guidance device in the predetermined parking area group based on the parking information for each of the parking guidance devices received from the AI server. do.

In addition, according to an embodiment of the present invention, the parking guidance device includes at least one camera unit for photographing a parking area in charge; a fullness display unit displaying a full or empty state of the parking area; a forward direction display unit for displaying a forward parking state in a predetermined parking area group; and a control unit controlling the mangong display unit and the forward direction display unit.

According to an embodiment of the present invention, the at least one camera unit includes a first camera unit for photographing a predetermined number of left parking surfaces of the parking area; a second camera unit for capturing a predetermined number of right parking surfaces among the parking areas; and a third camera unit for capturing a passage surface in the parking area.

According to an embodiment of the present invention, the at least one camera unit is a camera unit composed of one fish-eye lens; The parking area is photographed with the fish-eye lens, and the captured parking area image is divided into images of a left parking surface, a right parking surface, and a path surface, respectively.

According to one embodiment of the present invention, the parking state in the forward direction indicates whether there are vacant parking surfaces in the forward direction based on the parking guidance device in the predetermined parking area group, and indicates the number of vacant parking surfaces. including numbers, etc.

According to one embodiment of the present invention, the predetermined parking area group is set to a plurality of parking guidance device identifiers included in the predetermined parking area group and a forward sequence number within the group of each parking guidance device identifier.

According to one embodiment of the present invention, the parking guidance device further includes a reverse display unit for displaying a reverse parking state in the predetermined parking area group; The control unit further controls the reverse direction display unit; The parking state in the reverse direction includes a direction light indicating whether there is an empty parking surface and a number indicating the number of empty parking surfaces in the predetermined parking area group in a reverse direction based on the parking guidance device; The predetermined parking area group is set to a plurality of parking guidance device identifiers included in the predetermined parking area group, a forward sequence number within a group of each parking guidance device identifier, and a reverse sequence number within a group of each parking guidance device identifier. do.

The artificial intelligence parking guidance system according to the present invention can integrally provide parking condition display in a forward direction in a predetermined parking area group as well as parking area shooting and parking area full display through a parking guidance device. Through this, not only whether the parking area is full or empty, but also whether or not it is possible to park in a forward direction in a predetermined parking area group and the number of parking spaces available for parking are displayed to the driver at the same time, so that efficient parking guidance is possible in a short time.

In addition, the artificial intelligence parking guidance system according to the present invention can provide parking guidance devices for parking status display in each of the forward and reverse directions in a predetermined parking area group as well as parking area shooting and parking area full display through the parking guidance device. Through this, not only whether the parking area is full or empty, but also whether or not parking is possible in the forward and reverse directions in a predetermined parking area group, and the number of parking surfaces available for parking are simultaneously displayed to the driver, so that efficient parking guidance is possible in a short time.

The artificial intelligence parking guidance system according to the present invention displays the parking area in the parking guidance device and displays the parking status in the forward direction or the parking status in the forward and reverse directions in a predetermined parking area group. Based on this, it is possible to determine more accurate and efficient parking guidance by recognizing a vehicle object with artificial intelligence, determining whether the vehicle object is parked on a parking surface, and generating parking information for each parking guidance device.

In addition, the artificial intelligence parking guidance system according to the present invention determines the event of changing the parking situation in the parking area due to the detection of vehicle entry and exit in the AI server, and the video storage server performs intensive recording before and after the event occurs, thereby enabling intensive recording A necessary parking situation change event can be determined more accurately and the storage space of the image storage server can be used more efficiently.

1 is a schematic configuration diagram of a parking guidance system according to an embodiment of the present invention.
Figure 2 is a schematic block diagram of a parking guidance device according to an embodiment of the present invention.
3 shows a schematic appearance and a shooting screen of a parking guidance device according to an embodiment of the present invention.
Figure 4 is a schematic block diagram of a parking guidance device according to another embodiment of the present invention.
5 shows a shooting screen of a parking guidance device according to another embodiment of the present invention.
6 schematically illustrates an artificial intelligence parking guidance method of a parking guidance system according to an embodiment of the present invention.
7 schematically illustrates a parking area full display procedure in a parking guidance device in a parking guidance system according to an embodiment of the present invention.
8 schematically illustrates a procedure for recognizing a parking situation of an AI server and generating parking information for each parking guidance device in a parking guidance system according to an embodiment of the present invention.
9 schematically illustrates a parking state display procedure in each of forward and reverse directions within a predetermined parking area group in a parking guidance system in a parking guidance system according to an embodiment of the present invention.
10 schematically illustrates a centralized recording procedure of a video storage server according to an AI server determining a parking situation change event in a parking guidance system according to an embodiment of the present invention.
11 is a schematic block diagram of an AI server according to an embodiment of the present invention.
12 is a schematic block diagram of a management server according to an embodiment of the present invention.
13 is a schematic block diagram of a video storage server according to an embodiment of the present invention.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals denote the same components, and the size of each component in the drawings may be exaggerated for clarity of explanation.

1 is a schematic configuration diagram of a parking guidance system according to an embodiment of the present invention.

Parking guidance system 100 according to an embodiment of the present invention includes a parking guidance device 110, an AI server 120, a management server 130 and an image storage server 140.

At least one parking guidance device 110 exists in a parking facility. The parking guidance device 110 photographs a parking area by at least one camera unit, and displays a parking state in a forward direction in a predetermined parking area group or a parking state in each of the forward and reverse directions. The parking guidance device 110 will be described later in more detail with reference to FIGS. 2 to 5 below.

The AI server 120 recognizes the parking situation of the parking area by artificial intelligence based on the captured image received from the at least one camera unit of the parking guidance device 110, and the parking information of each parking guidance device 110 set The parking information of the parking guidance device 110 refers to flag bit information indicating whether or not parking is performed for each of a predetermined number of left and right parking surfaces for a parking area in charge of the parking guidance device 110.

The management server 130 sets the predetermined parking area group, and the parking guidance apparatus 110 within the predetermined parking area group based on the parking information of each parking guidance apparatus 110 received from the AI server 120. ), or generate forward parking information and reverse parking information, respectively.

The predetermined parking area group is set to a plurality of parking guidance device identifiers included in the predetermined parking area group, and a forward sequence number within the group of each parking guidance device identifier. Alternatively, the predetermined parking area group includes a plurality of parking guidance device identifiers included in the predetermined parking area group, a forward sequence number within a group of each parking guidance device identifier, and a reverse sequence number within a group of each parking guidance device identifier. is set to The forward direction parking information includes the number of empty parking surfaces in the forward direction based on the parking guidance device 110 in the predetermined parking area group. The reverse direction parking information includes the number of empty parking surfaces in the reverse direction based on the parking guidance device 110 in the predetermined parking area group.

When the parking situation of the parking area is changed, the image storage server 140 acquires and stores a photographed image from a corresponding camera unit of the parking guidance device 110 that photographs the changed parking area.

The parking guidance device 110, the AI server 120, the management server 130 and the image storage server 140 are network-connected to each other through a communication network. In addition, each of the at least one camera unit of the parking guidance device 110 is network-connected to each other with the AI server 120, the management server 130 and the image storage server 140 through the communication network. It is apparent to those skilled in the art that communication technologies used for the network connection may vary.

The artificial intelligence parking guidance method of the parking guidance system 100 will be described later in detail with reference to FIGS. 6 to 10.

Figure 2 is a schematic block diagram of a parking guidance device according to an embodiment of the present invention. Figure 3 shows a schematic appearance and a shooting screen of a parking guidance device according to an embodiment of the present invention.

The parking guidance device 200 according to an embodiment of the present invention includes a control unit 210, a full display unit 220, a forward display unit 230, a first camera unit 250, a second camera unit 260, and a third A camera unit 270 is included. Parking guidance device 200 according to an embodiment of the present invention may further include a reverse direction display unit 240.

The first camera unit 250, the second camera unit 260, and the third camera unit 270 take pictures of the parking area covered by the parking guidance device 200. For example, as shown in FIG. 3 , the first camera unit 250 captures a predetermined number (eg, three) of left parking surfaces in the parking area. The second camera unit 260 photographs the right parking surface of a predetermined number (eg, three) of the parking area. The third camera unit 270 photographs the passage surface in the parking area.

Images captured by the first camera unit 250, the second camera unit 260, and the third camera unit 270, respectively, are recorded in the image storage server 140. According to an embodiment of the present invention, the AI server 120 obtains images taken from the first camera unit 250, the second camera unit 260, and the third camera unit 270, respectively, to determine the location of the parking area. A parking situation change event is determined, and the video storage server 140 through the management server 130 intensively records images taken before and after the corresponding parking situation change event from the camera unit related to the parking situation change event. Accordingly, it is possible to more accurately determine a parking situation change event requiring intensive recording and more efficiently utilize the storage space of the video storage server. According to an embodiment of the present invention, the first camera unit 250, the second camera unit 260, and the third camera unit 250, the second camera unit 260, and the third It can be selectively applied to the camera unit 270 . For example, the first camera unit 250 for photographing the left parking surface and the second camera for photographing the right parking surface for intensive recording of the video storage server 140 according to the judgment of the parking situation change event of the AI server 120 It can be selectively applied to section 260. In this case, the image captured by the third camera unit 270 for capturing the passage surface may be continuously recorded by the image storage server 140 or intensively recorded based on event determination in another method.

The control unit 210 controls the mangong display unit 220 and the forward direction display unit 230. Also, the control unit 210 may further control the reverse direction display unit 240 . Based on the parking information of the parking guidance device 200 obtained from the AI server 120, the control unit 210 controls the full display unit 220 to display the full or empty state of the parking area in a predetermined color. . The control unit 210 controls the forward direction display unit 230 to display the forward parking status in the predetermined parking area group based on the forward parking information of the parking guidance device 110 obtained from the management server 130. The control unit 210 controls the reverse direction display unit 240 to display the reverse parking state in the predetermined parking area group based on the reverse parking information of the parking guidance device 110 obtained from the management server 130.

The fullness display unit 220 displays the full or empty state of the parking area in a predetermined color under the control of the controller 210. For example, when all the parking surfaces of the parking area are full, a light of a preset color such as red light and green light when at least one parking surface is empty are displayed. Mangong display unit 220 may be located on the bottom surface of the parking guidance device 200, but it is obvious to those skilled in the art that it is not limited thereto. In addition, the mangong display unit 220 may include a left mangong display unit and a right mangong display unit. In this case, the left empty display unit displays the full or empty state of the left parking surface in the parking area in a predetermined color. The right empty display unit displays the full or empty state of the right parking surface in the parking area in a predetermined color.

The forward direction display unit 230 is controlled by the control unit 210 and displays a parking state in the forward direction in the predetermined parking area group. The parking state in the forward direction includes a direction light indicating whether there is an empty parking surface and a number indicating the number of empty parking surfaces in the forward direction based on the parking guidance device 200 in the predetermined parking area group.

The reverse direction display unit 240 is controlled by the control unit 210 and displays a reverse parking state in the predetermined parking area group. The parking state in the reverse direction includes a direction light indicating whether there is an empty parking surface and a number indicating the number of empty parking surfaces in the reverse direction based on the parking guidance device 200 in the predetermined parking area group.

Figure 4 is a schematic block diagram of a parking guidance device according to another embodiment of the present invention. 5 shows a shooting screen of a parking guidance device according to another embodiment of the present invention.

The parking guidance device 400 according to this embodiment includes a control unit 410, a mangong display unit 420, a forward direction display unit 430 and a camera unit 450. The parking guidance device 400 may further include a reverse direction display unit 440 . Operations of the control unit 410, the full hole display unit 420, the forward direction display unit 430, and the reverse direction display unit 440 are the same as in the embodiment described in FIG. 2 .

The camera unit 450 of the parking guidance device 400 according to this embodiment is a camera unit composed of one fish-eye lens. The camera unit 450 photographs the parking area with the fish-eye lens, and transmits the photographed parking area image 510 to the left parking surface 540, the right parking surface 550, and the passage surfaces 520 and 530, respectively. split into images

The image taken by the camera unit 450 is recorded in the image storage server 140 . According to an embodiment of the present invention, the AI server 120 determines a parking situation change event of the parking area by obtaining a divided image after being photographed by the camera unit 450.

6 schematically illustrates an artificial intelligence parking guidance method of a parking guidance system according to an embodiment of the present invention.

The management server 130 sets a predetermined parking area group 600 . The predetermined parking area group 600 is set to a plurality of parking guidance device identifiers included in the predetermined parking area group 600, a forward sequence number within the group of each parking guidance device identifier, or a predetermined parking area group 600 A plurality of parking guidance device identifiers included in ), each parking guidance device identifier within a forward sequence number, and each parking guidance device identifier within a group of a reverse sequence number. In the illustrated example, a plurality of parking guidance devices included in a predetermined parking area group 600 include a first parking guidance device 610, a second parking guidance device 620, a third parking guidance device 630, and a second parking guidance device 610. 4 includes a parking guidance device (640). The forward sequence number of the first parking guidance device 610 is 1, the reverse sequence number is 4, the forward sequence number of the second parking guidance device 620 is 2, the reverse sequence number is 3, and the third parking guidance device ( 630) has a forward sequence number of 3, a reverse sequence number of 2, and a fourth parking guidance device 640 has a forward sequence number of 4 and a reverse sequence number of 1.

The fullness display unit 220 of each parking guidance device displays the full or empty state of the parking area in charge in a predetermined color. Based on the parking information of the parking guidance device 200 obtained from the AI server 120, the control unit 210 controls the full display unit 220 to display the full or empty state of the parking area in a predetermined color. . For example, when all parking surfaces (eg, 3 left sides and 3 right sides) of the parking area in charge are full, a light of a preset color is displayed, such as red light and green light when at least one parking surface is empty. In the illustrated example, since all parking surfaces in the parking area in charge of the first parking guidance device 610 are full, the full display unit 220 of the first parking guidance device 610 displays red. The parking information of the parking guidance device 200 refers to flag bit information indicating whether or not parking is performed for each of a predetermined number of left and right parking surfaces for a parking area in charge of the parking guidance device 200. Specifically, the parking information of the parking guidance device 200 may be represented by a flag bit array of parking_flag_bits [the number of parking surfaces]. The parking_flag_bits [number of parking surfaces] array has sequential array indexes of the left first parking surface, the left second parking surface, the left third parking surface, the right first parking surface, the right second parking surface, and the right third parking surface. . For example, parking_flag_bits[6], which is parking information of the second parking guidance device 620, has a value of {1, 1, 0, 1, 0, 1}.

The forward direction display unit 230 of each parking guidance device displays the parking state in the forward direction in a predetermined parking area group 600 . The control unit 210 controls the forward direction display unit 230 to display the forward parking status in a predetermined parking area group 600 based on the forward parking information of the parking guidance device 200 obtained from the management server 130. do. The forward direction parking information includes the number of empty parking surfaces in the forward direction based on the parking guidance device 200. The forward parking state includes a direction light indicating whether there is an empty parking surface and a number indicating the number of empty parking surfaces in a forward direction based on each parking guidance device in a predetermined parking area group 600. . For example, the forward direction display unit 230 of the first parking guidance device 610 displays a green direction light indicating that there is an empty parking surface in the forward direction and a number light '7' indicating the number of empty parking surfaces. The forward direction display unit 230 of the third parking guidance device 630 displays a green direction light indicating that there is an empty parking surface in the forward direction and a number light '5' indicating the number of empty parking surfaces.

The reverse direction display unit 240 of each parking guidance device displays a parking state in the reverse direction in a predetermined parking area group 600 . The control unit 210 controls the reverse direction display unit 240 to display the reverse parking status in a predetermined parking area group 600 based on the reverse parking information of the parking guidance device 200 obtained from the management server 130. do. The reverse direction parking information includes the number of vacant parking surfaces in the reverse direction based on the parking guidance device 200. The parking state in the reverse direction includes a direction light indicating whether there is an empty parking surface and a number indicating the number of empty parking surfaces in the reverse direction based on each parking guidance device in a predetermined parking area group 600. . For example, the reverse direction display unit 240 of the third parking guidance device 630 displays '5', a green direction light indicating that there is an empty parking surface in the reverse direction and a number indicating the number of empty parking surfaces. The reverse display unit 240 of the first parking guidance device 610 displays 'X', a number indicating that there is no 'red X' direction light and an empty parking surface indicating that there is no empty parking surface in the reverse direction.

7 schematically illustrates a parking area full display procedure in a parking guidance device in a parking guidance system according to an embodiment of the present invention.

In step S610, the management server 130 sets the parking area and parking area group in charge of each parking guidance device. The parking area setting is set through a parking guidance device identifier (ID), at least one camera unit identifier (ID) of the parking guidance device, and parking area setting information indicating parking area information in charge of the parking guidance device. For example, if the parking guidance device is in charge of 6 parking surfaces and identifies each parking surface with the start/end (x,y) coordinates of the center line, the parking area information is the start/end of the 6 center lines. It can be represented by a set of (x,y) coordinates. The parking area group setting is a plurality of parking guidance device identifiers (IDs) included in a predetermined parking area group, a forward sequence number within a group of each parking guidance device identifier, and a reverse sequence number within a group of each parking guidance device identifier. is set

In step S620, the management server 130 transmits the parking area setting information to the AI server 120.

In step S630, the AI server 120 sets a parking area using the parking area setting information.

In step S640, the AI server 120 acquires a photographed image from at least one camera unit of each parking guidance device 110.

In step S650, the AI server 120 recognizes the parking situation of the parking area related to the captured image based on the captured image obtained in step S640, and sets parking information for each parking guidance device. The parking information of each of the parking guidance devices means flag bit information indicating whether or not parking is performed for each of a predetermined number of left and right parking surfaces for a parking area in charge. The specific operation of step S650 will be described later in detail with reference to FIG. 8 .

In step S660, the AI server 120 transmits the parking information to the parking guidance device 110.

In step S670, the parking guidance device 110 displays the full or empty state of the parking area in charge based on the parking information.

8 schematically illustrates a procedure for recognizing a parking situation of an AI server and generating parking information for each parking guidance device in a parking guidance system according to an embodiment of the present invention.

In step S810, the AI server 120 recognizes the vehicle object with artificial intelligence from the photographed image obtained in step S640. It is obvious to those skilled in the art that various algorithms including machine learning and deep learning can be used for vehicle object recognition.

In step S820, the AI server 120 determines whether to park for each vehicle object-related parking surface recognized in step S810. Specifically, it is possible to determine whether the parking surface is parked by determining whether the recognized vehicle object is matched to the center line of the related parking surface with a predetermined probability or more, but it is possible to use various other algorithms to those skilled in the art. self-explanatory

In step S830, the AI server 120 sets the parking information of the parking guidance device according to the determination result. The parking information of the parking guidance device means flag bit information indicating whether or not parking for each of a predetermined number of left and right parking surfaces for a parking area in charge.

9 schematically illustrates a parking state display procedure in each of forward and reverse directions within a predetermined parking area group in a parking guidance system in a parking guidance system according to an embodiment of the present invention.

In step S910, the management server 130 sets the parking area and parking area group in charge of each parking guidance device. The parking area setting is set through a parking guidance device identifier (ID), at least one camera unit identifier (ID) of the parking guidance device, and parking area setting information indicating parking area information in charge of the parking guidance device. For example, if the parking guidance device is in charge of 6 parking surfaces and identifies each parking surface with the start/end (x,y) coordinates of the center line, the parking area information is the start/end of the 6 center lines. It can be represented by a set of (x,y) coordinates. The parking area group setting is a plurality of parking guidance device identifiers (IDs) included in a predetermined parking area group, a forward sequence number within a group of each parking guidance device identifier, and a reverse sequence number within a group of each parking guidance device identifier. is set Alternatively, the parking area group setting may be set to a plurality of parking guidance device identifiers (IDs) included in a predetermined parking area group, and a forward sequence number within a group of each parking guidance device identifier (not shown).

In step S920, the management server 130 transmits the parking area setting information to the AI server 120.

In step S930, the AI server 120 sets a parking area using the parking area setting information.

In step S940, the AI server 120 acquires a photographed image from at least one camera unit of each parking guidance device 110.

In step S950, the AI server 120 recognizes the parking situation of the parking area related to the captured image based on the captured image obtained in step S940, and sets parking information for each parking guidance device. The parking information of each of the parking guidance devices means flag bit information indicating whether or not parking is performed for each of a predetermined number of left and right parking surfaces for a parking area in charge.

In step S960, the AI server 120 transmits the parking information of each parking guidance device to the management server 130.

In step S970, the management server 130 generates forward parking information and reverse parking information of each parking guidance device in the parking area group based on the parking information of each parking guidance device obtained in step S960. Alternatively, the management server 130 may generate forward parking information of each parking guidance device in the parking area group based on the parking information of each parking guidance device obtained in step S960 (not shown).

The forward parking information includes the number of empty parking surfaces in the forward direction based on each parking guidance device in the parking area group. The reverse parking information includes the number of vacant parking surfaces in the reverse direction based on each parking guidance device in the parking area group.

In step S980, the management server 130 transmits forward parking information and reverse parking information to each parking guidance device 110. Alternatively, the management server 130 may transmit forward parking information to each parking guidance device 110 (not shown).

In step S990, the parking guidance device 110 displays the parking state in the forward direction and the parking state in the reverse direction in the parking area group. Alternatively, the parking guidance device 110 may display a forward parking state in the parking area group (not shown).

10 schematically illustrates a centralized recording procedure of a video storage server according to an AI server determining a parking situation change event in a parking guidance system according to an embodiment of the present invention.

In step S1010, the management server 130 sets the parking area and parking area group in charge of each parking guidance device.

In step S1020, the management server 130 transmits parking area setting information to the AI server 120.

In step S1030, the AI server 120 sets a parking area using the parking area setting information.

In step S1040, the AI server 120 acquires a photographed image from at least one camera unit of each parking guidance device 110.

In step S1050, the AI server 120 recognizes the parking situation of the parking area related to the captured image based on the captured image obtained in step S940, and sets parking information for each parking guidance device. The parking information of each of the parking guidance devices means flag bit information indicating whether or not parking is performed for each of a predetermined number of left and right parking surfaces for a parking area in charge.

In step S1060, the AI server 120 determines a parking situation change event of a parking area. Specifically, when specific parking information of a specific parking guidance device is changed, it is determined that an event in which a parking situation is changed occurs in the parking surface in charge of the corresponding camera unit of the corresponding parking guidance device.

When a parking situation change event occurs in a parking area, in step S1070, the AI server 120 transmits the parking situation change event to the management server 130. The parking situation change event includes a camera unit identifier in charge of the parking surface in which the parking situation is changed.

In step S1080, the management server 130 transmits a centralized recording request to the video storage server 140 based on the parking situation change event acquired in step S1070. The centralized recording request includes the camera unit identifier.

In step S1090, the image storage server 140 obtains a photographed image from the corresponding camera unit of the parking guidance device 110 corresponding to the camera unit identifier. The captured image obtained from the corresponding camera unit of the parking guidance device 110 further includes the camera unit identifier and a timestamp.

The AI server 120 according to the present embodiment determines a parking situation change event in a parking area by recognizing a vehicle object and determining whether a parking surface related to the recognized vehicle object is parked, and the image storage server 140 changes the parking situation. Enables intensive recording before and after the event. This makes it possible to more accurately determine parking situation change events that require intensive recording, and intensive recording due to unnecessary events such as lighting changes and environmental changes caused by movement of areas other than the monitored parking area (eg shadow generation, etc.) By not doing so, the storage space of the image storage server 140 can be utilized more efficiently.

11 is a schematic block diagram of an AI server according to an embodiment of the present invention.

The AI server 120 according to this embodiment includes a setting information receiving unit 1110, a setting unit 1120, an image acquisition unit 1130, a recognizing unit 1140, a parking information setting unit 1150, a parking information transmission unit ( 1160), a parking situation change event determination unit 1170 and a parking situation change event transmission unit 1180.

The setting information receiving unit 1110 receives parking area setting information from the management server 130 . The parking area setting information includes a parking guidance device identifier, at least one camera unit identifier of the parking guidance device, and parking area information in charge of the parking guidance device.

The setting unit 1120 sets a parking area for each parking guidance device.

The image acquisition unit 1130 acquires a photographed image from at least one camera unit of each parking guidance device.

The recognizing unit 1140 recognizes a parking situation in a parking area based on a photographed image received from the at least one camera unit. The recognizing unit 1140 recognizes a vehicle object using artificial intelligence in a photographed image acquired by the image acquiring unit 1130 . It is obvious to those skilled in the art that various algorithms including machine learning and deep learning can be used for vehicle object recognition. The recognition unit 1140 determines whether parking is performed on each recognized parking surface related to the vehicle object. Specifically, it is possible to determine whether the parking surface is parked by determining whether the recognized vehicle object is matched to the center line of the related parking surface with a predetermined probability or more, but it is possible to use various other algorithms to those skilled in the art. self-explanatory

Parking information setting unit 1150 sets the parking information of each parking guidance device. The parking information of each of the parking guidance devices means flag bit information indicating whether or not parking is performed for each of a predetermined number of left and right parking surfaces for a parking area in charge.

The parking information transmitter 1160 transmits parking information of each parking guidance device to the management server 130 . In addition, the parking information transmission unit 1160 transmits the corresponding parking information to the parking guidance device 110.

The parking situation change event determining unit 1170 determines a parking situation change event in a parking area. The parking situation change event determining unit 1170 determines that the parking situation change event occurs when the parking information of the parking guidance device is changed by the recognizing unit 1140 .

The parking situation change event transmission unit 1180 transmits the parking situation change event including the camera unit identifier of the parking guidance device for which parking information has been changed to the management server 130 .

12 is a schematic block diagram of a management server according to an embodiment of the present invention.

The management server 130 according to this embodiment includes a setting unit 1210, a group parking information generation unit 1220, an AI server interface unit 1230, a parking guidance device interface unit 1240, and an image storage server interface unit 1250. ).

The setting unit 1210 sets a parking area for the parking guidance device and sets a predetermined parking area group. The parking area setting is set through a parking guidance device identifier, at least one camera unit identifier of the parking guidance device, and parking area setting information indicating parking area information in charge of the parking guidance device. For example, if the parking guidance device is in charge of 6 parking surfaces and identifies each parking surface with the start/end (x,y) coordinates of the center line, the parking area information is the start/end of the 6 center lines. It can be represented by a set of (x,y) coordinates.

The parking area group setting is set to a plurality of parking guidance device identifiers included in a predetermined parking area group, a forward sequence number within a group of each parking guidance device identifier, and a reverse sequence number within a group of each parking guidance device identifier. Alternatively, the parking area group setting may be set to a plurality of parking guidance device identifiers included in a predetermined parking area group and a forward sequence number within a group of each parking guidance device identifier.

The group parking information generator 1220 generates forward parking information and reverse parking information of each parking guidance device in a predetermined parking area group based on the parking information of each parking guidance device received from the AI server 120. Alternatively, the group parking information generator 1220 may generate forward parking information of each parking guidance device in a predetermined parking area group based on the parking information of each parking guidance device received from the AI server 120. The forward direction parking information includes the number of empty parking surfaces in the forward direction based on each parking guidance device in the parking area group. The reverse direction parking information includes the number of vacant parking surfaces in the reverse direction based on each parking guidance device in the parking area group.

The AI server interface unit 1230 transmits parking area setting information to the AI server 120. In addition, the AI server interface unit 1230 receives parking information of each parking guidance device from the AI server 120. In addition, the AI server interface unit 1230 receives a parking situation change event from the AI server 120.

The parking guidance device interface unit 1240 transmits forward parking information and reverse parking information to each parking guidance device. Alternatively, the parking guidance device interface unit 1240 may transmit forward parking information to each parking guidance device.

The video storage server interface unit 1250 transmits a centralized recording request to the video storage server 140 based on the parking situation change event obtained from the AI server 120 .

13 is a schematic block diagram of a video storage server according to an embodiment of the present invention.

The video storage server 140 according to this embodiment includes a recording request receiving unit 1310, an image receiving unit 1320, and a storage unit 1330.

The recording request receiver 1310 receives a centralized recording request from the management server 130 . The centralized recording request includes an identifier of a camera unit in charge of a parking surface in which a parking situation is changed.

The image receiving unit 1320 acquires a photographed image from a corresponding camera unit of the parking guidance device that photographs the parking area in which the parking situation is changed. The captured image further includes the camera unit identifier and timestamp.

The storage unit 1330 stores the acquired captured image.

Although preferred embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention should be defined by the appended claims.

For example, an apparatus according to an exemplary embodiment of the present invention may include a bus coupled to each unit of the apparatus as shown, at least one processor coupled to the bus, and instructions, received and a memory coupled to the bus for storing messages or generated messages and coupled to at least one processor for performing instructions as described above.

In addition, the system according to the present invention can be implemented as computer readable codes on a computer readable recording medium. A computer-readable recording medium includes all types of recording devices in which data that can be read by a computer system is stored. The computer-readable recording medium includes a magnetic storage medium (eg, ROM, floppy disk, hard disk, etc.) and an optical reading medium (eg, CD-ROM, DVD, etc.). In addition, the computer-readable recording medium is distributed to computer systems connected through a network, and computer-readable codes can be stored and executed in a distributed manner.

Claims (24)

a parking guidance device for photographing a parking area by at least one camera unit and displaying a parking state in a forward direction in a predetermined parking area group;
an AI server recognizing a parking situation of the parking area based on the photographed image received from the at least one camera unit and generating parking information of the parking guidance device; and
A management server for generating forward parking information of the parking guidance device in the predetermined parking area group based on the parking information of the parking guidance device received from the AI server;
the parking guidance device further displays a reverse parking state in the predetermined parking area group;
the management server further generates reverse parking information of the parking guidance device in the predetermined parking area group;
The predetermined parking area group is set to a plurality of parking guidance device identifiers included in the predetermined parking area group, a forward sequence number within a group of each parking guidance device identifier, and a reverse sequence number within a group of each parking guidance device identifier. become;
the forward parking information includes the number of vacant parking surfaces in the predetermined parking area group in a forward direction based on the parking guidance device;
The parking guidance system, characterized in that the reverse direction parking information includes the number of empty parking surfaces in the reverse direction with respect to the parking guidance device in the predetermined parking area group. According to claim 1,
The parking information of the parking guidance device is
Parking guidance system characterized in that the flag bit information indicating whether or not parking for each of the left and right parking surfaces of a predetermined number of the parking area in charge of the parking guidance device. According to claim 1,
The predetermined parking area group
A parking guidance system, characterized in that set to a forward sequence number within a group of a plurality of parking guidance device identifiers and each parking guidance device identifier included in the predetermined parking area group. According to claim 1,
The forward parking information is
A parking guidance system comprising the number of empty parking surfaces in a forward direction based on the parking guidance device in the predetermined parking area group. According to claim 1,
The parking guidance device
at least one camera unit for capturing the parking area;
a fullness display unit displaying a full or empty state of the parking area;
a forward direction display unit for displaying a forward parking state in the predetermined parking area group; and
A control unit for controlling the full display unit based on the parking information of the parking guidance device obtained from the AI server and controlling the forward display unit based on the forward parking information of the parking guidance device obtained from the management server Parking guidance system, characterized in that. According to claim 1,
The at least one camera unit
a first camera unit for capturing a predetermined number of left parking surfaces among the parking areas;
a second camera unit for capturing a predetermined number of right parking surfaces among the parking areas; and
Parking guidance system, characterized in that it comprises a third camera unit for photographing the passage surface of the parking area. According to claim 1,
The at least one camera unit
A camera unit composed of one fish-eye lens;
The parking guidance system, characterized in that for photographing the parking area with the fish-eye lens, and dividing the photographed parking area image into images of a left parking surface, a right parking surface, and a passage surface, respectively. According to claim 5,
The parking state in the forward direction is
A parking guidance system comprising a direction light indicating whether there is an empty parking surface and a number indicating the number of empty parking surfaces in a forward direction based on the parking guidance device in the predetermined parking area group. According to claim 1,
The AI server
a setting unit for setting the parking area for the parking guidance device;
a recognizing unit recognizing a parking situation of the parking area based on a photographed image received from the at least one camera unit; and
A parking guidance system comprising a parking information setting unit for setting the parking information for each of the parking guidance devices. According to claim 9,
the recognition unit
Recognizing a vehicle object based on the photographed image, and determining whether to park on a parking surface related to the recognized vehicle object;
The parking information setting unit
Parking guidance system, characterized in that for setting the parking information of the corresponding parking guidance device based on the determination result. According to claim 1,
The management server
a setting unit that sets the parking area for the parking guidance device and sets the predetermined parking area group; and
And a group parking information generator for generating the forward parking information of the parking guidance device in the predetermined parking area group based on the parking information for each of the parking guidance devices received from the AI server. induction system. According to claim 10,
The parking guidance system
When the parking situation of the parking area is changed, the parking guidance system further comprises an image storage server for acquiring and storing a photographed image from a camera unit of the parking guidance device that photographs the changed parking area. According to claim 12,
The AI server
Further comprising a parking situation change event determination unit for determining a parking situation change event of the parking area;
The management server
Further comprising a video storage server interface unit for transmitting a centralized recording request to the video storage server based on the parking situation change event obtained from the AI server;
The video storage server
a recording request receiving unit receiving the centralized recording request from the management server;
An image receiving unit for acquiring a photographed image from a corresponding camera unit of the parking guidance device for photographing the changed parking area, and
Parking guidance system comprising a storage unit for storing the captured image. According to claim 13,
The parking situation change event determination unit
determining that a case where the parking information of the parking guidance device is changed by the recognition unit is a parking situation change event;
The AI server
The parking guidance system further comprises a parking situation change event transmission unit for transmitting the parking situation change event including the camera unit identifier of the parking guidance device in which the parking information is changed to the management server. delete According to claim 1,
The parking guidance device
at least one camera unit for capturing the parking area;
a fullness display unit displaying a full or empty state of the parking area;
a forward direction display unit for displaying a forward parking state in the predetermined parking area group;
a reverse direction display unit displaying a reverse parking state in the predetermined parking area group; and
Based on the parking information of the parking guidance device obtained from the AI server, controls the full empty display unit, controls the forward display unit based on the forward parking information of the parking guidance device obtained from the management server, and controls the forward direction display unit, and the management server Based on the reverse parking information of the parking guidance device obtained from the parking guidance system characterized in that it comprises a control unit for controlling the reverse direction display unit. According to claim 16,
The parking state in the forward direction is
In the predetermined parking area group, in a forward direction based on the parking guidance device, a direction light indicating whether there is an empty parking surface and a number indicating the number of empty parking surfaces are included;
The parking condition in the reverse direction is
A parking guidance system comprising a direction light indicating whether there is an empty parking surface and a number indicating the number of empty parking surfaces in a reverse direction based on the parking guidance device in the predetermined parking area group. According to claim 1,
The management server
a setting unit that sets the parking area for the parking guidance device and sets the predetermined parking area group; and
A group parking information generation unit for generating the forward parking information and the reverse parking information of the parking guidance device in the predetermined parking area group based on the parking information for each of the parking guidance devices received from the AI server. Parking guidance system, characterized in that. In the parking guidance device, the parking guidance device
At least one camera unit for photographing a parking area in charge;
a fullness display unit displaying a full or empty state of the parking area;
a forward direction display unit for displaying a forward parking state in a predetermined parking area group;
And a control unit for controlling the mangong display unit and the forward direction display unit;
The parking guidance device
It further includes a reverse direction display unit for displaying a reverse parking state in the predetermined parking area group;
The control unit further controls the reverse direction display unit;
The parking state in the reverse direction includes a direction light indicating whether there is an empty parking surface and a number indicating the number of empty parking surfaces in the predetermined parking area group in a reverse direction based on the parking guidance device;
The predetermined parking area group is set to a plurality of parking guidance device identifiers included in the predetermined parking area group, a forward sequence number within a group of each parking guidance device identifier, and a reverse sequence number within a group of each parking guidance device identifier. Parking guidance device, characterized in that being. According to claim 19,
The at least one camera unit
a first camera unit for capturing a predetermined number of left parking surfaces among the parking areas;
a second camera unit for capturing a predetermined number of right parking surfaces among the parking areas; and
Parking guidance device characterized in that it comprises a third camera unit for photographing the passage surface of the parking area. According to claim 19,
The at least one camera unit
A camera unit composed of one fish-eye lens;
The parking guidance device, characterized in that for photographing the parking area with the fish-eye lens, and dividing the photographed parking area image into images of a left parking surface, a right parking surface, and a passage surface, respectively. According to claim 19,
The parking state in the forward direction is
A parking guidance device comprising a direction light indicating whether there is an empty parking surface and a number indicating the number of empty parking surfaces in a forward direction based on the parking guidance device in the predetermined parking area group. According to claim 19,
The predetermined parking area group
Parking guidance device, characterized in that set to the forward sequence number within the group of a plurality of parking guidance device identifiers and each parking guidance device identifier included in the predetermined parking area group. delete