JP7303598B2 - Facility monitoring system - Google Patents

Description

The present invention provides a technique for monitoring the facility by scanning the facility in the x-direction and the y-direction with electromagnetic waves to identify the shape of the object in a non-contact manner, and to monitor the facility, enter the facility, or A technology for identifying a moving body leaving the facility and managing the facility, and/or a technology for identifying a user who is a user of the moving body and/or a user who uses the facility and managing the facility It is about.

Techniques already exist to geometrically identify an object without a camera and in a non-contact manner by scanning the object in one direction with a line sensor.

An example thereof is disclosed in Patent Document 1. In this technology, for the purpose of determining the vehicle type of a vehicle traveling on a horizontal support surface (for example, a road surface), a plurality of light emitting elements arranged one-dimensionally in the vertical direction and one-dimensional A silhouette sensor is configured as a line sensor by arranging a plurality of light-receiving elements arranged in a matrix so as to face each other in the horizontal direction.

JP-A-5-296737

However, the technique disclosed in Patent Document 1 has a problem that the shape of an object to be identified cannot be accurately measured by the silhouette sensor.

Specifically, in the silhouette sensor, the light-emitting element emits electromagnetic waves such as light, radio waves, or sound waves toward the light-receiving element. , has directivity.

If the electromagnetic wave is selected as laser light, neither the light-emitting device nor the light-receiving device need to have directivity. However, in that case, there are problems such as that the system is expensive, that the power consumption of the device increases, and that the emitted laser light is dangerous if it should enter the eyes of a person.

Therefore, if a normal electromagnetic wave is used to avoid these problems, the electromagnetic wave emitted from one light-emitting element travels in space with a divergence angle. They may be received at the same time.

As a result, when ordinary electromagnetic waves are used, the one-dimensional pattern represented by the light-receiving elements that are blocked by the object to be identified and cannot receive the electromagnetic wave accurately reflects the actual silhouette of the object to be identified. likely not.

Therefore, in the technique disclosed in Patent Document 1, if the light receiving element receives light from an unexpected light emitting element, the light cannot be removed as noise light. There is a problem that it cannot be measured well.

Note that the function (application) of identifying an object is embodied as a function of identifying the type of vehicle traveling on a toll road, as disclosed in Patent Document 1. , is embodied as a function of identifying and classifying vehicles entering and leaving the parking lot.

Further, there is a need to accurately associate a vehicle so identified with a user as an occupant of that vehicle.

Against this background, the present invention provides non-contact monitoring of a facility by geometrically identifying the object in the facility by scanning the object in the x and y directions with electromagnetic waves. A moving object that enters or exits a designated facility by using a line sensor that identifies the shape of an object in a non-contact manner without using a camera and an imaging device that captures the image of the object. and / or a technology that enables the user who is the user of the mobile body and / or the user who uses the facility to be identified and managed It is.

In order to solve the problem, according to one aspect of the present invention, there is provided a facility monitoring system for monitoring facilities,
A silhouette image of the object is obtained by irradiating an object existing in the facility with an electromagnetic wave and scanning the irradiated electromagnetic wave and the object relatively in the x direction and the y direction. a silhouette image acquisition device that
a monitoring unit that monitors the movement of the object based on the obtained silhouette image;
including
The facility has two monitoring positions,
The monitoring unit is in a moving state in which the object moves between the two monitoring positions when silhouette images that are geometrically similar to each other are acquired at the two monitoring positions ahead of each other in time. A facility monitoring system is provided that includes a moving state determination unit that determines that .
Further, according to another aspect of the present invention, a facility monitoring system for monitoring a facility,
A silhouette image of the object is obtained by irradiating an object existing in the facility with an electromagnetic wave and scanning the irradiated electromagnetic wave and the object relatively in the x direction and the y direction. a silhouette image acquisition device that
a display for displaying the obtained silhouette image on the screen;
a monitoring unit that monitors the movement of the object based on the obtained silhouette image;
including
The monitoring unit determines whether the object is a human being,
A facility monitoring system is provided in which the display displays the acquired silhouette image on the screen when the monitoring unit determines that the object is a person.
Further, according to still another aspect of the present invention, a facility monitoring system for monitoring a facility,
A silhouette image of the object is obtained by irradiating an object existing in the facility with an electromagnetic wave and scanning the irradiated electromagnetic wave and the object relatively in the x direction and the y direction. a silhouette image acquisition device that
a monitoring unit that monitors the movement of the object based on the obtained silhouette image;
including
When the object is a human, the monitoring unit determines whether the human is walking alone or moving in a wheelchair, based on the obtained silhouette image. Alternatively, there is provided a facility monitoring system including a movement form determination unit that determines whether a person is walking with a helper or a service dog.

Further, according to one aspect of the present invention, there is provided a facility monitoring system for monitoring a facility by identifying objects entering the facility, comprising:
A line sensor provided in the facility and extending in a direction intersecting the traveling direction of an object entering the facility, wherein the object is relatively scanned in its traveling direction to obtain a two-dimensional silhouette of the object. and
a type determination unit that determines whether the object is a human or an animal other than a human based on the acquired silhouette;
A facility monitoring system is provided, comprising: a photographing device provided in the facility for photographing the object when the type determining unit determines that the object is a person.

Further, according to one aspect of the present invention, there is provided a facility monitoring system for monitoring a facility by identifying objects entering the facility, comprising:
A line sensor provided in the facility and extending in a direction intersecting with the traveling direction of an object entering the facility, the line sensor scanning a side view of the object relatively in the traveling direction of the object to detect the object. obtaining a two-dimensional silhouette; and
Determining whether the object is a human or a non-human animal by comparing the obtained silhouette with a plurality of reference silhouettes representing standard two-dimensional shapes of humans and non-human animals. A facility monitoring system is provided that includes:

According to another aspect of the present invention, there is provided a system for identifying and managing users of facilities to be remotely managed by a management server, comprising:
A line sensor provided in the facility, installed in a passage common to a moving object as an object and a user, respectively, and extending in a direction intersecting with a traveling direction of an object passing through the passage, wherein the object is viewed from the side. relative to the direction of travel of the object to obtain a silhouette of the object;
a determination unit provided in the facility or the management server and configured to determine whether the object is a person based on the acquired silhouette;
A photographing device provided in the facility for photographing an object positioned on the passage, wherein the object is photographed as a human image of a user who uses the facility in temporal linkage with the acquisition of the silhouette or the determination. A user identity management system is provided that includes:

Also according to one aspect of the present invention, there is provided a system for identifying and managing objects entering or leaving a facility to be remotely managed by a management server, comprising:
a passage provided in the facility and common to the mobile object and the user, respectively;
a line sensor installed in the passage and scanning a side view of an object passing through the passage relative to the traveling direction of the object to obtain a lateral silhouette of the object;
a first determination unit provided in the facility or the management server and configured to determine whether the object is a moving object based on the acquired silhouette;
a moving body type determination unit provided in the facility or the management server and configured to determine the type of the moving body based on the acquired silhouette;
A photographing device provided in the facility for photographing an object located on the passage, wherein when the first determination unit determines that the object is a moving body, the acquisition of the silhouette, the determination, or capturing an image of the object as a moving object image in temporal linkage with the timing of the determination;
provided in the facility or the management server and recognizing mobile identification information, which is identification information of the mobile and displayed on the mobile, from the captured image of the mobile, thereby a mobile identification information acquisition unit that acquires the mobile identification information;
The type of the moving body includes a classification related to the height dimension in side view of the moving body, a classification related to the shape of the side view of the moving body, a classification related to the maximum size of the side view of the moving body, and a classification related to the maximum dimension of the side view of the moving body. classification relating to side view aspect ratio, and optionally, if the moving object is a vehicle, may optionally include the vehicle type of the vehicle.

The present invention provides the following aspects. Each aspect is divided into sections, each section is numbered, and the numbers of other sections are referred to as necessary. This is to facilitate understanding of some of the technical features that can be employed by the present invention and combinations thereof, and the technical features that can be employed by the present invention and combinations thereof are limited to the following aspects. should not be interpreted as That is, it should be construed that the technical features described in the present specification, which are not described in the following aspects, are appropriately extracted and employed as the technical features of the present invention.

Furthermore, it should be noted that stating each paragraph in a format that refers to the numbers of other paragraphs does not necessarily prevent the technical features described in each paragraph from being separated and independent from the technical features described in other paragraphs. It should be construed that the technical features described in each section can be made independent as appropriate according to their nature.

(1) An object identification method for geometrically identifying an object in a non-contact manner without using a camera by scanning the object in one direction with a line sensor,
The central space of the line sensor, in which the transmitter row, which is a row of a plurality of transmitters, and the receiver row, which is a row of a plurality of receivers, are arranged in the space so as to face each other across the central space. during a relative movement in which the object moves relative to the line sensor in a direction transverse to the length of the line sensor to pass through;
a transmitting step of continuously or discretely operating the plurality of transmitters to transmit a plurality of signals from the transmitters;
a target receiving step for attempting to receive the emitted plurality of signals multiple times by the plurality of receivers at discrete times, thereby resulting in multiple reception events, each reception When the receiver receives two or more signals from two or more transmitters at the same time, one of the transmitters assigned in advance to correspond to each receiver on a one-to-one basis is set as a target transmitter, and the target selecting the signal emitted by the transmitter as a valid signal;
At each reception event, among the plurality of receivers, those that have received a valid signal from each of the opposite transmitters and those that have not received a valid signal are distinguished from each other, one-dimensional information is generated from the results, and the plurality of a silhouette estimating step of arranging a plurality of one-dimensional information respectively generated in each reception event to convert it into two-dimensional information, and estimating an actual silhouette of the object based on the two-dimensional information;
and an object identification step of identifying the object based on the geometric similarity between the estimated actual silhouette and a plurality of predetermined reference silhouettes.

(2) each transmitter is configured to emit a signal representing a unique transmitter ID;
The target receiving step extracts a transmitter ID from the signals received from each transmitter by each receiver, and a plurality of transmitter IDs, each represented by a plurality of signals received simultaneously by each receiver from a plurality of transmitters. The object identification method according to item (1), further comprising the step of selecting, as the valid signal, a signal that matches the regular transmitter ID assigned to the counter transmitter.

(3) Item (1) or (2), wherein each receiver (e.g., beacon receiver) is configured to receive a signal from each transmitter (e.g., beacon transmitter) in a short-range wireless communication scheme. The object identification method according to .

(4) each transmitter is a light emitter (e.g., LED light source, laser light source, etc.) that emits visible light or infrared light in a unique blinking pattern;
each receiver is a light receiver (e.g., photodiode, light sensor, etc.) that receives light emitted from each light emitter;
The object identification method according to item (1) or (2), wherein the target receiving step includes a step of extracting a blinking pattern from the light received by each light receiver and converting the blinking pattern into a light emitter ID.

(5) The object identification method according to any one of items (1) to (4), wherein the plurality of reference silhouettes have respective shapes unique to a plurality of object categories as a plurality of candidates for identification of the object.

(6) Furthermore,
a speed acquisition step of acquiring a moving speed when the object passes through the central space of the line sensor during the relative movement;
The silhouette estimating step includes determining spatial intervals between the plurality of one-dimensional information using the acquired moving speed, and arranging the plurality of one-dimensional information at the determined spatial intervals. The object identification method according to any one of items (1) to (5), wherein the two-dimensional information is converted into the two-dimensional information.

(7) A signal transmitted by an end transmitter located at one end of the plurality of transmitters is transmitted as long as the actual silhouette dimension of the object in the length direction of the line sensor does not exceed a predetermined upper limit dimension. , items (1) to (6) that are received by an end receiver located at one end of the plurality of receivers and facing the end transmitter without being blocked by the object The object identification method according to any one of .

(8) Further including a first abnormality determination unit that determines that there is an abnormality in the operating state of the line sensor when the end receiver does not receive a signal from the end transmitter (7) 3. Object identification method according to item.

(9) Further including a second abnormality determination unit that determines that there is an abnormality in the attitude of the line sensor when the end receiver does not receive a signal from the end transmitter (7) or (8) The object identification method according to the item.

(10) Furthermore, including a failure diagnosis step of performing a failure diagnosis on the operating state of the line sensor prior to the actual operation of object identification,
The fault diagnosis process disregards the correspondence between transmitters and receivers, and for each receiver the receiver detects all or some of the signals from said transmitters. If all or some of the multiple receivers do not receive the signal from the same transmitter, it is determined that the transmitter is faulty; If the receiver does not receive a signal from any transmitter, it is determined that one of the receivers is faulty (1) to (9) object identification according to any one of items Method.

(11) A program executed by a computer to carry out the object identification method according to any one of (1) to (10).

Throughout this specification, the term "program" shall be construed to mean, for example, the combination of instructions executed by a computer to perform its function, and the combination of those instructions as well as each instruction. can be construed to include, but not be limited to, files and data processed according to.

In addition, this program may achieve its intended purpose by being executed by a computer by itself, or may achieve its intended purpose by being executed by a computer together with other programs. They can, but are not limited to. In the latter case, the programs under this section may be data-based, but are not so limited.

(12) A recording medium in which the program according to (11) is computer-readable.

Throughout this specification, the term "recording medium" can be construed to mean various types of recording medium, such as, for example, magnetic recording media such as floppy disks. Optical recording media such as CDs and CD-ROMs, magneto-optical recording media such as MOs, non-removable storages such as ROMs, etc., but are not limited to them.

(13) The object identification method according to any one of items (1) to (10), wherein the minimum dimension of the central space between the transmitter row and the receiver row is 30 cm, 50 cm, 1 m or 2 m. .

(14) The object identification method according to any one of items (1) to (10), wherein the object includes vehicles including bicycles, motorcycles and automobiles, or moving bodies.

(15) The object identification method according to any one of items (1) to (10), wherein the plurality of reference silhouettes include a plurality of standard silhouettes of vehicles, humans and animals, respectively.

(16) The line sensor according to any one of items (1) to (10), wherein the line sensor includes a first line sensor and a second line sensor that are respectively installed at two locations separated from each other in the traveling direction of the object. Object identification method.

(17) the object advances through a predetermined path;
The transmitter row and the receiver row are respectively installed at two locations facing each other across the passage,
The object identification method according to any one of items (1) to (10), wherein the object is identified while the object is traveling through the passage in one direction.

(18) the passageway is arranged to connect an open space and a dead end space to each other;
The object travels forward and backward through the passage,
The object identification method according to item (17), wherein the line sensors include an outer line sensor installed on the open space side and an inner line sensor installed on the dead end space side of the passage.

(19) An object identification system that geometrically identifies an object in a non-contact manner without using a camera by scanning the object in one direction with a line sensor,
A line sensor in which a plurality of transmitter rows, which are rows of transmitters, and a plurality of receiver rows, which are rows of receivers, are arranged in space so as to face each other across a central space, the object moves relative to the line sensor in a direction crossing the length direction of the line sensor so as to pass through the central space;
A target receiver that attempts to receive the emitted plurality of signals multiple times by the plurality of receivers in a time-discrete manner, thereby resulting in multiple reception events; When the receiver receives two or more signals from two or more transmitters at the same time, one of the transmitters assigned in advance to correspond to each receiver on a one-to-one basis is set as a target transmitter, and the target selecting the signal emitted by the transmitter as a valid signal;
At each reception event, among the plurality of receivers, those that have received a valid signal from each of the opposite transmitters and those that have not received a valid signal are distinguished from each other, one-dimensional information is generated from the results, and the plurality of a silhouette estimating unit for arranging a plurality of one-dimensional information respectively generated in each reception event to convert it into two-dimensional information, and estimating the actual silhouette of the object based on the two-dimensional information;
an object identifier that identifies the object based on the geometric similarity between the estimated actual silhouette and a plurality of predetermined reference silhouettes.

(20) An object identification system that geometrically identifies an object in a non-contact manner without using a camera by scanning the object in one direction with a line sensor,
A line sensor in which a plurality of transmitter rows, which are rows of transmitters, and a plurality of receiver rows, which are rows of receivers, are arranged in space so as to face each other across a central space, The object moves relative to the line sensor in a direction transverse to the length direction of the line sensor so as to pass through the central space, and the plurality of signals emitted from the plurality of transmitters are at least partially are blocked by the object and do not reach the receiver array at
estimating an actual silhouette of the object based on the received results of the line sensor, and identifying the object based on the geometric similarity between the estimated actual silhouette and a plurality of predetermined reference silhouettes; including an identification portion and
the object includes a vehicle;
The communication terminal is carried by a user who is an occupant of the vehicle while riding or is mounted on the vehicle,
each transmitter emits a signal representing a unique transmitter ID;
The communication terminal receives a portion of the plurality of signals from the plurality of transmitters that enter the vehicle during the ride,
The object identification system further comprises:
a management server communicable with the communication terminal;
a communication unit capable of transmitting a signal representing the reception status of the plurality of receivers and/or the object identification result of the object identification unit to the management server;
When receiving a signal from at least one of the plurality of transmitters, the communication terminal extracts a transmitter ID from the signal, associates the transmitter ID with user identification information, and transmits the transmitter ID to the management server. ,
When the management server receives the transmitter ID from the communication terminal in a state in which the line sensor detects the object and the object is identified as a vehicle, the management server receives the transmitter ID from the line sensor. an object identification system including a user/vehicle linking unit that links the user and the vehicle when the object belongs to.

(21) In order to identify and manage vehicles entering or exiting a designated facility and users who are users of the vehicles, respectively, in a state where they are distinguished from each other as objects, , a line sensor extending in a direction intersecting the traveling direction of an object passing through the passage, wherein the silhouette of the object is obtained by scanning the object passing through the passage relatively in its traveling direction. Then, a line sensor is installed to perform object identification processing based on the silhouette, and the line sensor is used to determine whether or not the object is a vehicle based on the acquired silhouette. The vehicle type is determined based on the silhouette, the vehicle is photographed using a camera in conjunction with the object identification processing, the determination, or the determination in terms of time, and the vehicle number is obtained based on the photographed vehicle image. , a vehicle/user identification management system and a vehicle/user identification management method for associating the facility, the vehicle type, the vehicle number, and the user ID or terminal ID with each other and registering these elements in a vehicle/user management list. .

FIG. 1 schematically illustrates the hardware configuration of an object identification system according to a first exemplary embodiment of the present invention implemented for identifying objects entering and exiting a parking lot having an entry/exit passageway. It is a top view showing. FIG. 2 is a perspective view schematically showing the hardware configuration of the object identification system shown in FIG. 1, and a functional block diagram conceptually showing the software configuration of the object identification system. FIG. 3 is a common front view of the outer line sensor and the inner line sensor shown in FIG. 2, in which a plurality of signals emitted from the transmitter post shown in the same figure pass through space without being blocked by objects; This is to explain how the objects are classified into objects and objects that are blocked by objects. 4 is a side view showing the inner surface of the transmitter post (or receiver post) shown in FIG. 3; FIG. 5 is a partial front view common to the outer line sensor and the inner line sensor shown in FIG. 2 emitting signals omnidirectionally (e.g., radially) from a transmitter of one of the transmitter posts; , and as a result, the transmitted signal may be received simultaneously by multiple receivers, including counter-transmitters facing the transmitter. FIG. 6 shows, for each of the outer line sensor and the inner line sensor shown in FIG. FIG. 4 is a diagram representing in tabular form the relationship between a plurality of transmitter IDs; FIG. 7 is a side view for explaining how the object is scanned in one direction by the outer line sensor while the object is traveling in one direction through the entrance/exit passage of the parking lot shown in FIG. 1, and the object is identified. be. FIG. 8 shows how the object is scanned in one direction by the outer line sensor as shown in FIG. FIG. 2 conceptually represents how the information is combined with the information to thereby estimate the actual silhouette of the object. FIG. 9 is a conceptual tabular representation of an exemplary relationship between multiple object categories and multiple reference silhouettes. FIG. 10 is a flow chart conceptually representing an exemplary object identification program executed in the object identification unit shown in FIG. FIG. 11 is a flowchart conceptually showing an exemplary entering/leaving determination program executed in the entering/leaving determining unit shown in FIG. FIG. 12(a) illustrates an example of how the reception states of the outer line sensor and the inner line sensor change in time series at the warehousing stage in which an object enters the parking lot through the entrance/exit passage shown in FIG. FIG. 1(b) shows the reception states of the outer line sensor and the inner line sensor chronologically at the leaving stage in which the object exits the parking lot through the entrance/exit passage shown in FIG. It is a figure for demonstrating an example of a state of change. FIG. 13 is a continuation of the functional block diagram representing the signal processing unit shown in FIG. 14 is a flowchart conceptually showing an exemplary first abnormality determination program executed in the first abnormality determination unit shown in FIG. 13. FIG. 15 is a flowchart conceptually showing an exemplary second abnormality determination program executed in the second abnormality determination section shown in FIG. 13. FIG. 16 is a flow chart conceptually representing an exemplary fault diagnosis program executed in the fault diagnosis unit shown in FIG. 13. FIG. FIG. 17 is a flowchart conceptually representing an exemplary parking lot management program executed in the management server shown in FIG. 2 together with a parking lot utilization program executed in a user's communication terminal. FIG. 18 is a front view of an outer line sensor of an object identification system according to a second exemplary embodiment of the present invention, wherein a plurality of signals emitted from the transmitter post shown in FIG. Those that pass through the space without being blocked by the outer panel and reach the receiver post, those that are blocked by the outer panel of the vehicle, those that pass through the window glass of the vehicle and enter the vehicle interior, and the user as a passenger. FIG. 10 shows how data is classified into data received by a communication terminal and a functional block diagram conceptually representing the software configuration of the object identification system. FIG. 19 is a flow chart conceptually representing an exemplary user-vehicle tying program executed in the user-vehicle tying unit shown in FIG. 18 together with a user identification support program executed in the user's communication terminal. FIG. 20 is a diagram conceptually representing an exemplary user/vehicle linking list created by the user/vehicle linking unit shown in FIG. 18 in tabular form. FIG. 21(a) illustrates the hardware configuration of an object identification system according to a third exemplary embodiment of the present invention implemented for identifying objects entering and exiting a parking lot having an entry/exit passageway. FIG. 2B is a schematic side view showing, in tabular form, a series of phases that can be taken by a vehicle and a user as objects in the parking lot during an entry stage and an exit stage, respectively, together with reference drawing numbers; It is a diagram. FIG. 22 is a flow chart conceptually representing a first object identification/stage determination program executed by the signal processing unit shown in FIG. 21 at the time of warehousing. FIG. 23 is a flowchart conceptually showing a parking lot identification program executed by the user terminal shown in FIG. 21 when entering and exiting. FIG. 24 is a flow chart conceptually representing a first linking/registration program executed by the management server shown in FIG. 21 at the time of warehousing. FIG. 25 is a diagram conceptually representing, in tabular form, a vehicle/user management list used by the management server shown in FIG. 21 to link and manage vehicle information and user information. 26 is a flowchart conceptually showing a second object identification/stage determination program executed by the signal processing unit shown in FIG. 21 when the user leaves alone. 27 is a flowchart conceptually showing a second linking/registration program executed by the management server shown in FIG. 21 when the user leaves alone. FIG. 28 is a flow chart conceptually representing a third object identification/stage determination program executed by the signal processing unit shown in FIG. 21 when the user enters alone. FIG. 29 is a flowchart conceptually showing a third linking/registration program executed by the management server shown in FIG. 21 when the user enters alone. FIG. 30 is a flow chart conceptually representing a fourth object identification/stage determination program executed by the signal processing unit shown in FIG. 21 when leaving the garage.

Below, some of the more specific exemplary embodiments of the present invention will be described in detail based on the drawings.

[First embodiment]

FIG. 1 schematically shows a plan view of the hardware configuration of an object identification system 10 (hereinafter simply referred to as "system 10") according to the first exemplary embodiment of the present invention. This system 10 is designed to implement an object identification method according to an exemplary embodiment of the present invention.

In this embodiment, the system 10 is incorporated as part of a parking lot management system 1000 that manages the parking lot 20 unmanned and remotely.

Briefly, the system 10 is designed to geometrically identify a three-dimensional object in a non-contact, non-camera manner by scanning the object in one direction with a line sensor. there is

This system 10 is implemented to identify whether an object entering or exiting a parking lot 20 is a vehicle 30, a human being, or an animal. The parking lot 20 connects an inner area (dead-end space) 34 having a plurality of compartments 32 that can accommodate multiple vehicles, and an outer area (open space) 38 which is a road 36 adjacent to the parking lot 20. It has an ingress/egress passage 40 .

A vehicle 30 travels along a common entrance/exit path 40 both when entering the parking lot 20 and when leaving the parking lot 20.例文帳に追加Specifically, the vehicle 30 travels in one direction (from the outside to the inside) in the entrance/exit passage 40 when entering the garage, and moves in the opposite direction (from the inside to the outside) in the entrance/exit passage 40 when leaving the garage. ).

As shown in FIG. 1, the system 10 includes an outer line sensor 50 located on the side of the outer region 38 of the access passage 40 and an inner line sensor 52 located on the side of the inner region 34. there is Both the outer line sensor 50 and the inner line sensor 52 are mounted on a support surface 54 of the parking lot 20 (eg, road surface, ground, etc.) in an upright position extending generally perpendicularly from the support surface 54 .

As shown in FIGS. 2 and 3, for both the outer line sensor 50 and the inner line sensor 52, a transmitter post 62 having a transmitter row, which is a row of a plurality of transmitters 60, housed in a housing 74; A receiver post 72 in which a receiver row, which is a row of a plurality of receivers 70 , is accommodated in a housing 76 is arranged in space so as to face each other across a central space 77 . Both transmitter post 62 and receiver post 72 have a plurality of sensor elements (this term is used collectively for transmitter 60 and receiver 70) that are linearly (e.g., straight or curved) centered. arranged and configured along a line).

Furthermore, for both the outer line sensor 50 and the inner line sensor 52, among the plurality of transmitters 60 and the plurality of receivers 70, one transmitter 60 and one receiver 70 paired with each other are shown in FIG. As shown, they are arranged to face each other in the horizontal direction.

Transmitter post 62 and receiver post 72 have columnar housings 74 and 76, respectively, extending generally perpendicularly from support surface 54, and within housings 74 and 76, respectively, a plurality of transmitters 60 and a plurality of receivers. 70 is housed so as to have a waterproof function (so as not to fail due to intrusion of rainwater or puddles).

In this embodiment, both the transmitter 60 and the receiver 70 are sensor elements (e.g., beacon transmitter and beacon receiver) that communicate using invisible light (e.g., radio waves). and sensor elements of the type that use visible light, infrared light, sound waves or ultrasonic waves, such as a combination of an LED light source and light sensor, a combination of an infrared light source and an infrared sensor, a combination of a laser light source and light sensor, or a combination of sound waves. Combinations of generators and sonic sensors, and the like, may also be used. That is, the transmitter 60 is an example of an electromagnetic wave emission element, and the receiver 70 is an example of an electromagnetic wave incidence element.

In one example, each transmitter 60 is a light emitter 60 that emits light, visible or infrared, in a unique blinking pattern. On the other hand, each receiver 70 is a light receiver 70 that receives light emitted from each light emitter 60 . In this case, the target receiver 108 extracts a blinking pattern from the light received by each light receiver 70 and converts the blinking pattern into a light emitter ID so that the light emitter 60 that emitted the received light It is determined whether or not it is a facing light emitter (an example of an authorized transmitter), that is, an authorized light emitter (an example of an authorized transmitter).

As shown in the front view of FIG. 3, the multiple transmitters 60 simultaneously transmit multiple signals during the object identification operation. The portion of those signals that is blocked by the vehicle 30 does not enter the opposing receiver 70, while the portion that is not blocked by the vehicle 30 is transmitted through the central space 77 and enters the opposing receiver 70. do.

As shown in side view in FIG. 4, both the outer line sensor 50 and the inner line sensor 52, as well as the transmitter post 62 and the receiver post 72, are one of the plurality of sensor elements 60, 70 arranged in a line. The top end (top end transmitter (an example of the "end transmitter") 60 and top end receiver (an example of the "end receiver") 70) are arranged as shown in FIGS. , the height of the top transmitter 60 and the top receiver 70 such that the signal emitted by the top transmitter 60 is received by the top receiver 70 for all types of vehicles 30 that fit in size A direction position is selected.

Therefore, the signal transmitted by the top end transmitter 60 is not interrupted by the object 30 unless the actual silhouette dimension of the object 30 in the length direction of each line sensor 50, 52 exceeds the predetermined upper limit dimension. , is received by the topmost receiver 70 opposite the topmost transmitter 60 .

Further, as shown in side view in FIG. 4, both the outer line sensor 50 and the inner line sensor 52, as well as the transmitter post 62 and the receiver post 72, have a plurality of sensor elements 60, 70 arranged in a row. The bottommost one (the bottommost transmitter 60 and the bottommost receiver 70) is for all kinds of vehicles 30, when the tire (wheel, wheel) 78 of the vehicle 30 passes the line sensors 50, 52 Also, the heightwise positions of the lowest transmitter 60 and the lowest receiver 70 are selected such that the signals emitted from the lowest transmitter 60 are blocked by the tires 78 and not received by the lowest receiver 70. . Thereby, it is possible to detect the timing at which the tire 78 of the vehicle 30 passes through each of the line sensors 50 and 52 .

As shown in front view in FIG. 5, for both outer line sensor 50 and inner line sensor 60, each transmitter 60 of transmitter posts 62 emits signals omnidirectionally (eg, radially). Therefore, a signal transmitted from one transmitter 60 can be received not only by a counter receiver (for example, one counter receiver) 70 facing the transmitter 60 but also by a plurality of receivers 70 located around it. , may be received at the same time.

To eliminate that possibility, targeted reception is performed for each receiver 70 in this embodiment. Specifically, when each receiver 70 receives two or more signals from two or more transmitters 60 at the same time, one of the transmitters 60 is assigned in advance so as to correspond to each receiver 70 on a one-to-one basis. Signal processing is performed to select the signal transmitted from the opposite transmitter 60 as a valid signal and exclude other signals as invalid signals. This is also called a filtering process.

In this regard, FIG. 6 shows the numbers of a plurality of receivers 70 for each of the outer line sensor 50 and the inner line sensor 52, and a plurality of transmitters (regular The relationship between the numbers of the transmitters) 60 and a plurality of transmitter IDs (regular transmitter IDs) for each transmitter 60 is represented in tabular form.

Specifically, in the above-described target reception, for each receiver 70, one counter transmitter 60 corresponding to it and a transmitter ID assigned to that counter transmitter 60, that is, a regular transmitter ID are determined. do. When each receiver 70 simultaneously receives two or more signals from two or more transmitters 60, it selects the signal representing the regular transmitter ID from those transmitters 60 as an effective signal, while ignoring the other signals. . This is also called software filtering processing.

That is, in the target reception described above, when each receiver 70 simultaneously receives two or more signals from two or more transmitters 60, one counter transmitter 60 assigned one regular transmitter ID is used as one target. Select a transmitter 60 and effectively attempt to receive a signal from only that target transmitter 60 .

On the other hand, random reception means that each receiver 70 ignores whether or not any of the transmitters 60 is the above-mentioned regular transmitter, and converts at least one randomly received signal into at least one actual signal. It means assigning each receiver 70 its at least one real transmitter ID in terms of transmitter IDs.

In this embodiment, for a plurality of receivers 70, the target reception described above is directed from the topmost receiver 70 to the bottommost receiver 70 (or vice versa, or in another direction). Sequentially, this means that the outer line sensor 50, i.e. the plurality of This is called soft scanning (y direction scanning, vertical direction scanning) for the receiver 70 .

In addition, in this embodiment, the inner line sensor 52 is designed to have a common configuration with the outer line sensor 50 . However, in this embodiment, the outer line sensor 50 is exclusively used for object identification. However, instead of this, the present invention may be implemented in a mode in which object identification is performed exclusively using the inner line sensor 52, or in a mode in which both line sensors 50 and 52 are used to perform object identification. The present invention may be implemented in

Therefore, the inner line sensor 52 is simplified from the outer line sensor 50 (e.g., mutually The number of sensor element pairs (transmissive opposed sensor elements) consisting of opposed transmitters 60 and receivers 70 may be designed to be one or more, or less than the number of sensor element pairs in the outer line sensor 50).

As previously described, the system 10 is designed to geometrically identify an object 30 in a non-contact, non-camera manner by physically scanning the three-dimensional object 30 in one direction with the outer line sensor 50. is designed to

Specifically, as shown in the side view of FIG. 7, while a vehicle 30, which is an example of an object, is traveling in one direction through the entrance/exit passage 40 of the parking lot 20, the vehicle 30 is scanned in one direction by the outside line sensor 50. and the vehicle 30 is identified.

When the vehicle 30 as a moving body moves through the central space 77 relative to the outer line sensor 50 as a stationary object, the vehicle 30 intersects the length direction of the outer line sensor 50. A relative movement is achieved that moves relative to the outer line sensor 50 in a direction (scanning direction).

In FIG. 8, the presence or absence of reception for each receiver 70 is indicated by a dot pattern (for each receiver 70, the non-receiving state due to signal interruption, that is, the off (OFF) state of the receiver 70 is indicated by dots). As a result of the vehicle 30 being scanned in one direction by the outer line sensor 50, a plurality of one-dimensional information about the vehicle 30 is generated discretely in time. The one-dimensional information is sequentially generated at a predetermined sampling period Δt.

In the example shown in FIG. 8, time _t1 is related to time _t1 in the example shown in FIG. In FIG. 7, one-dimensional information acquired when the portion indicated by time _t1 of the object 30 is measured by the outer line sensor 50 is shown in FIG. 8 as a dot pattern. Similarly, time _t2 in FIG. 8 is associated with the site indicated by time _t2 in FIG. The same is true for other times _t3 and _t4 .

Furthermore, as shown in FIG. 8, a plurality of one-dimensional information (one dot row) generated by the above-described unidirectional scanning are combined with two-dimensional information (a plurality of dot rows), thereby forming the object 30 is estimated. The shape of the actual silhouette is represented, for example, by an envelope circumscribing a plurality of dots representing two-dimensional information.

Combining a plurality of one-dimensional information may be performed by evenly arranging the one-dimensional information at their common spatial intervals. The length of the spatial interval at that time may be a fixed value or a variable value set according to the measured value of the moving speed of the object 30 .

Alternatively, the moving speed of the object 30 (e.g., vehicle running speed, vehicle speed) is obtained at generally the same timing as the sampling timing of the one-dimensional information, and a plurality of spatial intervals corresponding to the obtained plurality of actual speeds are obtained. A plurality of one-dimensional information may be arranged unevenly.

Specifically, by using the acquired plurality of moving speeds to determine the spatial interval between the plurality of one-dimensional information, and arranging the one-dimensional information at the determined spatial interval, It may be converted into two-dimensional information.

As previously mentioned, the system 10 is implemented to identify whether an object 30 entering or exiting a parking lot 20 is a vehicle, a person, or an animal. On the other hand, a plurality of reference silhouettes are prepared for article identification, and it is determined to which of these reference silhouettes the actual silhouette estimated as described above is most similar in shape. It is determined that the object category corresponding to the reference silhouette that is running is the current object 30 .

Therefore, in the present embodiment, as illustrated in FIG. 9, a plurality of reference silhouettes include a vehicle, a human (for example, a silhouette with a simple vertically elongated shape), and an animal (for example, a silhouette with a simple horizontally elongated shape). ) for each of the standard silhouettes.

For the degree of approximation (or degree of similarity) regarding the shape between the actual silhouette and each reference silhouette, for example, the degree of shape approximation between the actual silhouette and each reference silhouette is calculated for each reference silhouette. The degree of shape approximation can be calculated, for example, as the number of bits occupying the overlapping region between the bitmap data representing the actual silhouette and the bitmap data representing each reference silhouette.

Furthermore, when calculating the degree of shape approximation between the actual silhouette and each reference silhouette, so that the baseline of the actual silhouette (which represents the position of the support surface 54) and the baseline of each reference silhouette match each other: The actual silhouette and each reference silhouette are superimposed on the bitmap memory. As a result, the actual silhouette and each reference silhouette are positioned relative to each other in the vertical direction (y-direction). On the other hand, the relative positioning in the horizontal direction (x-direction) is calculated so as to maximize the overlapping area between the actual silhouette and each reference silhouette.

Further, for each reference silhouette, the degree of shape approximation with respect to each reference silhouette is maximized while changing the magnification of the actual silhouette, and the maximum value is taken as the degree of representative approximation. The representative approximation of that reference silhouette is compared with the representative approximation similarly calculated for the remaining reference silhouettes, and the object category corresponding to the one for which the maximum representative approximation is obtained among all the reference silhouettes is The current object 30 is identified.

An exemplary relationship between multiple object categories and multiple reference silhouettes is conceptually represented in tabular form in FIG. As shown in the figure, a reference silhouette for humans is a silhouette of a simple vertically elongated shape, and a reference silhouette for an animal is a silhouette of a simple horizontally elongated shape, for example. Each reference silhouette has a straight line representing the support surface 54 as a baseline and is positioned relative to the baseline.

In the example shown in FIG. 9, standard silhouettes (according to the geometrical classification used in standardizing vehicles by their shape) are selected as the reference vehicle silhouettes. However, instead of this, a plurality of individual silhouettes for each vehicle type may be selected. By doing so, when the object 30 is identified as a vehicle, it is possible to further identify which vehicle type (for example, the name of the vehicle manufacturer) the vehicle 30 is.

At the bottom of FIG. 2, the software configuration of this system 10 is conceptually represented as a functional block diagram.

A user uses the communication terminal 90 . The communication terminal 90 may be a device carried by the user and having a wireless communication function, such as a mobile phone, a smart phone, a laptop computer, a tablet computer, a PDA, and the like. Alternatively, the communication terminal 90 may be one that is not carried by the user, such as an in-vehicle communication terminal or an in-vehicle computer mounted on the vehicle 30 .

The system 10 has a signal processing unit 100 connected to transmitter posts 62,62 and receiver posts 72,72 of each line sensor 50,52, respectively. The signal processing unit 100 is configured to perform object identification and entry/exit determination based on a plurality of signals from the receiver posts 72 and 72 of the line sensors 50 and 52 .

Specifically, the signal processing unit 100 is configured to include a computer (processor) 160 and a memory 162 in terms of hardware configuration. The memory 162 has a first storage unit 102 that stores the relationships illustrated in FIG. 6 and a second storage unit 104 that stores the relationships illustrated in FIG.

The signal processing unit 100 further includes a transmitter 106 that operates the plurality of transmitters 60 all at once and continuously (or discretely in time), and a target receiver (filtering unit) for performing target reception. ) 108.

The signal processing unit 100 further comprises a silhouette estimator 110 for estimating the actual silhouette of the vehicle 30 based on the reception result by the target receiver 108, and an object estimator 110 for identifying the object 30 based on the estimated actual silhouette. and an identification unit 112 .

The signal processing unit 100 further uses two line sensors 50 and 52 to determine whether the vehicle 30 (after the object 30 is identified as a vehicle) is in the warehousing stage or the warehousing stage. 114 and a speed acquisition unit 116 for acquiring the moving speed of the object 30 . The acquired moving speed is used, for example, when the silhouette estimation unit 110 synthesizes a plurality of one-dimensional information and converts it into two-dimensional information as described above.

The silhouette estimator 110 uses a straight line representing the support surface 54 as a baseline (see FIG. 9), and estimates the actual silhouette of the object 30 by positioning the two-dimensional information relative to the baseline.

For example, the speed acquisition unit 116 may be configured to receive a signal representing the moving speed of the object 30 and acquire the moving speed of the object 30 from the signal, or may be configured as a Doppler speedometer. may

Instead of these, the speed acquisition unit 116 detects the timing at which the object 30 passes the outer line sensor 50 (any receiver 72 in the outer line sensor 50 or a predetermined plurality of mutually continuous receivers 72 first ) and the timing at which the same object 30 passes the inner line sensor 52 (any receiver 72 in the inner line sensor 52 or a predetermined plurality of mutually continuous receivers 72 are both turned OFF first). The average moving speed of the object 30 is obtained by dividing the distance between the installation position of the outer line sensor 50 and the installation position of the inner line sensor 52 by the time difference between may be configured.

The signal processing unit 100 further includes a communication device 300 (see FIG. 18) for transmitting at least the execution result of the object identification section 112 and the execution result of the entry/exit determination section 114 to the management server 130 . The communication device 300 has, for example, long-range wireless communication capabilities.

The system 10 further includes a drive unit 120 and a power supply unit 122 connected to transmitter posts 62,62 and receiver posts 72,72 of each line sensor 50,52, respectively. The drive unit 120 supplies power to each transmitter 60 and receiver 70 from a power supply unit (commercial power supply, solar cell, battery, etc.) 122 . The drive unit 120 thereby causes the transmitter 60 to transition to a state of transmitting a signal and the receiver 70 to attempt to receive signals from several transmitters 60. transition to state.

However, the transmitter 60 and the receiver 70 may be of a self-contained type that can operate without power supply from the outside by a combination of a solar battery and a rechargeable battery (rechargeable battery).

The system 10 further includes a management server 130 operated by a management center 124 located remotely from the parking lot 20 . Management server 130 is capable of long-distance wireless communication with signal processing unit 100 .

The management server 130 combines the signal received from the signal processing unit (for example, installed in the parking lot 20 but may be installed outside the parking lot 20) 100 and the signal received from the communication terminal 90 of the user. has a parking lot management unit 132 that manages the parking lot 20 based on.

The management server 130 is connected to the payment server 140 for electronic payment of parking charges by the user.

<Object identification>

FIG. 10 conceptually shows a flow chart of an exemplary object identification program executed in the object identification section 112 of the signal processing unit 100 shown in FIG. In this embodiment, only the outer line sensor 50 is used for object identification, and the remaining inner line sensor 52 is used together with the outer line sensor 50 when entering/exiting.

This object identification program is pre-stored in memory 162 and executed by computer (especially processor) 160 as appropriate.

When this object identification program is executed, first, in step S1001, the plurality of transmitters 60 in the outer line sensor 50 are driven all at once so that the transmitters 60 each represent a unique transmitter ID. signal.

Next, in step S1002, the current scan is started for the object 30 (strictly speaking, the object 30 does not always exist in the vicinity of the outer line sensor 50), and the current time is set to the current scan timing t. _n (this time, n=1, in the example shown in FIG. 7, n=1, 2, 3, 4, . . . ), and stored in the memory 162. Here, "scanning" is physical scanning, not software scanning (sequential target reception for each receiver 70), for example, multiple transmitters 60 and multiple receivers 70 at a given moment. Similar to the event of trying to photograph an object 30 with .

Subsequently, in step S1003, each receiver 70 sequentially shifts to the above-described target reception mode.

After that, in step S1004, in preparation for a synthesis process (step S1016) that converts a plurality of pieces of one-dimensional information into two-dimensional information (actual silhouette of the object 30) (step S1016), the speed acquisition unit 116 is used to determine the current position of the vehicle 30. The vehicle speed is acquired and stored in the memory 162 in association with the current scan timing _tn .

Subsequently, in step S1005, one of the plurality of receivers 70 (for example, the highest receiver 70 or the lowest receiver 70) is selected as the target of this implementation, and for that one receiver 70 , the corresponding authorized transmitter ID, that is, the authorized transmitter ID pre-assigned to one transmitter (authorized transmitter) 60 facing each receiver 70 as shown in FIG.

After that, in step S1006, at least one signal received by the current receiver 70 from at least one transmitter 60 is converted into a real transmitter ID, and any real transmitter ID is converted to the read regular It is determined whether or not it matches the transmitter ID. If they match, the determination in step S1006 becomes YES, and in step S1007 it is determined that the current receiver 70 has received a valid signal. Subsequently, in step S1008, it is determined that the current receiver 70 is in the ON state.

On the other hand, if none of the at least one real transmitter ID converted from the signal received by the current receiver 70 matches the read regular transmitter ID (when the current receiver 70 (including the case where no signal is received from any transmitter 60), the determination in step S1006 is NO, and subsequently, in step S1009, it is determined that the current receiver 70 has not received a valid signal. Subsequently, in step S1010, it is determined that the current receiver 70 is in the OFF state.

In either case, after that, in step S1011, it is determined whether target reception has been completed for all receivers 70, that is, whether multiple target receptions (one reception event) belonging to the current scan have been completed. determine whether or not If not, the determination in step S1011 becomes NO, the process returns to step S1005, and the next receiver 70 performs target reception.

When target reception (one reception event) is completed for all receivers 70, the determination in step S1011 becomes YES. are associated with the height position of each receiver 70 in a bitmap format, for example, as shown on the left side of FIG. , is stored in the memory 162 . As a result, one column of one-dimensional information is generated for the current reception event. That is, among the plurality of receivers 70, those that have received the valid signal from the corresponding transmitter 60 and those that have not received the valid signal are distinguished from each other, and one-dimensional information is generated from the results.

After that, in step S1013, it is determined whether or not scanning (physical scanning of a predetermined number of time-discrete times) has been completed for all of the plurality of locations of the object 30 spatially discretely arranged in the front-rear direction. . Specifically, for example, it is determined whether or not the number of scans n has reached a preset upper limit _nmax .

Assuming that the number of scans n has not reached the upper limit _nmax this time, the determination in step S1013 is NO, and in step S1014, from the current scan timing _tn , a predetermined , that is, one sampling period Δt (see FIG. 8). The sampling period Δt is one fixed value that is common to all inter-scan time intervals (scan periods), but it may be a variable value, for example.

After one sampling period Δt has elapsed, the determination in step S1014 becomes YES, the process returns to step S1002, and the next scan of another portion of the same object 30 is started.

As a result of repeating steps S1002 to S1012 the required number of times, when the number of scans n reaches the upper limit value n _max , the determination in step S1013 becomes YES, and in step S1015, as illustrated in FIG. are developed or arranged on a bitmap 180 with an interval Δx in the x direction, thereby generating bitmap data as one piece of two-dimensional information.

As illustrated in FIG. 8, the bitmap data on the bitmap 180 has a plurality of black dots and a plurality of white dots arranged two-dimensionally.

A plurality of black dots in the bitmap data indicate that the corresponding receivers 70 are in the OFF state (transmitter signal cutoff state). On the other hand, a plurality of white dots indicate that the corresponding receivers 70 are in the ON state (transmitter signal transmitting state).

The bitmap 180 is a virtual two-dimensional map formed on the memory 162. Specifically, the horizontal axis is the traveling direction dimension (x-direction dimension) of the object 30, and the vertical axis is the height direction dimension of the object 30. It is a two-dimensional coordinate plane to which (y-direction dimension) is assigned. The height dimension of each part of the object 30 corresponds to the height dimension position of each part, that is, each receiver 70 from the baseline representing the height of the support surface 54 .

On the other hand, regarding the traveling direction dimension of the object 30, even if the interval Δx between adjacent dot rows among the plurality of dot rows on the bitmap 180 is a common fixed value for the plurality of dot rows, However, in this embodiment, the variable values are common to a plurality of dot rows.

Specifically, Δx is calculated as the product of the moving speed v of the object 30 and the sampling period Δt. As a result, Δx becomes longer as the moving speed v increases. The velocity v of object 30 is defined as the average velocity of movement of object 30 as it passes through entryway 40 .

On the other hand, the moving speed v of the object 30 may be defined, for example, as the individual moving speed when the object 30 passes through each scanning position on the entrance/exit passage 40. In this case, an example is shown in FIG. , the value of .DELTA.x is calculated separately for each scan, that is, for each dot row.

Furthermore, in this step S1015, an envelope circumscribing the outline of the group of black dots in the bitmap data is estimated as the actual silhouette of the object 30. FIG.

Then, in step S1016, as described above, the degree of shape approximation between the estimated actual silhouette and each of a plurality of candidate reference silhouettes (see FIG. 9) is calculated.

Subsequently, in step S1017, of the plurality of reference silhouettes, the one having the highest degree of shape approximation among the plurality of calculated degrees of shape approximation is selected as one reference silhouette representing the actual silhouette of the object 30 this time. be.

After that, in step S1018, it is identified whether the current object 30 is a vehicle, a human being, or an animal other than a human being according to the relationship illustrated in FIG. 9 from one selected reference silhouette. . The object 30 at this time is identified as a vehicle for the example shown. The identification result is stored in memory 142 , and the latest identification result is constantly shared with other programs in signal processing unit 100 , programs in communication terminal 90 and programs in management server 130 .

Note that if neither receiver 70 is in the ON state, then none of the reference silhouettes are selected, then the program determines in step S1018 that there are no objects within the entryway 40. .

The program then returns to step S1002 to start the next scan process.

As is clear from the above description, according to the present embodiment, even if each receiver 70 receives a signal from an unexpected transmitter 60, the signal is treated as a noise signal (a plurality of noise signals for each receiver 70). of the received signals that do not correspond to the effective signal), the shape of the object to be identified can be accurately measured.

<Distinguish entry/exit>

FIG. 11 conceptually shows a flow chart of an exemplary entering/leaving determination program executed in the entering/leaving determination section 114 of the signal processing unit 100 shown in FIG. In this embodiment, both the outer line sensor 50 and the inner line sensor 52 are used for determining whether the vehicle is entering or leaving the warehouse.

This entry/exit determination program is pre-stored in the memory 162 and executed by the computer (particularly the processor) 160 as appropriate.

<Detection of initial state>

When the entering/leaving determination program is executed, first, in step S1101, the outer line sensor 50 is completely turned on (no object exists in the vicinity of the outer line sensor 50, so neither receiver 70 is turned on). state). If the outer line sensor 50 is at least partially OFF (some receiver 70 is OFF because some object is in the vicinity of the outer line sensor 50), an object is present. Since there is a possibility, the determination is NO, and the process returns to step S1101.

On the other hand, if the outer line sensor 50 is completely ON, the determination in step S1101 becomes YES, and then in step S1102, the inner line sensor 52 is completely ON (no object is inside). It is determined whether the line sensor 52 is not in the vicinity of the line sensor 52). If the inner line sensor 52 is at least partially OFF, there is a possibility that an object is present, so the determination is NO and the process returns to step S1101.

On the other hand, if both the outer line sensor 50 and the inner line sensor 52 are completely ON, both the determination in step S1101 and the determination in step S1102 are YES. It is confirmed that a state in which no object exists at any place of . This initial state is indicated by "t ₁ " in each of the examples shown in FIGS. 12(a) and 12(b).

<Detection of warehousing stage>

Subsequently, in step S1103, it is determined whether or not the outer line sensor 50 is at least partially OFF (a state in which any object exists in the vicinity of the outer line sensor 50). If it is at least partially off, there is a possibility that an object exists, so the determination is YES, and the process proceeds to step S1104.

In step S1104, it is determined whether or not the inner line sensor 52 is completely ON (a state in which no object exists in the vicinity of the inner line sensor 52). If it is completely ON, there is a possibility that the object does not exist, so the determination is YES. This state is indicated by “t ₂ ” in the example shown in FIG. 12(a).

Subsequently, in step S1105, it is determined whether or not the outer line sensor 50 is completely ON (a state in which no object exists in the vicinity of the outer line sensor 50). If it is completely ON, there is a possibility that the object does not exist.

In step S1106, it is determined whether or not the inner line sensor 52 is at least partially OFF (a state in which any object exists in the vicinity of the inner line sensor 52). If it is at least partially OFF, there is a possibility that an object exists, so the determination is YES. This state is indicated by “t ₃ ” in the example shown in FIG. 12(a).

After that, in step S1107, it is determined that the current object is in the storage stage. The determination results are stored in memory 142 , and the latest determination results are constantly shared with other programs in signal processing unit 100 , programs in communication terminal 90 , and programs in management server 130 .

The program then returns to stage S1101.

<Detection of delivery stage>

If the determination in step S1103 or 1104 is NO, it is determined in step S1108 whether or not the outer line sensor 50 is completely ON. If it is completely ON, there is a possibility that the object does not exist, so the determination becomes YES and the process proceeds to step S1109.

In step S1109, it is determined whether the inner line sensor 52 is at least partially off. If it is at least partially OFF, there is a possibility that an object exists, so the determination is YES. This state is indicated by “t ₂ ” in the example shown in FIG. 12(b).

Subsequently, in step S1110, it is determined whether the outer line sensor 50 is at least partially OFF. If it is at least partially in the OFF state, there is a possibility that an object exists.

In step S1111, it is determined whether or not the inner line sensor 52 is completely ON. If it is completely ON, there is a possibility that the object does not exist, so the determination is YES. This state is indicated by “t ₃ ” in the example shown in FIG. 12(b).

After that, in step S1112, it is determined that the current object is in the delivery stage. The determination results are stored in memory 142 , and the latest determination results are constantly shared with other programs in signal processing unit 100 , programs in communication terminal 90 , and programs in management server 130 .

The program then returns to stage S1101.

<First abnormality determination>

FIG. 14 conceptually shows a flow chart of an exemplary first abnormality determination program executed in the first abnormality determination section 200 of the signal processing unit 100 as shown in FIG. This first abnormality determination program is executed for each line sensor 50, 52 to determine whether the operating states of the top end transmitter 60 and the top end receiver 70 are normal or abnormal.

When the first abnormality determination program is executed, first, in step S1401, the outer line sensor 50 is selected as the line sensor to be determined this time.

Next, in step S1402, it is determined whether or not the top end receiver 70 is effectively receiving a signal from the top end transmitter 60 for the line sensor to be determined this time. If the reception is valid, the determination in step S1402 becomes YES, and in step S1403, it is determined that the operation states of both the top end transmitter 60 and the top end receiver 70 are normal for the line sensor to be determined this time. do.

On the other hand, if the top end receiver 70 does not effectively receive the signal from the top end transmitter 60 for the line sensor to be determined this time, the determination in step S1402 becomes NO, and in step S1404, the current It is determined that at least one of the uppermost end transmitter 60 and the uppermost end receiver 70 of the determination target line sensor is abnormal.

After that, in step S1405, an abnormality determination result indicating that at least one of the top end transmitter 60 and the top end receiver 70 is in an abnormal operating state is transmitted to the management server 130 for the line sensor to be determined this time.

In response to the abnormality determination result, the management server 130 dispatches a worker to the corresponding parking lot 20 to inspect, repair, and make an exchange.

In either case, in step S1406, the line sensor on the opposite side of the line sensor to be determined this time is selected as the next line sensor to be determined. Subsequently, the program proceeds to step S1402, and steps S1402-S1405 are executed this time for the outer line sensor 50 and the inner line sensor 52 that are different from the previous one.

<Second abnormality determination>

FIG. 15 conceptually shows a flow chart of an exemplary second abnormality determination program executed in the second abnormality determination section 202 of the signal processing unit 100 as shown in FIG. This second abnormality determination program is executed to determine whether the postures of the line sensors 50 and 52 in the installed state are normal or abnormal.

When the first abnormality determination program is executed, first, in step S1501, the outer line sensor 50 is selected as the line sensor to be determined this time.

Next, in step S1502, it is determined whether or not the top end receiver 70 is effectively receiving a signal from the top end transmitter 60 for the current determination target line sensor. If the signal is received effectively, the determination in step S1502 becomes YES, and in step S1503 it is determined that both the transmitter post 62 and the receiver post 72 are upright for the line sensor to be determined this time.

This is because, as long as the operating state of the line sensor to be determined this time is normal, if both the transmitter post 62 and the receiver post 72 are upright, the top end receiver 70 and the top end transmitter 60 are connected to each other. This is because they face each other and there is no obstacle between them.

On the other hand, if the top end receiver 70 does not effectively receive the signal from the top end transmitter 60 for the line sensor to be determined this time, the determination in step S1502 becomes NO, and in step S1504, the current It is determined that at least one of the transmitter post 62 and the receiver post 72 of the determination target line sensor may be tilted.

This is because, as long as the operating state of the current determination target line sensor is normal, if at least one of the transmitter post 62 and the receiver post 72 is tilted, the top end receiver 70 and the top end transmitter 60 do not face each other, or there is a possibility that an obstacle exists between them.

After that, in step S1505, an abnormality determination result indicating that at least one of the transmitter post 62 and the receiver post 72 may be tilted is transmitted to the management server 130 for the current determination target line sensor.

In response to the result of the abnormality determination, the management server 130 dispatches a worker to the corresponding parking lot 20 to inspect, repair, and replace the transmitter post 62 and the receiver post 72 of the line sensor to be determined this time. let it happen

In either case, in step S1506, the line sensor on the opposite side of the line sensor to be determined this time is selected as the next line sensor to be determined. Subsequently, the program proceeds to step S1502, and steps S1502-S1505 are executed this time for the outer line sensor 50 and the inner line sensor 52 that are different from the previous one.

In addition, in this embodiment, the first abnormality determination unit 200 exists to determine whether there is an abnormality in the operating state of the end transmitter and the end receiver, and the second abnormality determination unit 202 exist for determining whether or not there is an abnormality in the posture of the line sensors 50 and 52 .

However, since the first anomaly determination unit 200 and the second anomaly determination unit 202 focus on the same phenomenon of presence/absence of communication between the edge transmitter and the edge receiver, strictly speaking, It is not possible to separate the phenomenon of abnormal operating states of the transmitter and end receivers from the phenomenon of abnormal attitudes of the line sensors 50 and 52 .

Therefore, if the first abnormality determination unit 200 and the second abnormality determination unit 202 are combined and there is no communication between the end transmitter and the end receiver, The present invention may be implemented in a manner in which it is determined that at least one of the device abnormality and the attitude abnormality of the line sensors 50 and 52 exists.

Even in this mode, although the true type of abnormality may not be accurately determined remotely, it is possible to accurately remotely determine whether or not it is necessary to dispatch a worker to the parking lot 20. Therefore, it is easier to reduce labor costs for the workers than in the case where the workers are dispatched to the parking lot 20 on a regular basis in anticipation of waste.

<Failure Diagnosis>

FIG. 16 conceptually shows a flow chart of an exemplary failure diagnosis program executed in the failure diagnosis section 204 of the signal processing unit 100 as shown in FIG.

When this fault diagnosis program is executed, first, in step S1601, it is determined whether or not an interrupt signal has been generated by execution of another activation timing control program (not shown). The interrupt signal is a signal for controlling the activation timing of this fault diagnosis program.

If the interrupt signal does not exist, the determination in step S1601 becomes NO, and the execution of the same steps is repeated. Execution of the identification program, the entering/leaving determination program shown in FIG. 11, the first abnormality determination program shown in FIG. 12, and the second abnormality determination program shown in FIG. ) is temporarily prohibited.

Subsequently, in step S1603, the plurality of transmitters 60 in the outer line sensor 50 and the plurality of transmitters 60 in the inner line sensor 52 are driven all at once, so that the transmitters 60 each generate a unique transmitter ID. It emits multiple signals that represent

After that, in step S1604, the plurality of receivers 70 in the outer line sensor 50 and the plurality of receivers 70 in the inner line sensor 52 sequentially perform the above-described random reception. As a result, it would be expected that at least one real transmitter ID would be assigned to each receiver 70 for each of the outer line sensor 50 and the inner line sensor 52 .

Subsequently, in step S1605, for each of the outer line sensor 50 and the inner line sensor 52, by referring to the plurality of actual transmitter IDs assigned to each receiver 70 as described above, all receivers 70 (or some receivers 70 ) do not receive signals from the same transmitter 60 .

If all the receivers 70 (or some receivers 70) do not receive a signal from the same transmitter 60 for both or either of the outer line sensor 50 and the inner line sensor 52, the determination of step S1605 becomes YES, and in step S1606, it is determined that the corresponding one of the outer line sensor 50 and the inner line sensor 52 has its transmitter 60 out of order. That is, the transmitter 60 is determined to be the faulty transmitter.

Subsequently, in step S1607, for the corresponding one of the outer line sensor 50 and the inner line sensor 52 (the one having the fault transmitter 60), the fault diagnosis result indicating that the transmitter 60 is faulty is displayed. It is transmitted to the management server 130 in association with the transmitter ID for identifying the transmitter 60 . The program then returns to step S1601.

Upon receiving the failure diagnosis result, the management server 130 dispatches a worker to the corresponding parking lot 20 to inspect, repair, and replace the failure transmitter 60 .

On the other hand, if the determination in step S1605 is NO, any receiver 70 receives a signal from any transmitter 60 by referring to the plurality of actual transmitter IDs in step S1608. determine whether or not

If any receiver 70 does not receive a signal from any transmitter 60 for either or both of the outer line sensor 50 and inner line sensor 52, the determination in step S1608 becomes YES, and step S1609. , it is determined that the corresponding receiver 70 out of the outer line sensor 50 and the inner line sensor 52 (the one having the faulty receiver 70) is faulty. That is, the receiver 70 is determined to be the faulty receiver.

Subsequently, in step S1610, for the corresponding one of the outer line sensor 50 and the inner line sensor 52 (the one having the faulty receiver 70), the fault diagnosis result indicating that the receiver 70 is faulty is displayed. It is transmitted to the management server 130 in association with the transmitter ID for identifying the receiver 70 . The program then returns to step S1601.

Upon receiving the failure diagnosis result, management server 130 dispatches a worker to the corresponding parking lot 20 to inspect, repair, and replace faulty receiver 70 .

On the other hand, if both the determination in step S1605 and the determination in step S1708 are NO, in step S1611, the corresponding outer line sensor 50 and inner line sensor 52 (both the failure receiver 70 and the failure transmitter 60) non-existent), it is determined that all transmitters 60 and all receivers 70 are normal.

After that, in step S1612, the restart of the actual operation is permitted. The program then returns to step S1601.

<Parking management>

FIG. 17 conceptually shows a flow chart of an exemplary parking management program executed in the parking management unit 132 of the management server 130 shown in FIG.

When this parking lot management program is executed, first, in step S1701, the communication terminal 90 of the user transmits a request signal for logging into the management server 130 together with necessary personal information such as a user ID to the management server 130. do. On the other hand, when receiving the request signal, the management server 130 recognizes the communication terminal 90 and establishes communication with the communication terminal 90 .

In step S1711, the management server 130 communicates with the signal processing unit 100, receives the object identification result from the memory 162, and refers to it to determine whether the object 30 passing through the entrance/exit passage 40 of the parking lot 20 is a vehicle. Determine whether or not there is If the object 30 is not a vehicle, the determination is NO and the process returns to step S1711. If the object 30 is a vehicle, the determination is YES and the process proceeds to step S1712.

In step S1712, management server 130 communicates with signal processing unit 100, receives the entry/exit determination result from memory 162, and refers to it to determine whether vehicle 30 has entered parking lot 20 or not. judge. If it is determined that the vehicle 30 has entered the parking lot 20, the determination in step S1712 becomes YES, and the process proceeds to step S1713.

In step S1713, management server 130 selects one of the plurality of vacant rooms in parking lot 20 as the current user's cabin. The relationship between the user ID and the cabin number in use is stored in the memory of the management server 130 .

When the passenger compartment of the current user is selected, management server 130 transmits the selected passenger compartment to communication terminal 90 of the current user in step S1714.

In response to this, the communication terminal 90 receives information about the vehicle compartment from the management server 130 in step S1702, and then transmits a warehousing request to the management server 130 in step S1703.

Upon receiving the warehousing request, the management server 130 measures the current time and stores the warehousing time in the memory as the current time in step S1715. Subsequently, in step S1716, a warehousing completion signal indicating that the warehousing procedure is completed is transmitted to the communication terminal 90 of the current user.

On the other hand, the communication terminal 90 receives the warehousing completion signal from the management server 130 in step S1704.

The case where the management server 130 determines in step S1712 that the vehicle 30 has entered the parking lot 20 has been described above. If the management server 130 determines in S1717 whether or not the vehicle 30 has left the parking lot 20, the determination is YES. If the determination in step S1717 is NO, the process returns to step S1711.

After that, in step S1718, the management server 130 measures the current time and stores the leaving time in the memory as the current time. Subsequently, in step S1719, the parking time for the current user is read from the memory, and the parking time is calculated as the elapsed time from the parking time to the parking exit time.

Thereafter, in step S1720, management server 130 calculates a parking fee corresponding to the calculated length of parking time, and transmits data representing the parking fee to communication terminal 90 of the current user.

In response to this, the communication terminal 90 receives the data representing the parking fee from the management server 130 in step S1705, and then transmits a delivery request to the management server 130 in step S1706.

Upon receiving the delivery request, management server 130 electronically settles the parking fee by communicating with settlement server 140 in step S1721. Subsequently, in step S1722, a delivery completion signal indicating completion of the delivery procedure is transmitted to the communication terminal 90 of the current user.

In response to this, the communication terminal 90 receives the delivery completion signal from the management server 130 in step S1707.

By the way, in the stage in which the vehicle 30 enters the parking lot 20, normally, the vehicle 30 first approaches the entrance/exit passage 40 of the parking lot 20 from the outside of the parking lot 20, and eventually the vehicle 30 moves to the parking lot 20. With the user on board 30, the outer line sensor 50 is passed inward.

After that, when the user drives the vehicle 30 to a predetermined compartment and enters and parks there, the user gets off the vehicle 30 . Subsequently, the user walks alone in the parking lot 20 to the entrance/exit passage 40, and eventually passes the outside line sensor 50 in the opposite direction, that is, outward.

At this time, the user's communication terminal 90 passes outward through the outer line sensor 50 and then receives a signal from its at least one transmitter 60, so that the actual transmission of said at least one transmitter 60 You can get the device ID.

Therefore, even if the communication terminal 90 transmits the acquired real transmitter ID together with the user ID (an example of the user identification information) to the management server 130 in the aforementioned step S1701 shown in FIG. good.

In this case, management server 130 may determine whether or not the actual transmitter ID received from communication terminal 90 belongs to outside line sensor 50 of parking lot 20 .

When it is determined that the actual transmitter ID belongs to the outer line sensor 50 of the parking lot 20, the management server 130 executes the object identification program among the received user ID and the plurality of vehicle categories shown in FIG. (for example, object category No. 1 in the example shown in FIG. 2), and pairs of the user and the vehicle 30 may be stored in the memory.

Similarly, in the stage in which the vehicle 30 leaves the parking lot 20, the user usually first walks alone from the outside of the parking lot 20 to approach the entrance/exit passage 40, and eventually turns the outside line sensor 50 inward. pass through.

After that, the user walks in the parking lot 20 to his/her compartment and gets into the vehicle 30 parked there. Subsequently, the user starts the vehicle 30 and drives it through the parking lot 20 to approach the entrance/exit passage 40 . After that, the vehicle 30 passes the outer line sensor 50 outward.

At this time, since the user's communication terminal 90 passes inwardly through the outer line sensor 50 and then receives a signal from its at least one transmitter 60, the actual transmission of said at least one transmitter 60 You can get the device ID.

Therefore, the communication terminal 90 may transmit the acquired real transmitter ID together with the user ID to the management server 130 in step S1701 described above (at the time of leaving the car).

In this case, management server 130 may determine whether or not the actual transmitter ID received from communication terminal 90 belongs to outside line sensor 50 of parking lot 20 .

When it is determined that the actual transmitter ID belongs to the outer line sensor 50 of the parking lot 20, the management server 130 executes the object identification program among the received user ID and the plurality of vehicle categories shown in FIG. (for example, object category No. 1 in the example shown in FIG. 2), and pairs of the user and the vehicle 30 may be stored in the memory.

If the pair stored in the memory at the time of entering and the pair stored in the memory at the time of leaving match each other, it can be determined that the current user has been classified into the same vehicle category. This may be interpreted to mean that the accuracy of object identification was high, and thus the accuracy of linking the user and the vehicle 30 was high.

As a result, for example, when the user repeatedly uses the parking lot 20, the management center 124 can acquire valuable information such as the type of vehicle 30 used as personal information about the individual user. . The management center 124 can also utilize this personal information for future parking lot marketing.

Further, when the plurality of reference silhouettes are more vehicle silhouettes than the plurality of standard silhouettes illustrated in FIG. When the vehicle is parked in the parking lot 20 a plurality of times, the vehicle is normally classified as the same model silhouette, but due to the measurement error of the outer line sensor 50, the vehicle is classified into a plurality of model silhouettes in a dispersed manner. there is a possibility.

However, each time the same vehicle is parked in the parking lot 20, the user is associated with the vehicle category, so that the same user is most often associated with the same user when associated with multiple vehicle categories. It is possible to identify one vehicle category as the true vehicle category. In this case, as the number of links, that is, the number of sample data increases, the vehicle identification accuracy improves.

[Second embodiment]

An object identification system 10 according to a second exemplary embodiment of the present invention will now be described, wherein elements in common with the first embodiment are referenced using the same names or numerals: Duplicate descriptions are omitted, and only different elements are described in detail.

In the first embodiment, the outer line sensor 50 is used to realize the function (use) of object identification and the function (use) of entering/leaving determination. It is also used to realize functions (uses) of user identification and linking of users and vehicles.

In the system 10 according to the present embodiment, portions for realizing the function (application) of object identification and the function (application) of entering/exiting determination are common to those of the first embodiment, and redundant description is omitted. However, a detailed description will be given of the part for realizing the function (purpose) of identifying the user and linking the user and the vehicle.

FIG. 18 shows a front view of the outer line sensor 50 of the object identification system 10 according to this embodiment. A plurality of signals transmitted from the transmitter post 62 shown in FIG. and those transmitted through the window glass of the vehicle 30 and entered into the vehicle interior and received by the communication terminal 90 of the user as a passenger.

As shown in the figure, the signal processing unit 100 has a communication device 300 , and the management server 130 has a user/vehicle linking section 310 . The signal processing unit 100 transmits necessary information to the management server 130 via the communication device 300, and the user/vehicle linking unit 310 is activated based on the necessary information. The management server 130 also communicates with the user's communication terminal 90 .

FIG. 19 conceptually illustrates a flow chart of an exemplary user-vehicle tying program executed in the user-vehicle tying unit 310 together with a user identification support program executed in the user's communication terminal 90 . .

When the user/vehicle linking program is activated, the management server 130 first receives a signal representing the reception result of the receiver post 72 of the outside line sensor 50 from the signal processing unit 100 in step S1931. Further, based on the signal, whether the outer line sensor 50 is at least partially OFF, that is, the outer line sensor 50 is detecting some object (currently, on the entrance/exit passage 40 of the parking lot 20). object exists).

If the outer line sensor 50 is not at least partially OFF, a negative determination returns to step S1931, but if the outer line sensor 50 is not at least partially OFF. , the determination in step S1931 becomes YES, and the process proceeds to step S1932.

In this step S1932, a reception request is transmitted to the communication terminal 90 of the user by referring to the user ID.

On the other hand, communication terminal 90 attempts to receive signals from multiple transmitters 60 in step S1901. Subsequently, in step S1902, each received signal is converted into a real transmitter ID. Thereafter, in step S1903, the real transmitter ID is associated with the user ID and transmitted to management server .

In response, management server 130 associates the real transmitter ID with the user ID and receives it from communication terminal 90 in step S1933. Subsequently, in step S 1934 , an object identification result, which is the execution result of the object identification section 112 , is received from the signal processing unit 100 . Thereafter, in step S1935, the object identification unit 112 determines whether or not the object has been identified as the vehicle 30. FIG.

If the object is not identified as the vehicle 30 by the object identification unit 112, the determination is NO, and the process returns to step S1931. If the object is identified as the vehicle 30, the determination in step S1935 is YES. , in step S1936, whether or not the actual transmitter ID received from the communication terminal 90 belongs to the outer line sensor 50, that is, the actual transmitter IDs of the multiple transmitters 60 belonging to the transmitter post 62 of the outer line sensor 50. It is determined whether or not it matches any of the machine IDs.

If the actual transmitter ID received from the communication terminal 90 does not belong to the outer line sensor 50, the determination is NO, and the process returns to step S1931. received from the signal processing unit 100 the vehicle reference silhouette number (or the vehicle type) assigned to the vehicle 30 of FIG.

Subsequently, in step S1938, the management server 130 associates the current user (eg, user ID) with the current vehicle 30 (eg, current vehicle reference silhouette number (or vehicle type)). After that, in step S1939, the linking result is listed and saved in a user/vehicle linking list as illustrated in FIG.

[Other embodiments]

1. first idea

A vehicle (an example of a moving object as an inanimate object) entering or exiting a facility (for example, a parking lot) to be remotely managed by a management server and a user (an example of a living object) who uses the vehicle ) to identify and manage the
a passage provided in the facility and common to vehicles and users;
A line sensor installed in the passageway and extending in a direction intersecting the traveling direction of an object passing through the passageway, wherein the object is relatively scanned in its traveling direction to acquire the silhouette of the object. , which performs object identification processing based on its silhouette;
a first determination unit provided in the facility or the management server and configured to determine whether the object is a vehicle based on the acquired silhouette;
a vehicle type determination unit provided in the facility or the management server and configured to determine the type of the vehicle based on the acquired silhouette;
a photographing device provided in the facility for photographing an object positioned on the passage, wherein the vehicle is photographed as a vehicle image in conjunction with the object identification processing, the determination, or the determination in terms of time;
A vehicle/user identification management system, comprising: a vehicle identification information acquisition unit provided in the facility or the management server for acquiring vehicle identification information, which is identification information of the vehicle, based on the captured vehicle image.

moreover,
a transmitter that is provided in the facility and transmits a unique signal;
A communication terminal of a user in the vehicle, which, when receiving a signal from the transmitter, transmits a user ID or a terminal ID of the communication terminal in response to the signal in association with the ID of the facility to the management server. and
A vehicle/user identification management system in which the management server associates the facility, the vehicle type, the vehicle identification information, and the user ID or terminal ID with each other and registers these elements in a list.

2. second idea

A vehicle (an example of a moving object as an inanimate object) entering or exiting a facility (for example, a parking lot) to be remotely managed by a management server and a user (an example of a living object) who uses the vehicle ) to identify and manage the
a passage provided in the facility and common to vehicles and users;
A line sensor installed in the passageway and extending in a direction intersecting the traveling direction of an object passing through the passageway, wherein the object is relatively scanned in its traveling direction to acquire the silhouette of the object. , which performs object identification processing based on its silhouette;
a second determination unit provided in the facility or the management server and configured to determine whether the object is a person based on the acquired silhouette;
A photographing device provided in the facility for photographing an object located on the passageway, which photographs the user as a human image in conjunction with the object identification processing or the determination in terms of time. User identification management system.

moreover,
a transmitter that is provided in the facility and transmits a unique signal;
A communication terminal of a user in the vehicle, which, when receiving a signal from the transmitter, transmits a user ID or a terminal ID of the communication terminal in response to the signal in association with the ID of the facility to the management server. and
A vehicle/user identification management system in which the management server associates the facility, the human image, and the user ID or terminal ID with each other and registers these elements in a list.

3. Third idea

A vehicle (an example of a moving object as an inanimate object) entering or exiting a facility (for example, a parking lot) to be remotely managed by a management server and a user (an example of a living object) who uses the vehicle ) to identify and manage the
a passage provided in the facility and common to vehicles and users;
A line sensor installed in the passageway and extending in a direction intersecting the traveling direction of an object passing through the passageway, wherein the object is relatively scanned in its traveling direction to acquire the silhouette of the object. , which performs object identification processing based on its silhouette;
a determination unit provided in the facility or the management server and configured to determine whether the object is a vehicle or a person based on the acquired silhouette;
a photographing device provided in the facility for photographing an object positioned on the passage;
Classify the photographed object image provided in the facility or the management server as a vehicle image when the object is determined to be a vehicle, and classify the object image as a vehicle image when the object is determined to be a human being. is an image classification unit that classifies as a user's human image;
A vehicle/user identification management system, comprising: a vehicle-related information acquisition unit provided in the facility or the management server, and acquiring vehicle-related information related to the vehicle based on the captured vehicle image.

moreover,
a transmitter that is provided in the facility and transmits a unique signal;
A communication terminal of a user in the vehicle, which, when receiving a signal from the transmitter, transmits a user ID or a terminal ID of the communication terminal in response to the signal in association with the ID of the facility to the management server. and
A vehicle/user identification management system in which the management server associates the facility, the vehicle-related information or the human image, and the user ID or terminal ID with each other, and registers these elements in a list.

4. First embodiment

A method for identifying and managing vehicles entering or exiting a facility (for example, a parking lot) to be remotely managed by a management server and users of the vehicles, comprising:
Said facility is
A passageway common to a vehicle and a user and having first and second locations spaced apart from each other, wherein when an object, being a vehicle or user, travels through the passageway from the first location toward the second location, the entering the facility and, conversely, following the passageway from the second location toward the first location will result in exiting the facility;
a first line sensor installed at the first position, which acquires a silhouette of an object passing therethrough by irradiation with electromagnetic waves;
a first signal processing circuit that determines whether the object is a vehicle or a person based on the signal from the first line sensor;
a first communication device that transmits a processing result of the first signal processing circuit to the management server;
a photographing device for photographing an object positioned on the passage;
a first transmitter that is installed at or near the first position and emits a unique signal,
The method is
determining whether the object is a vehicle or a user by the first line sensor and the first signal processing circuit when the object reaches the first position before the second position;
a step of determining that the vehicle is in a vehicle entering stage in which the vehicle enters the parking lot when the object is determined to be a vehicle at the first position;
When it is determined that the vehicle is in the parking stage, the communication terminal of the user in the vehicle receives the signal from the first transmitter and, in response, transmits the parking lot ID identified by the signal. a step of transmitting a user ID or a terminal ID of the communication terminal as user information to the management server as parking lot information;
When the object is determined to be a vehicle at the first position, the vehicle is photographed by the photographing device, a predetermined type of information is extracted as vehicle information from the photographed result, and the first a communication device transmitting the extracted vehicle information together with the parking lot ID to the management server;
A step in which the management server associates the user information and the vehicle information with each other by associating them with the same parking lot ID, and registers the result in a management list.

5. Second embodiment

moreover,
a second line sensor installed at the second position, which obtains a silhouette of an object passing therethrough by irradiation with electromagnetic waves;
a second signal processing circuit that determines whether the object is a vehicle or a person based on the signal from the second line sensor;
a second communication device that transmits the processing result of the second signal processing circuit to the management server;
a second transmitter located at or near the second location, which emits a unique signal;
The method is
determining whether the object is a vehicle or a user by the second line sensor and the second signal processing circuit when the object reaches the second position before the first position;
determining that the user is in a user exit stage in which the user exits the vehicle and walks alone to exit the parking lot when the object is determined to be the user at the second position;
When it is determined that the user is in the leaving phase, the communication terminal of the walking user receives the signal from the second transmitter and, in response, transmits the parking lot ID identified by the signal to the parking lot. a step of transmitting a user ID or a terminal ID of the communication terminal as second user information to the management server as information;
When it is determined that the object is the user at the second position, the image capturing device captures a human image (human image) of the user, and the second communication device captures the human image together with the parking lot ID. sending to the management server;
A step in which the management server associates the second user information and the human image with the same parking lot ID, and registers the result in the management list.

6. Hardware configuration (see FIG. 21(a))

(1) First and second line sensors 50, 52 for object identification
A first line sensor installed at a first position on the upstream side in the traveling direction of the object for object identification (in the example shown in FIG. 21, for example, focusing on the warehousing stage, the outer line sensor 50 corresponds) and a second line sensor installed at a second position on the downstream side in the traveling direction of the object for object identification (in the example shown in FIG. 21, for example, when focusing on the warehousing stage, the inner line sensor 52 corresponds ) is used.

(2) A parking lot identification transmitter 60 that enables the user to identify the parking lot where the user is currently located using the user terminal 90
This parking lot identification transmitter has a function of transmitting a signal unique to the parking lot 20 and unique to the transmitter to the user terminal 90 by a short-range wireless method. In the example shown in FIG. 21, this parking lot identification transmitter is at least one of a plurality of transmitters 60 mounted on the outer and inner line sensors 50 and 52 .
In another example, although not shown, this parking lot identification transmitter is dedicated to the corresponding parking lot 20 separately from the plurality of transmitters mounted on the first and second line sensors. At least one transmitter installed.

(3) Imaging device 300
A photographing device is used to photograph objects in the parking lot 20 as moving images or still images. An example of this imaging device is the digital camera 300 .

This photographing device is installed in the corresponding parking lot 20. Specifically, for example, it may be installed in the outer line sensor 50 as shown in the figure, or may be installed in the inner line sensor 52 (not shown). Alternatively, although not shown, it may be installed at a position away from any of the line sensors 50 and 52 .

In the illustrated example, when the vehicle 30 enters the parking lot 20 along the entrance/exit passage 40 of the parking lot 20, the camera 300 detects the position of the vehicle 30 when the vehicle 30 reaches the second downstream position. is photographed, and as a result, the license plate 31 on the rear end surface of the vehicle 30 is photographed.

Further, in the illustrated example, when the vehicle 30 enters a vehicle interior in the parking lot 20 and the user gets out of the vehicle 30 and exits the parking lot 20 alone this time, the camera 300 detects the above-mentioned When the second position is reached, the user is photographed, and as a result, the entire figure of the user, specifically the whole front image or the whole rear image of the user, especially the face image of the user is photographed. .

Further, in the illustrated example, the camera 300 allows the user to enter the parking lot 20 by himself in order to let the vehicle 30 exit from a certain compartment in the parking lot 20. Once in position, the user is photographed, resulting in a full portrait of the user, specifically a full back view of the user.

(4) Signal processing unit 100 in object identification system 10
In the example shown in FIG. 21, the signal processing unit 100 outputs drive signals to the line sensors 50 and 52 to drive each line, as in the first and second embodiments described above. Sensors 50 and 52 are driven simultaneously or sequentially, and sensor signals are received simultaneously or sequentially from each line sensor 50 and 52 .

Further, the signal processing unit 100 drives the camera 300 by outputting drive signals to the camera 300 and further receives image signals from the camera 300 .

(5) Management server 130
The management server 130 is installed in a management center 130 installed in a remote location of the corresponding parking lot 20 . The management server 130 typically centrally and remotely manages a plurality of geographically different parking lots 20 .

(6) Communication device 200
The communication device 200 has a function of communicating between the object identification system 10 installed in the parking lot 20 and the management server 130 installed in the remote management center 130. .

The communication device 200 may be wirelessly or wiredly connected to the object identification system 10 , but is typically wirelessly connected to the management server 130 .

The communication device 200 may be installed individually on the first and second line sensors 50 and 52, or may be installed commonly on the line sensors 50 and 52, that is, on the corresponding parking lot 20. .

(7) Vehicle 30 as a parking target
As shown in FIG. 21(a), a vehicle 30 has pick-up plates 31 on its front end surface and rear end surface, respectively. vehicle registration number) is displayed immovably.

(8) Behavior of the vehicle 30 and the user in the parking lot 20 In FIG. For each, a series of phases are defined that are observed during each stage.

Further, the table includes, in association with some of the phases, reference drawings showing flow charts conceptually representing exemplary programs executed during the corresponding phases. there is

7. Software configuration

<When an object enters the parking lot 20>

When the object reaches a first position on the upstream side in the approach direction, the first line sensor 50 acquires the silhouette of the object in the left-right direction at the first position. If it is determined that the user is a vehicle, it is determined that the user is in the stage of driving the vehicle and entering a compartment in the parking lot 20 .

<When it is determined that the object is the vehicle 30 at the first position (the stage in which the user drives the vehicle 30 (in a riding state) and enters the parking lot 20>)

In the first position, the signal processing unit 100 receives the sensor signal from the outer line sensor 50 (a train of individual sensor signals from multiple receivers 70 in line), as in some of the previous embodiments. ), and furthermore, when it is determined that the object is a vehicle 30 using a silhouette image represented by a plurality of time-series sensor signals as a scanning result, the type of the vehicle 30 is determined, and any type of vehicle 30 is determined. When it is determined that it is, the communication device 200 transmits the determination result to the management server 130 as the first vehicle information (for example, the vehicle and the type of the vehicle).

After that, when the vehicle 30 reaches a second position downstream of the first position in the direction of entry, the signal processing unit 100 captures a still image or a moving image of the vehicle 30 using the camera 300 at the arrival timing. The photographed result is transmitted from the communication device 200 to the management server 130 as second vehicle information (for example, a vehicle image that is the appearance of the vehicle, the vehicle number recognized from the photographed license plate 31).

Further, the signal processing unit 100 determines that the vehicle 30 is in the parking lot 20 stage when the same vehicle 30 passes through the first position and the second position in that order.

On the other hand, when the communication terminal 90 carried by the user riding in the vehicle 30 receives the signal from the transmitter 60, it responds with a terminal ID unique to the communication terminal 90 (or a user ID, a user phone number, etc.). number, e-mail address for the user, etc.) is transmitted to the management server 130 as user information.

As a result, the management server 130 associates the current user with the terminal ID of the communication terminal 90 of the user, the type (vehicle type) of the vehicle 30 of the user, and the vehicle number of the vehicle 30. Then, the result is registered in the vehicle/user management list illustrated in FIG.

The signal processing that has been outlined above will be illustrated in more detail later with reference to FIGS. 22 to 24. FIG.

<When the object is determined to be a person at the first position (when the user enters the parking lot 20 alone)>

After determining that the object is a person at the first position, when the person (user) reaches the second position, the signal processing unit 100 uses the camera 300 at the arrival timing to capture the user as a still image or A moving image is captured, and the captured result is transmitted from the communication device 200 to the management server 130 as second human information (human image).

Further, the signal processing unit 100 determines that the same person enters the parking lot 20 alone when the same person passes the first position and the second position in that order.

On the other hand, when the communication terminal 90 carried by the walking user receives the signal from the transmitter 60, in response, the terminal ID unique to the communication terminal 90 is transmitted to the management server 130 as user information.

As a result, the management server 130 associates the current user with the person image of the user and the terminal ID of the communication terminal of the user.

The signal processing briefly described above will be illustrated in more detail later with reference to FIGS. 22, 28 and 29. FIG.

<When an object leaves the parking lot 20>

When the object reaches the second position, the second line sensor 52 is used to obtain a lateral silhouette of the object at the second position, and it is determined from the silhouette whether the object is a person or a vehicle. do.

<When the object is determined to be a person at the second position>

At the second position, the signal processing unit 100 captures the human as a still image or a moving image using the camera 300 at the timing when the object is determined to be a human, and uses the human image as a first human. It is transmitted from the communication device 200 to the management server 130 as information.

Furthermore, the signal processing unit 100 determines that the same person exits the parking lot 20 alone when the same person passes the second position and the first position in that order.

On the other hand, when the communication terminal 90 carried by the walking user receives the signal from the transmitter 60, in response, the terminal ID unique to the communication terminal 90 is transmitted to the management server 130 as user information.

The management server 130 identifies the current user by matching the newly received user information with the saved other user information, and assigns the person image to the user.

The signal processing briefly described above will be illustrated in more detail later with reference to FIGS. 23, 26 and 27. FIG.

<When it is determined that the object is the vehicle 30 at the second position>

At the second position, the signal processing unit 100 shoots the vehicle 30 as a still image or a moving image using the camera 300 at the timing when the object is determined to be the vehicle 30, and transmits the shooting result from the communication device 200 to the management server. 130.

Further, the signal processing unit 100 determines that the vehicle 30 is in the stage of leaving the parking lot 20 when the same vehicle 30 passes the second position and the first position in that order.

On the other hand, when the communication terminal 90 carried by the user on board the vehicle 30 receives the signal from the transmitter 60, in response, the management server 130 receives the terminal ID unique to the communication terminal 90 as user information. Send to

The management server 130 identifies the current user by matching the newly received user information with the saved other user information, and assigns the person image to the user.

The signal processing that has been outlined above will be illustrated in more detail later with reference to FIGS. 23 and 30. FIG.

Multiple optional features

(1) Method of photographing by camera 300 for acquiring evidence showing that user is in vehicle 30

At the arrival timing, the camera 300 is used to capture an image of the interior of the vehicle 30 that indicates who is in the vehicle 30, and the communication device 200 manages the imaged result as boarding state information. Send to server 130 .

(2) Case classification

When the dedicated application has already been downloaded to the communication terminal 90 before entering (when the management server 130 receives both the silhouette information and the terminal ID at the first location)
When the dedicated application is downloaded to the communication terminal 90 for the first time after entering (at the first location, the management server 130 receives the silhouette information but does not receive the terminal ID).

(3) Installation of multiple cameras 300 with different heights

A plurality of cameras 300 are installed so that their height positions are different from each other, and one of the cameras 300 corresponding to the type of vehicle 30 classified with respect to the height dimension of the vehicle is selected. , the camera 300 is used to photograph the vehicle 30 . Those cameras 300 include cameras installed at the same height as the license plate 31 of the vehicle 30 .

(4) Select photo

The camera 300 shoots a plurality of photographs in time series by continuous shooting at the time of imaging, selects a photograph in which a target of interest is in focus from among the plurality of photographs, and selects the photograph. Create a database using

(5) Users of the parking lot 20 are classified into members who have personally registered in advance and non-members. If the user is a member, the personal information is registered in the management center 124 in advance. If you are a member, no such deterrent will work against you.

Furthermore, when the user is a member, a dedicated application is pre-installed on the user's communication terminal 90, and the communication terminal 90 receives a signal from the transmitter 60 of the parking lot 20 and interprets it. and may be further transmitted to management server 130 in response to its receipt.

As a result, on the management server 130, the user ID or the terminal ID of the communication terminal 90 and the parking-related information about the same user (for example, the type of the vehicle 30 based on the aforementioned silhouette) can be associated with each other.

On the other hand, when the user is a non-member, unlike the case where the user is a member, the above-mentioned dedicated application is not pre-installed in the user's communication terminal 90, and therefore the transmitter of the parking lot 20 60, it cannot interpret it or transmit it to management server 130 in response.

Therefore, on the management server 130, the user ID or the terminal ID of the communication terminal 90 and the parking-related information about the same user cannot be associated with each other.

Therefore, in the latter case, the vehicle license plate 31 is photographed by the camera 300 installed in the parking lot 20, and the image of the user is photographed by the camera 300 or another camera. Furthermore, at least one of the type of vehicle 30 and the vehicle license plate 31 based on the silhouette described above and the user's portrait are associated with each other. Thereby, the behavior of non-member users in the parking lot 20 is monitored, and if there is fraudulent activity, the vehicle license plate 31 and the person's image are used as evidence to prove it.

Furthermore, a two-dimensional display (for example, an LCD display or an LED display with a lower resolution) is installed in the parking lot 20 at a position that is easily visible to the user. On the screen of the two-dimensional display, the above-mentioned vehicle silhouette image (one-dimensional image obtained by the line sensors 50 and 52 is developed into a two-dimensional image) is extracted from the image of the vehicle 30 photographed by the camera 300 depending on the case. display with added colors.

The two-dimensional display displays a vehicle silhouette image of the user who parks the vehicle 30 in the parking lot 20 , gets off the vehicle 30 , and walks out of the parking lot 20 .

At this time, the two-dimensional display may statistically display the vehicle silhouette image even during a time period when illegal activities increase in the parking lot 20, for example, at night.

In addition, when the two-dimensional display itself or the line sensors 50 and 52 sense the user (when the object is determined to be a person), the two-dimensional display timely identifies the vehicle silhouette image in response. users may be targeted and displayed. In this way, it is possible to effectively exert pressure on the user that the user is being individually monitored.

Thereby, the user may realize that the vehicle silhouette image currently displayed on the screen of the two-dimensional display is that of his/her own vehicle 30 . The user may then unknowingly associate their actions with being individually monitored by the parking lot 20 (in a different way than being generally monitored by a normal surveillance camera). unknown.

This may act as psychological pressure on the user to deter fraudulent behavior. As a result, it becomes easy to prevent an increase in fraud due to the user being a non-member.

[Third embodiment]

An object identification system 10 according to a third exemplary embodiment of the present invention will now be described, wherein elements in common with the first embodiment are referenced using the same names or numbers: Duplicate descriptions are omitted, and only different elements are described in detail.

FIG. 21(a) is a side view schematically showing the hardware configuration of the object identification system 10 according to the present embodiment implemented for identifying objects entering and exiting a parking lot 20 having an entrance/exit passage 40. FIG. It is a diagram. In addition, FIG. 4(b) is a table showing a series of phases that the vehicle 30 as an object in the parking lot 20 and the user (human) can take in the entering stage and the exiting stage, together with reference drawing numbers. .

The object identification system 10 according to the present embodiment is a vehicle 30 physically associated with the same parking lot 20 and its user (in particular, the user is walking without getting on the vehicle 30, i.e., the user has spatial coordinates It is designed to identify and manage individual objects (users occupying different positions than the vehicle 30 above), while distinguishing them as different types of objects from each other.

[First Object Identification/Stage Judgment Program Executed by Signal Processing Unit 100]

FIG. 22 is a flowchart conceptually showing the first object identification/stage determination program executed by the signal processing unit 100 when the vehicle is entered.

This first object identification/stage determination program is repeatedly executed by the signal processing unit 100, and each time the signal processing unit 100 first executes, in step S2201, the outer While the drive signal is output to the line sensor 50, the sensor signal reflecting the side view of the object shown in FIG.

In step S2201, the signal processing unit 100 further analyzes the silhouette of the current object based on the sensor signal input from the outer line sensor 50, and determines whether the current object is the vehicle 30 or a human being. identify whether

Next, in step S<b>2202 , signal processing unit 100 determines whether or not the current object has been identified as vehicle 30 . If the vehicle 30 is not identified, the determination is NO, and the current execution of this program ends. On the other hand, if the vehicle 30 is identified, the determination becomes YES, and step S2203 is subsequently executed.

In this step S2203, the signal processing unit 100 matches the silhouette (actual silhouette) with a plurality of pre-stored vehicle reference silhouettes to obtain the most approximate silhouette, as in the first embodiment. A vehicle reference silhouette is specified, and based on the result, the type of the current vehicle 30, that is, the type of vehicle is identified. For example, which car manufacturer made which car (and when it was made (model year)) is identified.

Here, steps S 2201 - 2203 are processes executed using the outer line sensor 50 .

Subsequently, in step S2204, the signal processing unit 100 associates the information about the identified vehicle type as the first vehicle information with the parking lot ID unique to the current parking lot 20, and sends the information to the management server 130, for example, Transmit wirelessly over a public network or global network.

After that, in step S2205, the signal processing unit 100 outputs the drive signal to the inner line sensor 52 this time, and outputs the sensor signal from the inner line sensor 52 as in the first embodiment. Input is a side view of the object shown in FIG.

In this step S2205, the signal processing unit 100 further analyzes the silhouette of the current object based on the sensor signal input from the inner line sensor 52, and determines whether the current object is the vehicle 30 or a human being. identify whether

Subsequently, in step S<b>2206 , the signal processing unit 100 determines whether or not the current object has been identified as the vehicle 30 . Here, it means that the signal processing unit 100 waits for the vehicle 30 that has passed the outer line sensor 50 to subsequently pass the inner line sensor 52 . If the signal processing unit 100 does not identify the current object as the vehicle 30, the determination is NO, and the process returns to step S2205. S2207 is executed.

In step S2207, signal processing unit 100 determines whether or not the silhouette obtained by executing step S2201 and the silhouette obtained by executing step S2205 are geometrically sufficiently similar to each other. Thus, it is determined whether or not the same vehicle 30 has passed the outer line sensor 50 and the inner line sensor 52 in that order.

If the vehicles 30 that have passed through the outer line sensor 50 and the inner line sensor 52 are not the same, the determination is NO, and the execution of this program ends. Then step S2208 is executed.

In step S<b>2208 , the signal processing unit 100 determines that the current vehicle 30 has entered the parking lot 20 .

After that, in step S2209, the signal processing unit 100 detects the YES determination timing in step S2207 or the timing substantially synchronized with the determination timing in step S2208 (that is, for example, when the rear end surface of the current vehicle 30 is detected by the inner line sensor 52). ), the current vehicle 30 is photographed using the camera 300 only once or continuously.

The rear end surface of the vehicle 30 (especially the license plate 31 ) when photographed by the camera 300 is in a fixed position relative to the inner line sensor 52 . On the other hand, the inner line sensor 52 is at a fixed position relative to the outer line sensor 50 and the camera 300 is at a fixed position relative to the outer line sensor 50 .

As a result, regardless of the type of vehicle 30, the actual distance between the rear end surface of the vehicle 30 (especially the license plate 31) and the camera 300 when photographed by the camera 300 is the focal point of the camera 300. The distance is maintained substantially the same, thus allowing the camera 300 to photograph the license plate 31 of any vehicle 30 in good focus. The focal length of camera 300 may be fixed or variable, and may be autofocus.

However, since the vehicle 30 may be moving relative to the camera 300 while the camera 300 is stationary, the captured image may be out of focus. If the camera 300 takes a series of pictures of the vehicle 30 to continuously take a plurality of pictures, there is a high possibility that the pictures include a picture that is sufficiently in focus.

Subsequently, in step S2210, the signal processing unit 100 recognizes a number (for example, a four-digit number) representing the vehicle number of the current vehicle 30 from the image of the license plate 31 photographed as described above.

Here, steps S 2205 - 2208 are processes performed using the outer line sensor 50 . Also, steps S 2209 to 2210 are processes executed using camera 300 .

After that, in step S2211, the signal processing unit 100 associates the information about the recognized vehicle number as the second vehicle information with the parking lot ID unique to the current parking lot 20, and sends it to the management server 130, for example, Transmit wirelessly over a public network or global network.

In this embodiment, the first vehicle information and the second vehicle information are transmitted to the management server 130 at different timings in different steps. It is not essential to implement the present invention, for example, they may be sent together to the management server 130 by the same steps.

This completes the execution of this program.

[Parking Lot Identification Program Executed by User Terminal 90]

FIG. 23 shows when the communication terminal 90 of the user enters (when the user enters alone and when the user enters while riding) and when leaving (when the user exits alone and when the user exits alone). 10 is a flowchart conceptually representing a parking lot identification program executed when exiting the parking lot with a passenger in boarding state.

This parking lot identification program is repeatedly executed by communication terminal 90, and each time it is executed, communication terminal 90 first measures its own current position in step S2301. The positioning method includes, for example, a method using the GPS installed in the communication terminal 90, a method using the geographical coordinates of each of a plurality of base stations located geographically around the communication terminal 90, and a method using There is a method of performing short-range communication with the installed transmitter 60 and identifying the parking lot ID from the signal.

Next, in step S2302, the communication terminal 90 determines whether or not the measured current position matches the position of any parking lot 20, thereby determining whether the user is in any parking lot 20. Or it is determined whether or not it is in the vicinity.

If the user is not geographically associated with any parking lot 20, the determination is NO, and the process returns to step S2301. If the user is geographically associated with any parking lot 20, the determination is YES, and step Move to S2303.

In this step S2303, the communication terminal 90 activates a dedicated application (program) pre-installed in its own memory and having a parking lot identification function. As a result, steps S2304-S2306 are executed.

In step S2304, communication terminal 90 determines whether or not a signal has been received from transmitter 60 installed in parking lot 20 this time. If not received, the determination is NO, and the process returns to step S2301. If received, the determination is YES, and the process proceeds to step S2305.

In this step S2305, the communication terminal 90 converts the received signal into a parking lot ID. Specifically, the communication terminal 90 acquires the transmitter ID represented by the received signal, and stores a predetermined relationship between the transmitter ID and the parking lot ID in the memory of the communication terminal 90. According to what has been downloaded in advance, the obtained transmitter ID is converted into a corresponding parking lot ID unique to the parking lot 20 where the user is currently present.

Subsequently, in step S2306, the communication terminal 90 associates its own terminal ID with the acquired parking lot ID and transmits it to the management server 130. FIG.

This completes the execution of this program.

[First Association/Registration Program Executed by Management Server 130]

FIG. 24 is a flow chart conceptually representing the first linking/registration program executed by the management server 130 at the time of warehousing.

This first association/registration program is repeatedly executed by the management server 130, and each time it is executed, first, in step S2401, the management server 130 associates an arbitrary terminal ID with an arbitrary parking lot ID and receives it. determine whether or not If no signal is received, the determination is NO and the current execution of the program ends.

On the other hand, if an arbitrary terminal ID is associated with an arbitrary parking lot ID and received, the determination becomes YES, and the process proceeds to step S2402.

In this step S2402, the management server 130 determines whether or not it has received arbitrary vehicle type information associated with an arbitrary parking lot ID. If no signal is received, the determination is NO and the process returns to step S2401.

On the other hand, if arbitrary vehicle type information is received in association with an arbitrary parking lot ID, the determination becomes YES, and the process proceeds to step S2403.

In step S2403, management server 130 determines whether or not it has received any vehicle number associated with any parking lot ID. If no signal is received, the determination is NO and the process returns to step S2401.

On the other hand, if an arbitrary vehicle number is associated with an arbitrary parking lot ID and received, the determination becomes YES, and the process proceeds to step S2404.

In step S2404, management server 130 determines whether or not the three parking lot IDs received in steps S2401-2403 match each other. Success or failure of matching between parking lot IDs is determined.

If the three parking lot IDs do not match each other, the determination is NO, and the current execution of this program ends. becomes YES, and the process proceeds to step S2405. As a result, the terminal ID, parking lot ID, vehicle type information and vehicle number are comprehensively received by the management server 130 substantially continuously or at substantially the same timing.

In this step S2405, the management server 130 associates the terminal ID, parking lot ID, vehicle type information, and vehicle number received this time with each other. Information is registered in the vehicle/user management list as illustrated in FIG.

This completes the execution of this program.

[Second Object Identification/Stage Judgment Program Executed by Signal Processing Unit 100]

FIG. 26 is a flowchart conceptually representing the second object identification/stage determination program executed by the signal processing unit 100 when the user leaves alone.

This second object identification/stage determination program is repetitively executed by the signal processing unit 100, and each time the signal processing unit 100 first executes, in step S2601, the inner The drive signal is output to the line sensor 52 and the sensor signal is input from the inner line sensor 52 .

In step S2601, the signal processing unit 100 further analyzes the silhouette of the current object based on the sensor signal input from the inner line sensor 52, and determines whether the current object is a person or not. identify.

Next, in step S2602, the signal processing unit 100 determines whether the current object has been identified as a human. If it is not identified as a human, the determination becomes NO, and the current execution of this program ends. On the other hand, if it is identified as a human, the determination becomes YES, and step S2603 is subsequently executed.

In this step S2603, the signal processing unit 100 operates at a timing that is substantially synchronized with the timing at which the object identification processing is started in step S2601 (that is, for example, the front of the person this time detects the inner line sensor 52 and the outer line sensor 52). 50), the current human object is photographed once or continuously with the camera 300.

The front of the person (particularly including the person's face) as photographed by camera 300 is at a fixed position relative to inner line sensor 52 . On the other hand, the inner line sensor 52 is at a fixed position relative to the outer line sensor 50 and the camera 300 is at a fixed position relative to the outer line sensor 50 .

As a result, the actual distance between the camera 300 and the front of a person (which is a frontal portrait of a person, particularly including the person's face) when photographed by the camera 300 is irrespective of the type of person. Instead, it remains substantially the same as the focal length of camera 300, thus allowing camera 300 to capture any human figure in good focus.

However, since the camera 300 is stationary and the person may be moving relative to the camera 300, the captured image may be out of focus. If multiple pictures are taken in succession with the 300 shooting the same person in succession, it is likely that some of the pictures will be well focused.

Subsequently, in step S2604, the signal processing unit 100 extracts a face image representing the current human face from the human image photographed as described above.

After that, in step S2605, the signal processing unit 100 outputs the drive signal to the outer line sensor 50 and inputs the sensor signal from the outer line sensor 50 as in the first embodiment. .

In step S2605, the signal processing unit 100 further analyzes the silhouette of the current object based on the sensor signal input from the outer line sensor 50, and determines whether the current object is a person or not. identify.

Subsequently, in step S2606, the signal processing unit 100 determines whether the current object has been identified as a person. If it is not identified as a human, the determination becomes NO, and the process returns to step S2605. If it is identified as a human, the determination becomes YES, and step S2607 is executed.

In step S2607, signal processing unit 100 determines whether or not the silhouette obtained by executing step S2601 and the silhouette obtained by executing step S2605 are geometrically sufficiently similar to each other. Thus, it is determined whether or not the same person has passed the inner line sensor 52 and the outer line sensor 50 in that order.

If the persons who have passed through the inner line sensor 52 and the outer line sensor 50 are not the same, the determination is NO, and the current execution of the program ends. , step S2608 is executed.

In this step S2608, the signal processing unit 100 determines that the current human user has exited the current parking lot 20 alone after the current vehicle 30 has entered the current parking lot 20 .

Here, steps S 2601 - 2602 are processes executed using the inner line sensor 52 . Also, steps S2603 and S2604 are processes executed using the camera 300. FIG. Also, steps S2605-2607 are processes executed using the outer line sensor 50. FIG.

After that, in step S2609, the signal processing unit 100 associates the information about the recognized face image as the first human information with the parking lot ID unique to the current parking lot 20, and sends it to the management server 130, for example, Transmit wirelessly over a public network or global network.

This completes the execution of this program.

[Second Linking/Registration Program Executed by Management Server 130]

FIG. 27 is a flowchart conceptually showing the second linking/registration program executed by the management server 130 when the user leaves alone.

This second linking/registration program is repeatedly executed by the management server 130, and each time it is executed, first, in step S2701, the management server 130 transfers an arbitrary terminal ID from an arbitrary communication terminal 90 to an arbitrary station. It is determined whether or not the information has been received in association with the parking lot ID. If no signal is received, the determination is NO and the current execution of the program ends.

On the other hand, if an arbitrary terminal ID is associated with an arbitrary parking lot ID and received, the determination becomes YES, and the process proceeds to step S2702.

In this step S2702, management server 130 determines whether or not it has received any face image information associated with any parking lot ID from any signal processing unit 100 . If no signal is received, the determination is NO and the process returns to step S2701.

On the other hand, if arbitrary face image information has been received in association with an arbitrary parking lot ID, the determination is YES, and the process proceeds to step S2703.

In step S2703, management server 130 determines whether the two parking lot IDs received in steps S2701-2703 match each other. Success or failure of matching between parking lot IDs is determined.

If the two parking lot IDs do not match each other, the determination is NO, and the current execution of this program ends. becomes YES, and the process moves to step S2704. As a result, the terminal ID, the parking lot ID and the face image are comprehensively received by the management server 130 substantially continuously or at substantially the same timing.

In this step S2704, the management server 130 associates the terminal ID, parking lot ID, and face image received this time with each other. As exemplified in FIG. 25, it is registered in the vehicle/user management list.

This completes the execution of this program.

[Third Object Identification/Stage Judgment Program Executed by Signal Processing Unit 100]

FIG. 28 is a flowchart conceptually showing the third object identification/stage determination program executed by the signal processing unit 130 when the user enters alone.

This third object identification/stage determination program is repetitively executed by the signal processing unit 100, and each time the signal processing unit 100 executes, first, in step S2801, as in the first embodiment, the signal processing unit 100 While outputting the drive signal to the line sensor 50 , the sensor signal is input from the outer line sensor 50 .

In step S2801, the signal processing unit 100 further analyzes the silhouette of the current object based on the sensor signal input from the outer line sensor 50, and determines whether the current object is a person or not. identify.

Next, in step S2802, signal processing unit 100 determines whether the current object has been identified as a human. If it is not identified as a human, the determination is NO, and the process returns to step S2801. On the other hand, if it is identified as a human, the determination becomes YES, and step S2803 is subsequently executed.

In this step S2803, the signal processing unit 100 outputs the drive signal to the inner line sensor 52 and inputs the sensor signal from the inner line sensor 52 as in the first embodiment. .

In this step S2803, the signal processing unit 100 further analyzes the silhouette of the current object based on the sensor signal input from the inner line sensor 52, and determines whether the current object is a person or not. identify.

Subsequently, in step S2804, the signal processing unit 100 determines whether the current object has been identified as a person. Here it means that the signal processing unit 100 waits for a person who has passed the outer line sensor 50 to subsequently pass the inner line sensor 52 . If the signal processing unit 100 has not identified the current object as a human being, the determination is NO, and the process returns to step S2803. executed.

In step S2805, signal processing unit 100 determines whether or not the silhouette obtained by executing step S2801 and the silhouette obtained by executing step S2803 are geometrically sufficiently similar to each other. By doing so, it is determined whether or not the same person has passed the outer line sensor 50 and the inner line sensor 52 in that order.

If the persons who have passed through the outer line sensor 50 and the inner line sensor 52 are not the same, the determination is NO, and the execution of this program ends. If they are the same, the determination is YES, and then , step S2806 is executed.

In this step S2806, the signal processing unit 100 determines that the current human user has entered the parking lot 20 alone in order to let the vehicle 30 leave the parking lot 20 this time.

After that, in step S2807, the signal processing unit 100 performs detection at a timing substantially synchronous with the timing at which the object identification processing in step S2803 is started (that is, for example, immediately after the front of the person passes the inner line sensor 52). 2), the present person is photographed using the camera 300 only once or continuously.

A person's back (rear view) when photographed by the camera 300 is in a fixed position relative to the inner line sensor 52 . On the other hand, the inner line sensor 52 is at a fixed position relative to the outer line sensor 50 and the camera 300 is at a fixed position relative to the outer line sensor 50 .

As a result, the actual distance between the back of the person as imaged by the camera 300 and the camera 300 remains substantially the same as the focal length of the camera 300 regardless of the type of person, Therefore, the camera 300 can photograph a human image as the back of any human with sufficiently good focus.

However, since the camera 300 is stationary and the person may be moving relative to the camera 300, the captured image may be out of focus. If multiple photographs are taken in succession with the 300 continuously photographing the same subject, it is highly likely that some of the photographs will include a photograph that is sufficiently in focus.

Subsequently, in step S2808, the signal processing unit 100 recognizes the current human figure from the image captured as described above.

After that, in step S2809, the signal processing unit 100 associates the information about the recognized human image as the second human information with the parking lot ID unique to the current parking lot 20, and sends it to the management server 130, for example, Transmit wirelessly over a public network or global network.

This completes the execution of this program.

[Third Association/Registration Program Executed by Management Server 130]

FIG. 29 is a flowchart conceptually showing the third linking/registration program executed by the management server 130 when the user enters alone.

This third linking/registration program is repeatedly executed by the management server 130. At each execution, first, in step S2901, the management server 130 transfers an arbitrary terminal ID from an arbitrary communication terminal 90 to an arbitrary station. It is determined whether or not the information has been received in association with the parking lot ID. If no signal is received, the determination is NO and the current execution of the program ends.

On the other hand, if an arbitrary terminal ID is associated with an arbitrary parking lot ID and received, the determination becomes YES, and the process proceeds to step S2902.

In this step S2902, management server 130 determines whether or not it has received arbitrary human image information from arbitrary signal processing unit 100 in association with arbitrary parking lot ID. If no signal is received, the determination is NO and the process returns to step S2901.

On the other hand, if arbitrary person image information is received in association with an arbitrary parking lot ID, the determination is YES, and the process proceeds to step S2903.

In step S2903, management server 130 determines whether the two parking lot IDs received in steps S2901-2902 match each other. Success or failure of matching between parking lot IDs is determined.

If the two parking lot IDs do not match each other, the determination is NO, and the current execution of this program ends. becomes YES, and the process moves to step S2904.

In this step S2904, the management server 130 associates the terminal ID, parking lot ID, and person image received this time with each other. As exemplified in FIG. 25, it is registered in the vehicle/user management list.

This completes the execution of this program.

[Fourth Object Identification/Stage Judgment Program Executed by Signal Processing Unit 100]

FIG. 30 is a flowchart conceptually showing the fourth object identification/stage determination program executed by the signal processing unit 130 when leaving the garage.

This fourth object identification/stage determination program is repeatedly executed by the signal processing unit 100, and each time the signal processing unit 100 first executes, in step S3001, the inner The drive signal is output to the line sensor 52 and the sensor signal is input from the inner line sensor 52 .

In step S3001, the signal processing unit 100 further analyzes the silhouette of the current object based on the sensor signal input from the inner line sensor 52, and determines whether the current object is the vehicle 30 or not. identify

Next, in step S3002, the signal processing unit 100 determines whether the current object has been identified as the vehicle 30 or not. If the vehicle 30 is not identified, the determination is NO, and the current execution of this program ends. On the other hand, if the vehicle 30 is identified, the determination becomes YES, and step S3003 is subsequently executed.

In this step S3003, the signal processing unit 100 operates at a timing substantially synchronous with the timing at which the object identification processing is started in step S3001 (that is, for example, when the front end face of the vehicle 30 this time detects the inner line sensor 52 and the outer line sensor 52). Immediately after passing toward the line sensor 50 ), the vehicle 30 as the current object is photographed only once or continuously by using the camera 300 .

The front end face of vehicle 30 (particularly including license plate 31 ) when photographed by camera 300 is in a fixed position relative to inner line sensor 52 . On the other hand, the inner line sensor 52 is at a fixed position relative to the outer line sensor 50 and the camera 300 is at a fixed position relative to the outer line sensor 50 .

As a result, regardless of the type of vehicle 30, the actual distance between the front end face of vehicle 30 (especially license plate 31) and camera 300 when photographed by camera 300 is the focal point of camera 300. The distance remains substantially the same, thus allowing the camera 300 to take an image of any vehicle 30 in good focus.

Subsequently, in step S3004, the signal processing unit 100 extracts the number representing the vehicle number of the current vehicle 30 from the image of the license plate 31 photographed as described above.

After that, in step S3005, the signal processing unit 100 outputs the drive signal to the outer line sensor 50 and inputs the sensor signal from the outer line sensor 50 as in the first embodiment. .

In this step S3005, the signal processing unit 100 further analyzes the silhouette of the current object based on the sensor signal input from the outer line sensor 50, and determines whether the current object is the vehicle 30 or not. identify

Subsequently, in step S<b>3006 , the signal processing unit 100 determines whether or not the current object has been identified as the vehicle 30 . If the vehicle 30 is not identified, the determination is NO, and the process returns to step S3005. If the vehicle 30 is identified, the determination is YES, and step S3007 is executed.

In step S3007, signal processing unit 100 determines whether or not the silhouette obtained by executing step S3001 and the silhouette obtained by executing step S3005 are geometrically sufficiently similar to each other. Thus, it is determined whether or not the same vehicle 30 has passed the inner line sensor 52 and the outer line sensor 50 in that order.

If the vehicles 30 passing through the inner line sensor 52 and the outer line sensor 50 are not the same, the determination is NO, and the current execution of the program ends. Then step S3008 is executed.

In this step S3008, the signal processing unit 100 determines that the current vehicle 30 has left the parking lot 20 this time.

After that, in step S3009, the signal processing unit 100 associates the recognized vehicle number with the parking lot ID unique to the current parking lot 20, and transmits the information to the management server 130 wirelessly, for example, via a public line network or a global network. Send.

This completes the execution of this program.

Additionally, the present embodiment is implemented to identify objects using the line sensors 50, 52 according to the first and second embodiments, but alternatively, the line sensors 50, 52 and may be implemented with different line sensors that identify objects using different device configurations, image processing techniques, arithmetic algorithms or object identification principles.

Additionally, in this embodiment, each line sensor 505, 52 is of a transmissive type in which the transmitter post 62 and the receiver post 72 face each other across the object to be identified. , the transmitter post 62 and the receiver post 72 may be of a reflective type located on the same side of the object to be identified.

In the case of this reflection type, one transmitter 60 and one receiver 70 corresponding to each other constitute one pair, and a plurality of such pairs are arranged in a row to form a single post. Alternatively, the combination of 62 and receiver post 72 may be used. In each pair, of the electromagnetic waves emitted from the transmitter 60 belonging to it, the part reflected from the object or reflected from the reflecting surface located on the opposite side of the one post with respect to the object is sent to the same pair. It will be incident on the receiver 70 to which it belongs.

As described above, in the parking lot 20, the vehicle 30 as a three-dimensional object passing through the entrance/exit passage 40 as a predetermined passage can be easily identified from only one direction and the shape of the vehicle 30 can be easily identified. Although a scenario has been described that uses the classification application, similar embodiments can be used for other applications.

As an example of such other applications, in a distribution center, sheet-like or plate-like or three-dimensional articles flowing along a predetermined passage (e.g., conveyor) are identified and shape-sorted (e.g., There are multiple classifications such as classification by size (classification by maximum dimension), whether it is close to square or vertically or horizontally (classification by aspect ratio).

Another example is commercial facilities (e.g., department stores, restaurants, food courts, bookstores) or public facilities used by the public (e.g., roads, underpasses, museums, schools, city halls, stations, airports, bus stops, buses, libraries). ), identify and morphologically classify humans (three-dimensional objects) flowing along a predetermined path (for example, humans walking independently, humans walking in wheelchairs, people with caregivers or service dogs) multiple classifications such as humans, adults, and children).

A number of exemplary embodiments of the present invention have been described in detail above with reference to the drawings. It is possible to implement the present invention in other forms with various modifications and improvements based on the above.

Claims (9)

A facility monitoring system for monitoring a facility,
A silhouette image of the object is obtained by irradiating an object existing in the facility with an electromagnetic wave and scanning the irradiated electromagnetic wave and the object relatively in the x direction and the y direction. a silhouette image acquisition device that
a monitoring unit that monitors the movement of the object based on the obtained silhouette image ,
The facility has two monitoring positions,
The monitoring unit is in a moving state in which the object moves between the two monitoring positions when silhouette images that are geometrically similar to each other are acquired at the two monitoring positions ahead of each other in time. A facility monitoring system including a movement state determination unit that determines that The silhouette image acquisition device includes an electromagnetic wave emitting element that emits the electromagnetic wave, an electromagnetic wave incident element that receives the electromagnetic wave reflected from or transmitted through the object, and a drive that drives the electromagnetic wave emitting element and the electromagnetic wave incident element. 2. The facility monitoring system according to claim 1, comprising a unit and a signal processing unit for processing at least a signal from said electromagnetic wave incidence element. The facility monitoring system according to claim 1, wherein the electromagnetic waves include visible light, infrared light, sound waves, ultrasonic waves, or laser light. A facility monitoring system for monitoring a facility,
A silhouette image of the object is obtained by irradiating an object existing in the facility with an electromagnetic wave and scanning the irradiated electromagnetic wave and the object relatively in the x direction and the y direction. a silhouette image acquisition device that
a display for displaying the obtained silhouette image on the screen;
a monitoring unit that monitors the movement of the object based on the obtained silhouette image;
including
The monitoring unit determines whether the object is a human being,
The facility monitoring system, wherein the display displays the obtained silhouette image on the screen when the monitoring unit determines that the object is a person. A facility monitoring system for monitoring a facility,
A silhouette image of the object is obtained by irradiating an object existing in the facility with an electromagnetic wave and scanning the irradiated electromagnetic wave and the object relatively in the x direction and the y direction. a silhouette image acquisition device that
a monitoring unit that monitors the movement of the object based on the obtained silhouette image;
including
When the object is a human, the monitoring unit determines whether the human is walking alone or moving in a wheelchair, based on the obtained silhouette image. Alternatively, a facility monitoring system including a movement form determination unit that determines whether the person is walking with a helper or a service dog. A program for causing a computer to function as the monitoring unit according to any one of claims 1 to 5. A program for causing a computer to function as the signal processing unit according to claim 2. A recording medium on which the program according to claim 6 is computer-readable. A recording medium on which the program according to claim 7 is computer-readable.

Images