JP2004206584A - Image data processor and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To specify the travel paths of visitors in a hall and to output the specified travel paths. <P>SOLUTION: Cameras 1a to 1n as photographic means and guide display devices 10a to 10j as guiding means are installed at prescribed intervals in a parking lot and a store. In addition, an elevator is installed at an accessway and the visitors can move to different floors by using the elevator. A main body part 20 for performing the display output or voice output of a leaving path to the visitors is installed in the vicinity of the elevator. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image data processing device and a program for photographing a visitor and processing the photographed image.
[0002]
[Prior art]
Facilities such as department stores and theme parks have large-scale parking lots. Since such a large-scale parking lot may be installed over a large area or over a plurality of floors, it is necessary to guide the visitors or the visiting vehicles on which the visitors ride. As the guidance method, a method of installing a signboard of a guide map in the facility and a sign indicating the route to the entrance and exit, and arranging a guide to guide empty vehicles and guidance to the entrance and exit have been adopted. I have.
[0003]
2. Description of the Related Art Conventionally, in order to efficiently guide a visiting vehicle, a technique has been developed in which a vehicle entering a parking lot is photographed, and the vehicle is guided to an empty space according to the size of the vehicle grasped from the photographed image. (For example, see Patent Document 1).
[0004]
[Patent Document 1]
JP-A-5-040900
[0005]
[Problems to be solved by the invention]
However, the above-described guidance method is inconvenient because the visitor himself has to judge the route at the time of entry or exit by looking at the signboard or sign. In addition, even when a guide is located, the guide can guide the entrance and exit to the facility, but cannot know the parking position of each visitor, If you forget the parking position when you leave, it is very difficult to find the parking position.
[0006]
Further, in a parking lot, there is a case where a mischief or theft of a visitor's vehicle occurs. Since an unspecified number of people enter and leave the parking lot and it is not known whether or not the person in the parking lot is the owner of the vehicle, it is difficult to detect and prevent crimes against the visitors' vehicles.
[0007]
In addition, when visitors come off with their accompanying guests, it is difficult to find lost companions in the vast facilities and venues.
[0008]
An object of the present invention is to specify a moving path of a visitor in a hall and output the specified moving path.
[0009]
[Means for Solving the Problems]
The invention according to claim 1 is an image data processing device,
Photographing means for sequentially photographing images of a moving visitor at a plurality of positions;
From the photographed image of the visitor and a plurality of photographing positions, specifying means for specifying a route of the visitor at the time of visit,
Calculating means for calculating a route at the time of exit based on the specified route at the time of arrival;
Output means for outputting the calculated route at the time of exit when the visitor leaves,
It is characterized by having.
[0010]
According to the first aspect of the present invention, a route at the time of arrival is specified from a photographed image and a photographing position of a moving visitor, and a route at the time of exit is calculated and output based on the route at the time of visit. Therefore, the visitor can easily grasp the route at the time of leaving.
[0011]
According to a tenth aspect of the present invention, in the image data processing device,
Photographing means for sequentially taking a visitor and a companion in the vicinity of the visitor at a plurality of positions as a group,
Identifying means for identifying a moving path of the group from the photographed group images and the plurality of photographing positions, and for specifying a moving path of each of a visitor and a companion when the group moves separately. When,
Route storage means for sequentially storing the specified movement route in association with the group identification data,
Output means for acquiring identification data of the group of the visitor from the captured image of the visitor, searching for and outputting the latest travel route of the accompanying person included in the group from the route storage means,
It is characterized by having.
[0012]
According to the tenth aspect of the present invention, the moving path of the visitor and the accompanying person is specified from the photographed image and the photographing position of the visitor and the accompanying person as one group, and the identification data of the group is obtained. Since the latest travel route of the accompanying person is retrieved and output based on the group identification data, the traveling route of the accompanying person can be easily grasped.
[0013]
The invention according to claim 14 is
On the computer,
A shooting function for sequentially shooting images of a moving visitor at a plurality of positions,
From the photographed image of the visitor and a plurality of photographing positions, a specifying function of specifying a route of the visitor at the time of visit,
A calculation function for calculating a route at the time of exit based on the route at the time of the specified visit,
When the visitor leaves, an output function for outputting the calculated exit route,
It is characterized by being a program for realizing.
[0014]
According to the fourteenth aspect of the present invention, the route at the time of arrival is specified from the photographed image and the photographing position of the moving visitor, and the route at the time of exit is calculated and output based on the route at the time of visit. Therefore, the visitor can easily grasp the route at the time of leaving.
[0015]
The invention according to claim 15 is
On the computer,
A photographing function of sequentially grouping a visitor and a companion in the vicinity of the visitor at a plurality of positions, and
A specifying function for specifying a moving route of the group from the photographed group images and the plurality of photographing positions, and specifying a moving route of each of a visitor and a companion when the group moves separately. When,
A function of sequentially storing the specified moving route in the route storage unit in association with the identification data of the group;
An output function of acquiring identification data of the group of the visitor from the photographed image of the visitor, searching for and outputting the latest traveling route of the accompanying person included in the group from the route storage unit,
It is characterized by being a program for realizing.
[0016]
According to the invention described in claim 15, the moving path of the visitor and the accompanying person is specified from the photographed image and the photographing position of the visitor and the accompanying person as one group, and the identification data of the group is obtained. Since the latest travel route of the accompanying person is retrieved and output based on the group identification data, the traveling route of the accompanying person can be easily grasped.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
In the present embodiment, a plurality of photographing devices are installed in a facility to photograph a visitor, and a route at the time of the visitor's visit is specified based on the position and photographing time of the photographing device that photographed the visitor. An example will be described in which, when the player leaves, the exit route is calculated based on the route at the time of arrival and guidance is performed.
[0018]
First, the configuration will be described.
In FIG. 1, the image data processing apparatus 100 according to the present embodiment is installed in a certain facility (not shown, but an office provided in a store) (not shown, installed in the office, cameras 1a to 1n, and a guide). Display devices 10a to 10j are connected). The facility is composed of a plurality of floors, and FIG. 1 shows one floor of the facility as viewed from directly above.
[0019]
As shown in FIG. 1, the facility is divided into a parking lot and a store, and is connected by a communication passage. Cameras 1a to 1n and guidance display devices 10a to 10j are installed at predetermined intervals in a parking lot and a store. An elevator is installed in the communication passage, and visitors can move to each floor by the elevator. In the vicinity of the elevator, a main body unit 20 that guides a visitor by display output or voice output is installed.
[0020]
The cameras 1a to 1n are photographing means, and are attached to ceilings of stores and parking lots so as to look down from above the parking lot and can photograph a wide angle range. Each of the cameras 1a to 1n is provided with a camera number C (indicated by the numeral attached to the camera in FIG. 1) for identifying the camera that has taken the image. The number and locations of cameras installed in the hall are not particularly limited.
[0021]
The guidance display devices 10a to 10j are guidance means, and are arrow-type display devices embedded in the passage of the parking lot as shown in FIGS. 2 (a) and 2 (b). As shown in FIGS. 2A and 2B, the guidance display devices 10a to 10j each have one or a plurality of arrows (arrows indicated by solid lines and dotted lines) according to a traveling direction at a point where each is installed. When a visitor is guided, only the arrow in the traveling direction for guiding (the arrow shown by a solid line) is lit. In addition, the installation number and installation location of the guidance display device in the hall are not particularly limited.
[0022]
FIG. 3 shows a functional configuration of the image data processing device 100.
As shown in FIG. 3, the image data processing device 100 includes cameras 1a to 1n, guidance display devices 10a to 10j, and a main unit 20. The cameras 1a to 1n and the main unit 20 are connected via a camera connection unit 24 of the main unit 20, and the guidance display devices 10a to 10j and the main unit 20 are connected via a guidance display device connection unit 25 of the main unit 20. Connected.
[0023]
Note that the cameras 1a to 1n and the guidance display devices 10a to 10j are the same as those described above, and a description thereof will be omitted.
[0024]
The main unit 20 includes a CPU (Central Processing Unit) 21, an input unit 22, a RAM (Random Access Memory) 23, a camera connection unit 24, a guidance display device 25, a display unit 26, a storage unit 27, a sound output unit 28, a printing unit. 29, a communication unit 30, and each unit is connected by a bus 31.
[0025]
The CPU 21 includes, in addition to the system programs stored in the storage unit 16, an empty vehicle information collection processing program according to the present invention (see FIG. 8), an image identification processing of the empty vehicle state (see FIG. 9), and a visiting vehicle information collection processing program (see FIG. 9). 11), a visitor information collection processing program (see FIG. 13), an exit route guidance processing program (see FIG. 14), a suspicious person warning processing program (see FIG. 17), and a lost child inquiry processing program (see FIG. 19) in the RAM 15. The processing is expanded and the processing operation is comprehensively controlled in cooperation with the program.
[0026]
Specifically, in the empty vehicle information collecting process and the image identifying process of the empty vehicle status, the parking space of the empty vehicle in the hall is determined from the captured image in the hall, and in the visiting vehicle information collecting process and the visitor information collecting process, the arrival from the captured image is performed. A car or a visitor is specified, and a route at the time of the visit is specified. In the exit route guidance processing, a route at the time of arrival is specified from the photographed image of the visitor, and a route at the time of exit is calculated based on the route at the time of arrival. Also, in the suspicious person warning process, it is determined whether or not the visitor is a suspicious person from the captured image, the current position of the visitor determined to be the suspicious person is specified, From the image and the photographed image at the time of the visit, the accompanying person of the lost child of the visitor is identified, and the current position of the accompanying person of the lost child is identified.
[0027]
Further, the CPU 21 measures time using an internal clock signal.
[0028]
The input unit 22 includes a touch panel integrated with the display unit 26, character keys, numeric keys, and various function keys, and outputs an operation signal corresponding to the operated key to the CPU 21.
[0029]
The RAM 23 forms a work area for temporarily storing various programs executed by the CPU 21 and data related to these programs.
[0030]
The RAM 23 is route storage means, and includes an empty vehicle information memory 231, a visiting vehicle information memory 232, and a visitor information memory 233.
[0031]
The empty vehicle information memory 231 is a memory for managing the empty vehicle status of the parking lot. In the parking lot, a parking lot number S for identifying each parking space is assigned to each space where one car is parked. As shown in FIG. 4, the empty vehicle information memory 231 stores a parking lot number S (for example, “1”) and an empty flag (for example, “0”) that indicates whether the parking space of the parking lot number is empty. Are stored in association with each other. When the empty vehicle flag is "1", it indicates that the parking space is an empty space, and when the empty vehicle flag is "2", it indicates that the parking space is not empty and a car is in a parking state.
[0032]
The visiting vehicle information memory 232 is a memory for managing a route of a visiting vehicle when the vehicle arrives. A vehicle identified as a visiting vehicle is provided with a visiting vehicle ID for identifying each vehicle. For example, in FIG. 1, when a visiting vehicle enters a parking lot and is parked in a parking space X in FIG. 1, the visiting vehicle has camera numbers 7 and 6 while moving along the visiting route. , 4, 2, and 1 are sequentially taken. Therefore, the route at the time of arrival of the visiting vehicle can be specified from the shooting position and the shooting time of the camera with the camera number C.
[0033]
As shown in FIG. 5, the visitor car information memory 232 stores, for each visitor car ID, visitor car images (for example, “car image 1”, “car image 2”) indicating the file name of the image of the visitor car. , "Car image 3", etc.), the parking lot number S (for example, "1") of the parking space where the visiting car was parked, and the moving route of the visiting car, the camera number C of the camera that photographed the visiting car. (For example, “7 → 6 → 4 → 2 → 1”: the number indicates the camera number C) and is stored in association with each other.
[0034]
The visitor information memory 233 is a memory for managing a route of a visitor when the visitor arrives. If one visitor has a visitor and a companion, a group ID, which is identification data for identifying each group, is assigned to the plurality of visitors as one group. In addition, a visitor ID for identifying each person is given to a person specified as a visitor. In addition, for example, in FIG. 1, when a visitor gets off from an entrance car parked in the parking space X and heads toward the elevator in FIG. Person is sequentially photographed by the cameras of camera numbers 1, 2, and 3. Therefore, the route at which the visitor arrives can be specified from the shooting position and the shooting time of the camera with the camera number C.
[0035]
As shown in FIG. 6, the visitor memory 233 stores a group ID (for example, “AAA”) to which the visitor belongs, a visitor ID (for example, “001”), and an image of the image of the visitor. A visitor image indicating a file name (for example, “person image 1”, “person image 2”,..., Etc.) and a movement path of the visitor indicated by the camera number C of the camera that captured the visitor Path data (for example, “1 → 2 → 3”: the number indicates the camera number C) is stored in association with the path data.
[0036]
The camera connection unit 24 is an interface for connecting the cameras 1a to 1n to the main unit 20.
[0037]
The guidance display device connection unit 25 is an interface for connecting the guidance display devices 10a to 10j to the main unit 20.
[0038]
The display unit 23 is one of an output unit and a warning unit, and includes a display such as an LCD (Liquid Crystal Display). The display unit 23 includes an initial screen 261 (see FIG. 15), a guidance screen 262 (see FIG. 16 (a)) for displaying a leaving route of a visitor, a guidance screen 263 (see FIG. 16 (b)), and imaging of a suspicious person. A warning screen 264 (see FIG. 18) that displays an image and warns that a suspicious person is in the hall, and a lost child inquiry screen 265 that displays the current position together with a captured image of a lost child searched at the time of lost child inquiry (FIG. 20C) See various types of display information.
[0039]
The storage unit 27 has a storage medium (not shown) made up of a magnetic, optical storage medium, or a semiconductor memory. Various programs such as a processing program, an empty vehicle status image identification processing program, a visiting vehicle information collection processing program, a visitor information collection processing program, an exit route guidance processing program, a suspicious person warning processing program, a lost child inquiry processing program, and the like, and processed by these programs The stored data and the like are stored.
[0040]
The storage unit 27 is a determination image storage unit, and stores therein an empty vehicle determination image data group and an empty vehicle determination image table 271. The empty vehicle determination image data is image data that has been taken and prepared in advance by the cameras 1a to 1n in order to determine whether each parking space in the parking lot is empty or not, and the vehicle enters the parking space. This is image data of an empty parking space that is not empty.
[0041]
The empty vehicle determination image table 271 is a table for specifying which parking space the empty vehicle determination image data corresponds to, as shown in FIG. 7, the camera number C (for example, “ 1 ”) and an empty vehicle determination image indicating the file name of the empty vehicle determination image data (for example,“ empty vehicle determination image 1 ”) are stored in association with each other.
[0042]
The audio output unit 28 is one of an output unit and a warning unit, and includes a speaker and the like. The voice output unit 28 outputs various messages such as a guidance message for guiding a route at the time of exit, a warning message for warning that a suspicious person is in the hall, a message for notifying the current position of a lost child searched at the time of lost child inquiry, and the like. I do.
[0043]
The printing unit 29 is one of output units, and performs printing on a print recording medium such as paper by various printing methods such as a dot impact method, a thermal transfer method, a laser method, and an ink jet method. The printing unit 29 prints out a route at the time of exit, a photographed image of a suspicious individual, a photographed image of a lost child searched for when a lost child is referred, and the like.
[0044]
The communication unit 30 includes a network interface card, a modem, a terminal adapter, and the like, and transmits and receives various information to and from an external device on a communication network. The communication unit 30 is connected to an image data processing device installed on another floor, and is capable of acquiring information of a visitor on another floor and a photographed image taken on another floor. Further, the image data processing apparatus 100 may be connected to a security system installed in a security room or the like of a facility via a communication network, and may transmit information on the suspicious individual specified by the image data processing apparatus 100.
[0045]
Next, the operation in the present embodiment will be described.
Hereinafter, the operation will be described with reference to flowcharts, but a program for implementing each function described in the flowcharts described later is stored in the storage unit 27 in the form of a computer-readable program code, The CPU 21 sequentially executes an operation according to the program code. Further, the CPU 21 can sequentially execute operations according to the program codes transmitted via the transmission medium. That is, it is also possible to execute an operation specific to the present embodiment using a program or data externally supplied via a transmission medium in addition to the storage unit 27.
[0046]
First, with reference to FIG. 8, an empty vehicle information collecting process executed by the image data processing device 100 will be described. The empty vehicle information collecting process is a process of collecting information on an empty parking space in a parking lot.
[0047]
First, in step A1 shown in FIG. 8, for any one of the cameras 1a to 1n, it is determined whether or not the image of the parking space captured by the camera has changed. When a photographed image is changed due to the visitor moving within the photographing range, such as when the visitor enters the parking space in the parking lot or the visitor leaves the parking space and exits (step A1; Y), the process proceeds to step A2, and when there is no visiting vehicle moving within the photographing range, such as when the visiting vehicle is parked or the parking space is empty, and there is no change in the photographed image (step A1; N), The process proceeds to the process of step A3 described later.
[0048]
In step A2, the camera whose photographed image has changed is specified, and the camera number C of the specified camera, its photographing time, and the photographed image are temporarily stored in the RAM 23. Next, the process proceeds to an image identification process of the empty vehicle state in step A3.
[0049]
The process of identifying an empty vehicle in step A3 will be described with reference to FIG.
First, in step A31 shown in FIG. 9, the file name of the empty vehicle determination image corresponding to the camera number C temporarily stored in the RAM 23 is read from the empty vehicle determination image table 271, and the image data of the empty vehicle determination image of the file name is read. It is read from the storage unit 27. Then, the read-out empty-space determination image is compared with the current captured image of the parking space captured by the camera number C, and in step A32, each parking space included in the imaging range of the camera number C is determined to be an empty vehicle. It is determined whether or not it is in the state.
[0050]
For example, the parking space of parking lot numbers 1 to 10 is included in the shooting range of the camera of camera number 3, and the empty vehicle determination image corresponding to camera number 3 is an image as shown in FIG. If the current photographed image taken by the camera No. is an image as shown in FIG. 10B, the visiting vehicle is parked in the parking spaces of the parking lot numbers 1, 3, 5, 6, 7, and 8. The parking spaces of parking numbers 2, 4, 9, and 10 are determined to be empty.
[0051]
When it is determined whether or not the vehicle is empty, the process proceeds to step A4 in FIG.
In step A4 of FIG. 8, the empty flag of the parking lot number S of the parking space determined to be empty is set to “1” in the empty vehicle information memory 231, and the parking space determined to be non-empty is parked. The empty flag of the parking lot number S is set to “0”. After setting the empty vehicle flag, the process proceeds to step A5.
[0052]
In step A5, it is determined whether or not the empty state has been determined for all the cameras. If the determination of the empty state has not been performed for the images captured by all the cameras (step A5; N), the process returns to step A2, and the determination of the empty state is sequentially performed for all the remaining cameras. On the other hand, when the determination of the empty vehicle status has been completed for the images captured by all the cameras (step A5; Y), the empty vehicle information collection processing ends.
[0053]
Next, the visiting vehicle information collecting process will be described with reference to FIG. The visiting vehicle information collecting process is a process of collecting specific information of the visiting vehicle that has entered the parking lot. In this embodiment, an empty vehicle is not guided to a parking space, and a visitor parks a visiting vehicle in a desired parking space.
[0054]
In step B1 shown in FIG. 11, it is determined whether or not an image captured by any one of the cameras 1a to 1n has changed. If the photographed image changes due to the visitor moving within the photographing range, such as when the visitor enters or leaves the parking lot and passes through the passage (step B1; Y), the process proceeds to step B2. When the visiting vehicle does not move and there is no change in the captured image (step B1; N), the process proceeds to step B9 described below.
[0055]
In step B2, the camera whose photographed image has changed is specified, and the camera number C of the specified camera, its photographing time, and the photographed image are temporarily stored in the RAM 23.
[0056]
Next, in step B3, the captured image temporarily stored in the RAM 23 is read, and the visiting vehicle included in the captured image is specified. Then, it is determined whether or not an image of the same visitor vehicle as the specified visitor vehicle has already been captured and temporarily stored in the RAM 23. When the photographed image of the same visiting vehicle is temporarily stored in the RAM 23 (Step B3; Y), the process proceeds to Step B4, and when the photographed image of the same visiting vehicle is not temporarily stored in the RAM 23 (Step B3; N). ), And proceeds to the process of step B9 described later.
[0057]
In step B4, it is determined whether or not the photographed image of the specified visitor vehicle is an image in which a visitor vehicle ID has already been issued in the visitor vehicle information memory 232 and a registration area has been secured. If the image has no registered area (Step B4; N), the process proceeds to Step B5. If the image has already been registered (Step B4; Y), the process proceeds to Step B7 described later. I do.
[0058]
In step B5, a new visitor vehicle ID is issued for the specified visitor vehicle, and a new registration area is secured in the visitor vehicle information memory 232. That is, only the visiting vehicle whose moving image is photographed twice or more and the photographed image is stored in the RAM 23 is registered in the visiting vehicle information memory 232.
[0059]
Next, in step B6, the empty space flag is set to "1" in the empty vehicle information memory 231, that is, the parking lot number S of the empty parking space is read out and displayed on the display unit 26. After displaying the empty parking lot number S, the process proceeds to step B7.
[0060]
In step B7, an image file name is given to the captured image temporarily stored in the RAM 23, and this image file name is registered in the registration area secured in the visitor vehicle memory 232 as the visitor vehicle image of the specified visitor vehicle. .
[0061]
Next, in step B8, the camera number C of the camera that captured the registered captured image is additionally registered as the current position of the visiting vehicle at the end of the route data at the time of the visit, and the route at the time of the visit is specified. For example, when the car image 7 photographed with the camera number 7 and the car image 6 photographed with the camera number 6 are already registered as the visiting car images, and the car image 5 photographed with the camera number 5 this time is registered. The camera number 5 is added to the route data registered as “7 → 6” as the route data at the time of arrival, and registered as “7 → 6 → 5”.
[0062]
When the route at the time of arrival is specified, it is determined in step B9 whether or not the visiting vehicle has been specified for all the cameras. If the visiting vehicles have not been specified for the images captured by all the cameras (step B9; N), the process returns to step B2, and the visiting vehicles are specified for the remaining cameras in order. On the other hand, when the visiting vehicles are specified for the images captured by all the cameras (step B9; Y), the visiting vehicle information collecting process ends.
[0063]
In the above-mentioned visitor vehicle information collection process, the description has been made on the assumption that the visitor can park the visitor vehicle in the desired parking space. However, the empty vehicle route guidance process shown in the flowchart of FIG. By executing this, the image data processing apparatus 100 may determine the vacant state of the parking space, calculate a guidance route to the parking space determined to be empty, and guide the visiting vehicle.
[0064]
With reference to FIG. 12, the empty vehicle route guidance processing will be described.
In step G1 shown in FIG. 12, the cameras 1a to 1n capture an image of an incoming vehicle that has entered the parking lot, and identify the incoming vehicle from the captured image. When the visiting vehicle is specified, the process proceeds to step G2.
[0065]
At step G2, it is determined whether or not the visiting vehicle is at a position to be guided. When the visiting vehicle is not at the position to be guided, such as when the vehicle has already been parked in an empty parking space (step G2; N), the process proceeds to step G5 described below. On the other hand, when the visiting vehicle is still in the position to be guided, such as near the entrance (step G2; Y), the process proceeds to step G3.
[0066]
In step G3, the parking lot number S for which the empty flag is set to “1” is read from the empty car information memory 231 and among the read parking lot numbers S, the parking lot number S is closest to the current position of the visiting car. Alternatively, the parking lot number S of the parking space near the entrance to the store is the distance between the parking space of each empty vehicle and the current position of the visiting vehicle (not shown, but a table storing the distance from the entrance to each parking space is stored. Are selected by comparison. Then, a guidance route from the current position of the visiting vehicle to the parking space of the selected parking lot number S is calculated, and the process proceeds to step G4.
[0067]
In step G4, the visiting vehicles are photographed by the cameras 1a to 1n, and the current position of the visiting vehicles is specified from the photographed images. Then, the guidance display devices 10a to 10j installed on the calculated guidance route are turned on according to the current position of the visiting vehicle, and guidance is displayed to the empty parking space.
[0068]
Next, in step G5, it is determined whether or not the visiting vehicle is at the guidance end position. When the visitor is not at the position where the guidance has been completed, such as when moving on the guidance route (step G5; N), the process returns to step G2 to continue the guidance. On the other hand, when the visiting vehicle is at the guidance end position, such as when the vehicle has been parked in the already-guided parking space (step G5; Y), the empty vehicle route guidance process ends.
[0069]
As described above, by guiding the route to the empty vehicle, parking can be performed efficiently, and traffic jams and the like can be avoided.
[0070]
Next, the visitor information collection processing will be described with reference to FIG. The visitor information collecting process is a process of collecting specific information of a visitor entering a store from a visiting vehicle parked in a parking lot.
[0071]
In step C1 shown in FIG. 13, it is determined whether or not an image captured by any one of the cameras 1a to 1n has changed. When the visitors move within the shooting range, such as when the visitor is getting off the car and moving down the aisle or the visitor is moving down the aisle and going to the parking position of the car, If there is a change (Step C1; Y), the process proceeds to Step C2, and if the visitor does not move and there is no change in the captured image (Step C1; N), the process proceeds to Step C11 described below.
[0072]
In step C2, the camera whose photographed image has changed is specified, and the camera number C of the specified camera, its photographing time, and the photographed image are temporarily stored in the RAM 23.
[0073]
Next, in step C3, the photographed image temporarily stored in the RAM 23 is read, and the visitors included in the photographed image are specified. Then, it is determined whether or not an image of the same visitor as the specified visitor has already been captured and temporarily stored in the RAM 23. If the photographed image of the same visitor is temporarily stored in the RAM 23 (step C3; Y), the process proceeds to step C4, and the photographed image of the same visitor is not temporarily stored in the RAM 23 (step C3; N). ), And proceeds to the process of Step C11 described later.
[0074]
In step C4, it is determined whether or not the captured image of the specified visitor is an image for which a visitor ID has already been issued in the visitor information memory 233 and a registration area has been secured. If the image has no registered area (step C4; N), the process proceeds to step C5. If the image has already been registered area (step C4; Y), the process proceeds to step C6 described later. I do.
[0075]
In step C5, a new visitor ID is issued to the specified visitor, and a new registration area is secured in the visitor information memory 233. That is, only the visitor whose moving image is photographed twice or more and the photographed image is stored in the RAM 23 is registered in the visitor information memory 233.
[0076]
Next, in step C6, the number of visitors included in the captured image is specified, and in step C7, it is determined whether or not the visitors form a group with accompanying persons. For example, a family or the like who gets off from the same visiting vehicle is determined as one group. If it is determined from the captured image that the visitor and the accompanying person have been identified and form a group (step C7; Y), the process proceeds to step C8, where the number of visitors is one from the captured image, If it is determined that a group has not been configured (step C7; N), the process proceeds to step C9 described below.
[0077]
In step C8, a new group ID is issued to the specified group of visitors, and the group ID is registered in association with the visitor ID registered in the visitor memory 233.
[0078]
Next, in step C9, an image file name is given to the captured image temporarily stored in the RAM 23, and this image file name is registered as a visitor image of the specified visitor in the registration area secured in the visitor memory 233. Is done.
[0079]
Next, in step C10, the camera number C of the camera that captured the registered captured image is additionally registered as the current position of the visitor at the end of the visitor's travel route data, and the route at the time of visit is specified. For example, when a person image 1 shot with camera number 1 and a person image 2 shot with camera number 2 are already registered as visitor images, and a person image 3 shot with camera number 3 this time is registered The camera number 3 is added to the route data registered as “1 → 2” as the visitor's travel route data, and registered as “1 → 2 → 3”.
[0080]
When the route at the time of arrival is specified, it is determined in step C11 whether or not the visitors have been specified for all the cameras. If the visitors have not been specified for the images captured by all the cameras (step C11; N), the process returns to step C2, and the visitors are specified sequentially for the images captured by the remaining cameras. On the other hand, when the visitors have been specified for the images captured by all the cameras (step C11; Y), the visitor information collection processing ends.
[0081]
Next, the exit route guidance processing will be described with reference to FIG. The exit route guidance process is a process of identifying a visitor who exits by photographing, calculating an exit route according to the identified visitor, and performing guidance display.
[0082]
As a premise of the description, it is assumed that an initial screen 261 as shown in FIG. 15 is displayed on the display unit 26. On the initial screen 261, a planar map of the parking lot is displayed, and the current position of the visitor who views the initial screen 261, that is, the installation position of the main body unit 20 is shown. In addition, a return route guidance button 22a for instructing the display of the exit route and a lost child inquiry button 22b for instructing a lost child are displayed below the plane map of the parking lot. When exiting from the facility, the visitor presses the return route guidance button 22a when he / she wants to inquire about the exit route from the store to the parking position where his / her vehicle is parked in the parking lot.
[0083]
When the return route guidance button 22a is pressed, in step D1 shown in FIG. 14, visitors are photographed by the cameras 1a to 1n. Then, an image of the same visitor as the visitor included in the captured image is retrieved from the visitor information memory 233, and when an image of the same visitor is retrieved, the visitor ID corresponding to the visitor image is read. A visitor is specified. When a visitor is specified, the process proceeds to step D2.
[0084]
If a visitor erroneously instructs an exit route inquiry on a floor different from the floor where the vehicle is parked, the image data processing apparatus 100 cannot identify the visitor. In this case, a connection is made to the image data processing device installed on another floor via the communication unit 30, a request for a visitor's inquiry is made, and the visitor is specified from the inquiry result.
[0085]
In step D2, it is determined whether or not the visitor is at a position to be guided from the photographing position where the image of the visitor was photographed. For example, in FIG. 1, the camera number 3 indicates that a visitor has taken a photographed image while looking at the initial screen 261 at the installation position of the main body unit 20, or that the visitor is moving toward a parking position. If the vehicle has not yet reached the guidance end point of the route and is at the position to be guided (step D2; Y), the process proceeds to step D3. If the visitor has already arrived at the parking position, which is the guidance end point, or is in a position where guidance is not required (Step D2; N), the process proceeds to Step D7 described below.
[0086]
In step D3, the movement path data of the specified visitor is read from the visitor information memory 233, and the exit path is calculated based on the movement path data. For example, when the route data at the time of arrival is “1 → 2 → 3” from the moving route data, the route “3 → 4 → 1” in the reverse order to the route at the time of arrival is calculated as the exit route.
[0087]
Next, in step D4, guidance display according to the current position of the visitor and the calculated exit route is performed. For example, when the visitor is at the installation position of the main body 20, a guidance screen 262 as shown in FIG. On the guidance screen 262, a leaving route R from the calculated current position to the parking space X where the visitor's car is parked is displayed. At this time, the display information of the guidance screen 262 may be printed out by the printing unit 29. On the other hand, when the visitor is moving toward the parking position, the current position of the visitor is specified by photographing the cameras 1a to 1n, and the guidance display devices 10a to 10a on the exit route are determined according to the specified current position. 10j is turned on.
[0088]
If the visitor is not specified in step D1 and the visitor is referred to the image data processing apparatus on another floor, and the visitor is specified as a visitor on another floor, a guidance screen 263 for guiding to another floor is provided. (See FIG. 16B) is displayed on the display unit 26, and a guidance message such as “Your parking floor is the fourth floor.
[0089]
Next, in step D5, it is determined whether or not the current position of the visitor is a position where voice guidance should be performed, that is, whether or not the present position is at the installation position of the main body unit 20 having the voice output unit 28. If the visitor is not at a position where voice guidance should be performed, such as when the visitor is moving in a parking lot (step D5; N), the process proceeds to step D7 described below. On the other hand, if the user is at the position where voice guidance should be performed (step D5; Y), the process proceeds to step D6.
[0090]
In step D6, as shown in FIG. 16 (a), the exit screen R is guided along with the guidance screen 262, and the exit path R is guided. Please proceed to "".
[0091]
After the voice guidance, in step D7, it is determined whether or not the current position of the visitor is the position at which the guidance ends. If the current position of the visitor is a position where the guidance has not been completed yet (step D7; N), for example, the visitor is moving on the exit route (step D7; N), the process returns to step D2 and the visitor ends the guidance. Continue induction until. On the other hand, when the guidance is completed (step D7; Y), for example, when the visitor is at the parking position where the guidance ends, the exit route guidance processing is completed.
[0092]
In the present embodiment, an example has been described in which the exit route from the store to the parking position is calculated to guide the visitors, but it is also possible to guide the visiting vehicle from the parking position to the exit of the parking lot. In this case, the route data at the time of the visit is read from the visitor vehicle information memory 232, and the exit route from the parking position of the visitor vehicle to the exit is calculated based on the route data. Next, the current position of the visitor is specified from the imaged position of the image of the imaged vehicle, and the guidance display devices 10a to 10j on the exit route are turned on in accordance with the specified current position to guide the vehicle. .
[0093]
Next, a suspicious person warning process will be described with reference to FIG. The suspicious person warning process is a process of determining whether or not a visitor who is in the parking lot by photographing is a suspicious person, and issuing a warning when it is determined that the visitor is a suspicious person.
[0094]
In step E1 shown in FIG. 17, the visitors 1 are photographed by the cameras 1a to 1n. Then, an image of the same visitor as the visitor included in the captured image is retrieved from the visitor information memory 233, and the visitor is specified.
[0095]
Next, in step E2, it is determined whether or not the visitor information corresponding to the specified visitor is registered in the visitor information memory 233. When there is no visitor information corresponding to the visitor (step E2; N), the visitor is determined to be a suspicious person, and the process proceeds to step E6 described later, and a warning is issued. On the other hand, when there is visitor information corresponding to the visitor (step E2; Y), the process proceeds to step E3.
[0096]
In step E3, the travel route data of the specified visitor is read from the visitor information memory 233, and it is determined from the read travel route data whether the visitor is in the middle of entering the store. When it is determined that the route at the time of the visit is a route from the parking lot to the store and the vehicle is in the middle of entry (step E3; Y), it is determined that the visitor is a normal visitor, and the suspicious person warning process ends. . On the other hand, if it is determined that the route at the time of arrival is not going from the parking lot to the store, but is traveling around the parking lot or from the store to the parking lot, and is not in the middle of entering the store. (Step E3; N), the process proceeds to Step E4.
[0097]
In step E4, travel route data corresponding to the specified visitor is read from the visitor information memory 233, and a leaving route is calculated based on the travel route data.
[0098]
Next, in step E5, the cameras 1a to 1n again photograph the visitors traveling in the parking lot, and it is determined whether or not the specified visitors are proceeding on the calculated exit route. If the visitor is proceeding on the exit route (step E5; Y), the visitor is determined to be a normal visitor, and the suspicious person warning process ends. On the other hand, if the visitor is not on the exit route (step E5; N), it is determined that the visitor is a suspicious person (for example, it is unnatural if a person who is not coming by car is heading for the parking lot). , Suspecting vandalism on the car, etc.), and then proceeding to step E6.
[0099]
In step E6, a warning screen 264 (see FIG. 18) including the captured image of the visitor specified as the suspicious individual is displayed on the display unit 26, and the audio output unit 28 warns that the suspicious individual is in the parking lot. A warning message such as "A suspicious person was found in the third passage on the second floor of the parking lot. A path unrelated to the parking position is in progress" is output as a voice.
[0100]
Note that the captured image of the visitor specified as the suspicious individual may be transmitted to the security system via the communication unit 30 to warn that there is a suspicious individual in the parking lot.
[0101]
Next, in step E7, it is determined whether the warning has ended. If the warning has not ended (step E7; N), the process returns to step E6 to continue the warning, and if the warning has ended (step E7; Y), the suspicious person warning process ends.
[0102]
Next, the lost child inquiry processing will be described with reference to FIGS. The lost child inquiry process is a process of specifying a lost companion from a photographed image of a visitor of a group taken at the time of the visit, and specifying and outputting the current position of the specified lost companion.
[0103]
As a premise of the description, an initial screen 261 shown in FIG. 15 is displayed on the display unit 26 of the main body unit 20. In this initial screen 261, a visitor who is searching for a companion of a lost child is displayed. It is assumed that the lost child inquiry button 22b is pressed to instruct a lost child inquiry.
[0104]
First, in step F1 of FIG. 19, a visitor who has instructed lost child inquiry is photographed. Next, in step F2, the visitor is specified based on the photographed image of the visitor. Specifically, an image of the same visitor as the visitor included in the captured image is retrieved from the visitor information memory 233 and specified.
[0105]
When the visitor is specified, in step F3, a companion of the lost child is specified based on the photographed image of the visitor photographed in the group at the time of the visit and the photographed image of the visitor photographed in step F1. For example, the photographed image of the visitor P photographed in step F1 is an image as shown in FIG. 20A, and the photographed image of the group photographed at the time of the visit is an image as shown in FIG. In this case, the visitors P and Q belonging to the group are photographed at the time of the visit, but only the visitor P is photographed at the time of the lost child inquiry. Therefore, the accompanying person of the lost child is specified as the visitor Q.
[0106]
Next, in step F4, the cameras 1a to 1n take pictures of the inside of the parking lot and the store, and an image in which the same visitor as the identified accompanying person of the lost child is taken from these taken images. When the photographed image of the companion of the lost child is retrieved, the current position of the companion of the lost child is specified from the photographed position, and is stored in the visitor information memory 233 as the latest travel route. For example, in the example described above, if the same visitor as the lost companion P is identified from the image captured by the camera number 10, the current position of the lost companion P is determined by the installation position of the camera number 10. Is specified.
[0107]
When the current position is specified as the latest moving path of the lost companion, in step F5, a lost child inquiry screen 265 (see FIG. 20C) displaying a captured image of the specified lost companion is displayed. At the same time, a message such as "Discovery of lost person at toy section on the fifth floor of the store" or the like, which notifies the current location of the accompanying person of the lost child, is output by voice output unit 28.
[0108]
After the voice output, in step F6, it is determined whether or not the lost child search has been completed. If there are a plurality of lost children and the search of the current position has not been performed for all the lost children (step F6; N), the process returns to step F4, and the search for another lost child is repeated. On the other hand, when the search of the current position is completed for all the lost children (step F6; Y), the lost child inquiry processing is terminated.
[0109]
As described above, the image of the moving visitor is photographed by the image data processing apparatus 100, the route at the time of visit is specified from the photographed image and stored in the visitor information memory 233, and when the visitor leaves. In, the exit route is calculated and displayed based on the route at the time of arrival, so that even if the parking position is forgotten, the visitor can easily grasp the exit route.
[0110]
Similarly, an image of the traveling vehicle that is moving is captured for the visiting vehicle on which the passenger is boarding, the route at the time of arrival is specified from the captured image and stored in the visiting vehicle information memory 232, and the visiting vehicle exits. In doing so, the exit route is calculated and guided based on the exit route, so that the visitor can easily grasp the exit route even while driving the car. Therefore, it is possible to reduce traffic congestion in the hall.
[0111]
In addition, when a visitor in the parking lot is specified by photographing, a photographed image of the specified visitor at the time of the visit is not stored in the visitor information memory 232, or the specified visitor is not in progress on the exit route. Since the visitor is determined to be a suspicious individual and is warned that there is a suspicious individual in the hall, it is possible to prevent crimes in the hall beforehand and to secure security in the hall.
[0112]
In addition, the current position of the suspicious individual is identified from the photographed image of the suspicious individual, and when the suspicious individual is warned, the photographed image of the suspicious individual is displayed and the current position of the suspicious individual is output in voice, so that the suspicious individual can be easily output. Can be specified, and security can be improved.
[0113]
Also, the visitors and their accompanying persons are stored as a group in the visitor information memory 233 in association with the group ID, and when a lost child is referred, the lost image is taken from the photographed image of the visitors. Is identified and the current position of the companion of the lost child is specified from the traveling route data of the companion of the lost child, and the current position is displayed or output in voice. Can be easily searched for.
[0114]
Note that the description content in the present embodiment is a suitable example to which the image data processing device of the present invention is applied, and is not limited to this. Further, the detailed configuration and detailed operation of the image data processing apparatus 100 according to the present embodiment can be appropriately changed without departing from the spirit of the present invention.
[0115]
【The invention's effect】
According to the first aspect of the present invention, the route at the time of arrival is specified and stored from the image of the moving visitor, and the route at the time of exit is calculated and output based on the route at the time of the visit. The visitor can easily grasp the route at the time of leaving.
[0116]
According to the tenth aspect of the present invention, the moving path of the visitor and the accompanying person is specified from the photographed image and the photographing position where the visitor and the accompanying person are taken as one group and correspond to the identification data of the group. In addition, the latest travel route of the accompanying person is retrieved and output based on the identification data of the group, so that the traveling route of the accompanying person can be easily grasped.
[0117]
According to the fourteenth aspect of the present invention, the route at the time of arrival is specified from the photographed image and the photographing position of the moving visitor, and the route at the time of exit is calculated and output based on the route at the time of visit. Therefore, the visitor can easily grasp the route at the time of leaving.
[0118]
According to the invention described in claim 15, the movement route of the visitor and the accompanying person is specified from the photographed image and the photographing position where the visitor and the accompanying person are taken as one group and correspond to the identification data of the group. In addition, the latest travel route of the accompanying person is retrieved and output based on the identification data of the group, so that the traveling route of the accompanying person can be easily grasped.
[Brief description of the drawings]
FIG. 1 is a diagram showing an installation example of an image data processing apparatus 100 according to an embodiment to which the present invention is applied.
FIG. 2 is a diagram showing an installation example of the guidance display devices 10a to 10j in FIG.
FIG. 3 is a block diagram illustrating a functional configuration of the image data processing apparatus 100.
FIG. 4 is a diagram showing a data configuration example of an empty vehicle information memory 231.
FIG. 5 is a diagram showing an example of a data configuration of a visiting vehicle information memory 232;
FIG. 6 is a diagram showing a data configuration example of a visitor information memory 233.
FIG. 7 is a diagram showing a data configuration example of an empty vehicle determination image table 271.
FIG. 8 is a flowchart illustrating an empty vehicle information collection process executed by the image data processing apparatus 100.
FIG. 9 is a flowchart illustrating an image identification process of an empty vehicle state performed by the image data processing apparatus 100.
10A is an empty vehicle determination image captured by the camera 1c having the camera number 3, and FIG. 10B is a captured image captured by the camera 1c having the camera number 3. FIG.
FIG. 11 is a flowchart illustrating a visiting vehicle information collection process executed by the image data processing apparatus 100.
FIG. 12 is a flowchart illustrating an empty vehicle route guidance process executed by the image data processing apparatus 100.
FIG. 13 is a flowchart illustrating a visitor information collection process performed by the image data processing apparatus 100.
FIG. 14 is a flowchart illustrating a leaving route guidance process performed by the image data processing apparatus 100.
15 shows an initial screen 261 displayed on the display unit 26. FIG.
16A is a diagram illustrating a guidance screen 262 displayed on the display unit 26, and FIG. 16B is a diagram illustrating a guidance screen 263.
17 is a flowchart illustrating a suspicious person warning process performed by the image data processing apparatus 100. FIG.
FIG. 18 is a diagram showing a warning screen 264 displayed on the display unit 26.
FIG. 19 is a flowchart illustrating a lost child inquiry process executed by the image data processing apparatus 100.
FIG. 20A is a photographed image of the visitor P photographed at the time of lost child inquiry, and FIG. 20B is a photographed image of the visitor P and the accompanying person Q photographed at the time of visit. (C) is a figure which shows the lost child inquiry screen 265 displayed on the display part 26.
[Explanation of symbols]
1a-1n camera
10a-10n Guidance display device
21 CPU
22 Input section
22a Return guide button
22b Lost child inquiry button
23 RAM
231 Empty car information memory
232 Visitor car information memory
233 Visitor information memory
24 Camera connection
25 Guidance display device connection
26 Display
27 Memory
271 Empty vehicle judgment image table
28 Audio output unit
29 Printing department
30 Communication unit

Claims (15)

Photographing means for sequentially photographing images of a moving visitor at a plurality of positions;
From the photographed image of the visitor and a plurality of photographing positions, specifying means for specifying a route of the visitor at the time of visit,
Calculating means for calculating a route at the time of exit based on the specified route at the time of arrival;
Output means for outputting the calculated route at the time of exit when the visitor leaves,
An image data processing device comprising: Path storage means for storing the path specified by the specifying means,
Guidance means for guiding the visitor on the calculated exit route according to the specified visitor's shooting position,
The image data processing device according to claim 1, further comprising: A determination unit configured to determine whether the specified visitor is a suspicious person traveling on a route different from the exit route based on the photographed image of the visitor,
When the determined visitor is determined to be a suspicious person by the determination unit, a warning unit that warns that the suspicious person is in the hall,
The image data processing device according to claim 1, further comprising: The specifying means specifies a current position of the suspicious individual from a photographing position of the image of the photographed suspicious person,
The image data processing apparatus according to claim 3, wherein the output unit outputs a current position of the identified suspicious individual. The image data processing device according to claim 3, wherein the output unit outputs the image of the photographed suspicious individual. The photographing means, as a visitor, sequentially takes images of a visitor vehicle on which the visitor gets on at a plurality of positions,
The specifying means specifies a route at the time of the visit of the visit vehicle from the photographed image of the visit vehicle and a plurality of photographing positions,
The route storage means stores the identified route at the time of arrival,
The calculating means calculates a route at the time of exit based on the stored route at the time of arrival,
2. The image data processing apparatus according to claim 1, wherein the output unit outputs the calculated route at the time of the exit of the visiting vehicle. The specifying means specifies the current position of the visiting vehicle from the photographed position of the visiting vehicle,
7. The image data processing apparatus according to claim 6, wherein the guidance unit guides the visiting vehicle along the calculated exit route according to the specified current position of the visiting vehicle. A determination image storage unit that stores an image obtained by photographing the inside of the empty space where there is no incoming vehicle as a determination image,
The photographing means photographs an image of the hall,
The determining means compares the captured image in the place where the image was taken with the stored determination image to determine a free space in the place,
8. The image data processing apparatus according to claim 6, wherein the output unit outputs information on the determined empty space. 19. The vehicle according to claim 6, wherein the guiding unit guides the visiting vehicle to an empty space in the hall determined by the determining unit according to the specified current position of the visiting vehicle. An image data processing device according to claim 1. Photographing means for sequentially taking a visitor and a companion in the vicinity of the visitor at a plurality of positions as a group,
Identifying means for identifying a moving path of the group from the photographed group images and the plurality of photographing positions, and for specifying a moving path of each of a visitor and a companion when the group moves separately. When,
Route storage means for sequentially storing the specified movement route in association with the group identification data,
Output means for acquiring identification data of the group of the visitor from the captured image of the visitor, searching for and outputting the latest travel route of the accompanying person included in the group from the route storage means,
An image data processing device comprising: 11. The image data processing apparatus according to claim 10, wherein the output unit retrieves and outputs the latest travel route of a lost companion from the companion belonging to the group from the route storage unit. The specifying means specifies the current position of the companion of the lost child from the photographing position of the companion of the lost child photographed by the photographing means,
The image data processing device according to claim 11, wherein the output unit outputs a current position of the companion of the lost child. The image data processing apparatus according to claim 7, wherein the output unit outputs a captured image of the photographed companion of the lost child. On the computer,
A shooting function for sequentially shooting images of a moving visitor at a plurality of positions,
From the photographed image of the visitor and a plurality of photographing positions, a specifying function of specifying a route of the visitor at the time of visit,
A calculation function for calculating a route at the time of exit based on the route at the time of the specified visit,
When the visitor leaves, an output function for outputting the calculated exit route,
The program to realize. On the computer,
A photographing function of sequentially grouping a visitor and a companion in the vicinity of the visitor at a plurality of positions, and
A specifying function for specifying a moving route of the group from the photographed group images and the plurality of photographing positions, and specifying a moving route of each of a visitor and a companion when the group moves separately. When,
A function of sequentially storing the specified moving route in the route storage unit in association with the identification data of the group;
An output function of acquiring identification data of the group of the visitor from the photographed image of the visitor, searching for and outputting the latest traveling route of the accompanying person included in the group from the route storage unit,
The program to realize.

Images