JP6509691B2 - Ticket inspection system - Google Patents

Description

  Embodiments of the present invention relate to a ticket gate monitoring system.

  At railway stations, etc., admission tickets are used to temporarily enter the station premises. As this admission ticket does not include the fare, it is prohibited for the user to get on the train. However, in the prior art, there was a case where it could not cope with the user who used the admission ticket getting on the train illegally.

Unexamined-Japanese-Patent No. 2010-097272

  The problem to be solved by the present invention is to provide a ticket gate monitoring system capable of suppressing the occurrence of an illegal ride by a user using an admission ticket.

  The ticket inspection system according to the embodiment includes an entrance surveillance camera, a reading unit, a generation unit, a getting on / off surveillance camera, and a movement determination unit. The entry surveillance camera captures an image of a user entering the station yard. The reading unit reads identification information of an admission ticket for identifying the admission ticket from the admission ticket used by the user. The generation unit generates correspondence information in which information based on the image of the user captured by the entrance surveillance camera is associated with identification information of the entrance ticket read by the reading unit. An on-off surveillance camera captures an image of a user who gets on and off the train. The movement determination unit uses the admission ticket based on the correspondence information generated by the generation unit and the information based on the image captured by the getting-on / off camera during the period from when the train stops at the station to when it leaves the station. It is determined whether the user who has been traveling is moving by train.

BRIEF DESCRIPTION OF THE DRAWINGS The figure which shows an example of a structure of the ticket inspection system 1 in embodiment. The figure which looked at the automatic ticket gate 100 in embodiment from upper direction. The figure which looked at the main opportunity 110 of the automatic ticket gate 100 of an embodiment from the passage side. A figure showing an example of functional composition of automatic ticket gate 100 in an embodiment. The figure which shows an example of a function structure of the station server apparatus 200 in embodiment. A figure showing an example of user database DB stored in station server side storage part 230 in an embodiment. The figure which shows an example of the entrance ticket user watch list WL produced | generated by the information management part 216 in embodiment. The figure which shows an example of a function structure of the vehicle server apparatus 300 in embodiment. The figure which shows the example of arrangement | positioning of boarding surveillance camera CAMa and CAMb. The sequence diagram which shows an example of the flow of a process of the ticket inspection system 1 in embodiment. The flowchart which shows an example of the flow of processing of the automatic ticket gate 100 in an embodiment. The flowchart which shows an example of the flow of processing of station server device 200 in an embodiment. The figure for demonstrating the transmission method of the entrance ticket user watch list WL. The flowchart which shows an example of the flow of processing of vehicle server device 300 in an embodiment.

  Hereinafter, a ticket inspection system according to an embodiment will be described with reference to the drawings.

  FIG. 1 is a diagram showing an example of the configuration of the ticket inspection system 1 according to the embodiment. The ticket inspection system 1 of this embodiment is used, for example, to monitor entry and exit at a railway station. The ticket inspection system 1 includes, for example, a plurality of automatic ticket gates 100, a plurality of station server devices 200-1 to 200-n, and a plurality of vehicle server devices 300-1 to 300-m. The symbols n and m are arbitrary natural numbers. In addition to the above-described example, the ticket inspection system 1 may be applied to, for example, a system for monitoring boarding (boarding) or boarding (boarding) of a vehicle such as a bus or a ferry.

  For example, a plurality of automatic ticket gates 100 are provided at ticket gates of stations. As illustrated, when there are a plurality of ticket gates at a station, the automatic ticket gate 100 is provided for each ticket gate. The automatic ticket gate 100 restricts entry and exit of users by reading information from a ticket TIX issued by a ticket vending machine or the like (not shown). The ticket TIX in the present embodiment is an admission ticket for entering the station yard temporarily, a one-way, two-way, ordinary ticket such as round trip, a fixed number of available number ticket, and a commuter's commuter ticket It is classified into the ticket type such as The ticket TIX described above may be, for example, a magnetic ticket having a magnetic recording surface on the front or back surface of the ticket, or a paper ticket on which a two-dimensional code such as QR code (registered trademark) is printed. Good. Hereinafter, the ticket TIX will be described as a magnetic ticket. For example, ticket information is recorded on the magnetic recording surface of the ticket TIX. The ticket information includes, for example, a valid period, a boarding station (a departure station), a boarding section, a ticket identification information (ticket ID) for identifying each of the boarding tickets, a boarding time, participation from a station yard, or a station It includes entry and exit code indicating entry to the yard and information such as the ticket type of the ticket.

  Each of the station server devices 200-1 to 200-n is provided, for example, for each station, communicates with the above-described automatic ticket gate 100 by wireless or wired communication, and processes information acquired from the automatic ticket gate 100. For example, the station server devices 200-1 to 200-n can process the processed information in the vehicle server devices 300-1 to 300- via the network NW including a LAN (Local Area Network), a WAN (Wide Area Network), and the like. Send to m etc. Station server devices 200-1 to 200-n are an example of an information processing device. Hereinafter, the station server devices 200-1 to 200-n will be simply referred to as the station server device 200 unless they are particularly distinguished.

  Each of the vehicle server devices 300-1 to 300-m is provided, for example, for each of the trains T1 to Tm, and performs wireless communication with the wireless base station BS connected to the above-mentioned network NW. Trains T1 to Tm in the present embodiment are, for example, limited express trains such as Shinkansen. The vehicle server devices 300-1 to 300-m receive information from the station server device 200 via the radio base station BS, and perform various processes in units of trains. Hereinafter, when the vehicle server devices 300-1 to 300-m and the trains T1 to Tm are not particularly distinguished from one another, they are simply referred to as the vehicle server device 300 and the train T, respectively.

  Hereinafter, the automatic ticket gate 100, the station server device 200, and the vehicle server device 300 described above will be described. First, the automatic ticket gate 100 will be described.

  FIG. 2 is a view of the automatic ticket gate 100 in the embodiment as viewed from above. The automatic ticket gate 100 includes, for example, a master 110 and a slave 130 which are disposed opposite to each other across a passage. For example, main unit 110 includes reading unit 111, top display unit 112, front display unit 113, doors 114 and 115, ticket entry port 116, ticket exit 117, camera 118, ticket gate, and the like. And a side control unit 150. In addition, the slave unit 130 includes a reading unit 131, an upper surface display unit 132, a front display unit 133, doors 134 and 135, a ticket input port 136, a ticket output port 137, and a camera 138. Prepare.

  The reading unit 111 of the main unit 110 is, for example, a magnetic ticket reader / writer. The reading unit 111 reads the ticket information recorded in the ticket TIX inserted into the ticket inlet 116 by the user who is going to pass in the a direction shown in FIG. 2 and reads the read ticket information on the ticket gate side Transmit to control unit 150. Further, the reading unit 111 rewrites the ticket information of the ticket TIX based on the information output by the ticket control device-side control unit 150, and discharges the ticket information from the ticket discharge port 117. When the ticket TIX is inserted into the ticket insertion port 116, the upper surface display unit 112 displays an image based on the result processed by the ticket gate-side control unit 150 or the information received from the station server device 200. The front display unit 113 displays a mark, a figure, a character, and the like indicating whether or not it is possible to pass in the direction a shown in FIG. The display content of the front display unit 113 or the presence or absence of the display is determined by the ticket control device control unit 150.

  On the other hand, the reading unit 131 of the slave 130 is, for example, a magnetic ticket reader / writer. The reading unit 131 reads the ticket information recorded in the ticket TIX inserted into the ticket insertion slot 136 by the user who is going to pass in the b direction shown in FIG. 2 and reads the read ticket information on the ticket gate side Transmit to control unit 150. Further, the reading unit 131 rewrites the ticket information of the ticket TIX based on the information output by the ticket gate control unit 150 and discharges the ticket information from the ticket outlet 137. When the ticket TIX is inserted into the ticket insertion port 136, the upper surface display unit 132 displays an image based on the result processed by the ticket gate controller 150 or the information received from the station server device 200. The front display unit 133 displays a mark, a figure, a character, and the like indicating whether or not passage is possible in the direction b shown in FIG. The display content of the front display unit 133 or the presence or absence of the display is determined by the ticket control unit 150.

  When the automatic ticket gate 100 is set to the operation mode that allows the user to pass in the direction a shown in FIG. 2, the ticket gate side controller 150 maintains the door portions 115 and 135 in the open state, and By controlling the door parts 114 (115) and 134 (135) to the open state or the closed state, the passage of the user in the a direction is permitted or prohibited. Further, when the automatic ticket gate 100 is set to the operation mode that allows the user to pass in the b direction shown in FIG. 2, the ticket gate side controller 150 sets the door portions 114 (115) and 134 (135). Is maintained in the open state, and the doors 115 and 135 are controlled in the open state or the closed state, thereby allowing or prohibiting the passage of the user in the b direction.

  Further, the operation mode of the automatic ticket gate 100 may include an operation mode that permits both passage in the a direction and passage in the b direction shown in FIG. 2. In this case, if the user is not passing through, for example, the ticket gate-side control unit 150 controls the front display unit 113 and the front display unit 133 to display marks, figures, characters, etc. I do. Further, in the ticket gate side controller 150, for example, the user enters from either side of the a direction or the b direction, and the ticket TIX is displayed in one of the ticket entry port 116 and the ticket entry port 136. When it is inserted, the opening of the other ticket entry port is closed to prohibit entry of the ticket TIX, and the display unit (the front display unit 113 or the front display unit 133) on the side to which the user has not entered Control is performed to display marks, figures, characters and the like indicating that passage is prohibited.

  In FIG. 2, the automatic ticket gate 100 has been described as being a dedicated device for magnetic tickets whose ticket information is recorded on the magnetic recording surface. However, the automatic ticket gate 100 further has a two-dimensional structure such as a QR code. It may be an apparatus capable of processing a paper card on which a code is printed, a traffic IC card capable of storing information such as electronic money, and the like. Further, the automatic ticket gate 100 is not limited to one that allows the user to pass in both directions, but may be one that can be passed by the user in only one direction, which is configured of a master and an accessory.

  FIG. 3 is a view of the main unit 110 of the automatic ticket gate 100 of the embodiment as viewed from the passage side. In addition to the door parts 114 and 115 and the camera 118 described above, the main unit 110 further includes a transmissive photoelectric sensor St and a reflective photoelectric sensor Sr. For example, among the housing surfaces of the main unit 110, a plurality of (26 in the case of the example of FIG. 3) transmission-type photoelectric sensors St are provided at equal intervals on the housing surface on the passage side. In the present embodiment, a transmission type photoelectric sensor St functioning as a light projector and a transmission type photoelectric sensor St functioning as a light receiver are used as a pair. For example, when the transmission type photoelectric sensor St provided in the main unit 110 is a light projector, the transmission type photoelectric sensor St provided in the slave unit 130 functions as a light receiver. Based on the detection signals of the plurality of transmission type photoelectric sensors St and the arrangement position, the ticket gate-side control unit 150 described later specifies the position in the passage where the user is. Further, as in the case of the transmission type photoelectric sensor St, for example, a plurality of reflection type photoelectric sensors Sr are provided at equal intervals on the passage side surface of the partition part protruding upward from the casing of the main unit 110 (see FIG. In the case, 3) are provided. The reflective photoelectric sensor Sr projects light in a predetermined direction. The reflective photoelectric sensor Sr projects light and then receives light reflected from the direction in which the light is projected. The reflective photoelectric sensor Sr generates a detection signal indicating whether or not the user's body that reflects the light exists in the passage based on the intensity of the received light. The reflective photoelectric sensor Sr is mainly used to identify the height of the user present in the passage. For example, according to the height of the user, the ticket gate-side control unit 150 described later distinguishes whether the user is an adult or a child. Although the above-described reflection type photoelectric sensor Sr has been described as being provided to the main unit 110, the present invention is not limited to this. The reflection type photoelectric sensor Sr may be provided to the sub unit 130 or may be provided to both the main unit 110 and the sub unit 130 Good.

  The camera 118 includes, for example, an image sensor such as a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). For example, the angle of the camera 118 is set so that the face of the user who inserts the ticket TIX into the ticket inlet 116 falls within the viewing angle FOV. The camera 118 captures an image of a user who tries to insert a ticket TIX into the ticket inlet 116 or has inserted a ticket TIX under the control of the ticket gate side control unit 150. The camera 118 captures images continuous in time series, that is, a moving image, for example, at about 5 to 10 fps (frame per second). The camera 118 outputs the captured moving image (image) to the ticket gate control unit 150. The camera 138 of the slave unit 130 is also set so that the face of the user whose angle inserts the ticket TIX into the ticket inlet 136 falls within the viewing angle FOV, as with the camera 118. Thereby, the camera 138 captures an image of the user who is trying to insert the ticket TIX into the ticket insertion port 136 or the user who has entered the ticket under the control of the ticket gate side control unit 150. The camera 138 outputs the captured moving image (image) to the ticket gate control unit 150. The camera 118 (138) is an example of the entrance surveillance camera.

  FIG. 4 is a diagram showing an example of a functional configuration of the automatic ticket gate 100 in the embodiment. In addition to the configuration shown in FIG. 2, the automatic ticket gate 100 further includes a speaker 140 for outputting sound in accordance with an instruction from the ticket gate-side control unit 150 and a ticket gate-side storage unit 170 for storing various information. Further, the ticket gate-side control unit 150 includes a ticket gate-side communication unit 152, an imaging control unit 154, and a passage determination unit 156.

  Some or all of the functional units of the ticket gate-side control unit 150 are realized by execution of a program stored in the ticket gate-side storage unit 170 by a processor such as a CPU (Central Processing Unit). For example, the program may be downloaded from an application server via a network, or the program stored in a portable storage medium such as an SD card may be installed in the automatic ticket gate 100. Further, some or all of the functional units of the ticket control unit-side control unit 150 are realized by hardware such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), and FPGA (Field-Programmable Gate Array). It is also good.

  The ticket gate machine side storage unit 170 is, for example, a nonvolatile storage medium such as a ROM (Read Only Memory), a flash memory, an HDD (Hard Disk Drive), a non-volatile storage medium such as an SD card, a RAM (Random Access Memory), and a register. And a storage medium of The ticket gate side storage unit 170 stores a program to be executed by the processor and also stores a fare table and the like described later.

  The ticket gate side communication unit 152, for example, associates the moving image captured by the camera 118 (138) with the ticket information read from the ticket TIX to be processed and transmits it to the station server device 200.

  In addition, the ticket gate side communication unit 152 receives the information transmitted by the station server device 200, and outputs this information to the passage determination unit 156.

  The ticket gate side communication unit 152 detects a detection signal detected by the transmission type photoelectric sensor St or the reflection type photoelectric sensor Sr when the user enters the station yard or participates in the station yard as a station server device. It may be sent to 200.

  The imaging control unit 154 causes the camera 118 (138) to start capturing a moving image when, for example, the approach of the user can be detected by the human sensor Sc or the like provided on the housing surface of the master unit 110 or the slave unit 130. . Further, the imaging control unit 154 controls the camera 118 (in accordance with a series of processes from when the reading process of the ticket TIX by the reading unit 111 (131) is started to when the determination process by the passability determination unit 156 is completed. 138) End the imaging of the moving image.

  The passage determination unit 156 performs control to permit or prohibit passage of the user based on the ticket information read by the reading unit 111 (131). For example, the automatic ticket gate 100, which is the own device, can check the passability determination unit 156 by collating the information such as the valid period, the boarding station (a departure station), the boardable section, etc. Whether the installed station matches the boarding station, whether the station where the automatic ticket gate 100 is installed is within the boardable section, ie, whether the boarding section of the user meets the purchase price for the ticket Determine the judgment condition such as whether the time when the ticket TIX is inserted into the ticket insertion slot 116 (136) is within the valid period, and allow the user to pass when all the judgment conditions are satisfied, The user is prohibited from passing if any one or more determination conditions are not satisfied.

  In addition, when the used ticket TIX is an entrance ticket, the passage determination section 156 inserts the ticket TIX into the ticket entry port 116 (136) to determine whether the ticket is an entrance ticket for the station. Judgment conditions such as whether or not the time is within the effective period is judged, and the passage of the user is permitted when all the judgment conditions are satisfied, and the passage of the user when any one or more judgment conditions are not satisfied. Prohibit

  The passage determination unit 156 determines whether the doors 114, 115, 134, 135, the speaker 140, the upper surface display 112, 132, the front display 113, 133, or a combination thereof is used according to the determination of permission or prohibition of the passage. Control things.

  In addition, the passage determination unit 156 passes the user when the user proceeds to the specified position of the photoelectric sensor St without passing the ticket TIX into the ticket entry port 116 (136). Prohibit

  Hereinafter, the station server device 200 will be described. FIG. 5 is a diagram showing an example of a functional configuration of the station server device 200 in the embodiment. The station server device 200 includes, for example, a station server control unit 210 and a station server storage unit 230.

  The station server side control unit 210 includes, for example, a station server side communication unit 212, an image selection unit 214, and an information management unit 216. Part or all of these functional units are realized by execution of a program stored in the station server side storage unit 230 by a processor such as a CPU. For example, the program may be downloaded from the application server via a network including a LAN, a WAN, etc., or the program stored in a portable storage medium such as an SD card may be installed in the station server device 200. Further, some or all of the functional units of the station server control unit 210 may be realized by hardware such as an LSI, an ASIC, or an FPGA.

  The station server side storage unit 230 is realized by, for example, a non-volatile storage medium such as a ROM, a flash memory, an HDD, and an SD card, and a volatile storage medium such as a RAM and a register. The station server side storage unit 230 stores a program to be executed by the processor and, for example, a moving image (time series data of an image) captured by the camera 118 (138), a user database DB described later, an admission ticket user The watch list WL and timetable information TTB are stored.

  The station server side communication unit 212 receives the information transmitted by the automatic ticket gate 100. Further, the station server side communication unit 212 transmits the processing result of the station server side control unit 210 to the vehicle server device 300.

  The image selection unit 214 is a frame containing a form using the ticket TIX when the user enters the station yard from the moving image captured by the camera 118 (138) based on the processing time of the automatic ticket gate 100. Select an image. For example, the image selection unit 214 selects an image having a predetermined number of frames that are temporally adjacent to each other around the processing time of the automatic ticket gate 100. Then, the image selection unit 214 selects a frame image containing a form using the ticket TIX when the user participates in the station yard. Here, the “figure using the ticket TIX” is, for example, a body above the chest of a person, and more preferably a head including the face of the user. The image selection unit 214 selects a frame image in which the largest part of the human head is accommodated by a method such as pattern matching.

  The “processing time of the automatic ticket gate 100” is, for example, the time when the ticket TIX is inserted into the ticket entry port 116 (136), or the time when the passability determination unit 156 determines the passability. is there. The “processing time of the automatic ticket gate 100” may be a time when a detection signal of the transmission type photoelectric sensor St of the automatic ticket gate 100 or the reflection type photoelectric sensor Sr is generated.

  The information management unit 216 associates the ticket information received by the station server side communication unit 212 with the frame image selected by the image selection unit 214, stores the ticket information in the station server side storage unit 230, and obtains the ticket TIX. Build a user database DB to monitor users who use it.

  Drawing 6 is a figure showing an example of user database DB stored in station server side storage part 230 in an embodiment. The user database DB, for example, for each ticket identification information (ticket ID), ticket type information, processing time of the automatic ticket gate, ticket gate identification information (ticket ID), usage conditions, frame image And are a set of data strings associated with each other.

  The information management unit 216 extracts only a data string having ticket type information indicating an admission ticket from the user database DB, and generates an admission ticket user watch list WL in which only users who have used the admission ticket are selected. The information management unit 216 is an example of a generation unit.

  FIG. 7 is a diagram showing an example of the entrance ticket user watch list WL generated by the information management unit 216 in the embodiment. As illustrated, the information management unit 216 extracts ticket identification information IDt-C and IDt-E having ticket type information indicating an admission ticket from the user database DB of FIG. The watch list WL is generated.

  The station server side communication unit 212 described above refers to the timetable information TTB stored in advance in the station server side storage unit 230, and uses the admission ticket user watch list WL generated by the information management unit 216 as an admission ticket. It transmits to the vehicle server apparatus 300 mounted in the train T which the user who utilized can get on. The selection method of the vehicle server device 300 which is the transmission destination of the entrance ticket user watch list WL will be described later using a sequence diagram or a flowchart.

  Hereinafter, the vehicle server device 300 will be described. FIG. 8 is a diagram showing an example of a functional configuration of the vehicle server device 300 in the embodiment. The vehicle server device 300 includes, for example, a vehicle server control unit 310 and a vehicle server storage unit 330.

  The vehicle server side control unit 310 includes, for example, a vehicle server side communication unit 312, a feature extraction unit 314, and a movement determination unit 316. Some or all of these functional units are realized by execution of a program stored in the vehicle server storage unit 330 by a processor such as a CPU. For example, the program may be downloaded from the application server via a network including a LAN, a WAN, etc., or the program stored in a portable storage medium such as an SD card may be installed in the vehicle server device 300. Further, some or all of the functional units of the vehicle server control unit 310 may be realized by hardware such as an LSI, an ASIC, or an FPGA.

  The vehicle server side storage unit 330 is realized by, for example, a nonvolatile storage medium such as a ROM, a flash memory, an HDD, and an SD card, and a volatile storage medium such as a RAM and a register. The vehicle server side storage unit 330 stores the program executed by the processor, and also stores, for example, the admission ticket user watch list WL generated for each station server device 200 installed at each station. For example, the vehicle server side storage unit 330 stores the entrance ticket user watch lists WL1 to WLn generated by each of the station server devices 200-1 to 200-n.

  Vehicle server side communication unit 312 receives admission ticket user watch list WL generated for each station server device 200. Further, the vehicle server side communication unit 312 receives information indicating an image captured by the getting on / off monitoring camera CAMa, CAMb. The passenger monitoring cameras CAMa and CAMb are provided, for example, in a train and images a passenger opening and closing that is opened and closed when the train stops at the station.

  FIG. 9 is a view showing an arrangement example of the getting-on / off monitoring cameras CAMa and CAMb. In the example shown in FIG. 9, among the side surfaces of the train T, the camera cameras CAMa-1 and CAMa-2 capture the entrance provided on one side of the train T from the inside of the train T, The car surveillance cameras CAMb-1 and CAMb-2 capture an entrance provided on the other side of the train T from the inside of the train T. Hereinafter, CAMa-1 and CAMb-1 will be representatively described.

  The passenger monitoring camera CAMa-1 is, for example, provided on a ceiling surface in the train T, and of the doors DR1 and DR3 of the entrances installed at opposite positions, the door DR3 of the B side door is the back of the door DR1. Capture the direction. In addition, for example, the passenger monitoring camera CAMb-1 is provided on a ceiling surface in the train T, and among the doors DR1 and DR3 of the entrances installed at opposite positions, the door DR1 on the A side is the back of the door Capture the direction of DR3.

  For example, when the platform of the station is located on the A side when the train T stops at the station, the entrance door DR1 opens and closes. In this case, the passenger monitoring camera CAMb-1 picks up the user who gets in from the door DR1 of the entrance from the back and picks up the user who gets off the door DR1 from the front. Moreover, while getting on / off the surveillance camera CAMa-1 images from the front the user who gets in from the door DR1 of the entrance, and captures the user who gets off from the door DR1 from the back. Therefore, when the door DR1 on the A side of the entrance opens and closes, the face and the like of the user getting off the train T is reflected in the image captured by the getting on and off monitoring camera CAMb-1 and the getting on and off monitoring camera CAMa- The face of the user who gets on the train T, etc., is captured in the image captured by 1.

  On the other hand, when the platform of the station is located on the B side, the roles of the boarding surveillance cameras CAMa-1 and CAMb-1 switch between each other. That is, the passenger monitoring camera CAMa-1 images the user who gets in from the door DR3 of the entrance from the back and picks up the user who gets off the door DR3 from the front. Moreover, while getting on and off the surveillance camera CAMb-1 images from the front the user who gets in from the door DR3 of the entrance, and captures from the rear the user getting off the door DR3.

  The feature extraction unit 314 extracts the features of the user's face from the images captured by the on / off surveillance cameras CAMa and CAMb. The feature of the face is, for example, a feature point such as an ear, a nose, a mouth, an eye, a contour of a face (edge), and the like. Also, the feature extraction unit 314 extracts the feature of the user's face from the frame image included in the admission ticket user watch list WL. Hereinafter, the feature of the user's face extracted from the frame image included in the entrance ticket user watch list WL is referred to as a first feature, and is used from the images captured by the on / off monitoring cameras CAMa and CAMb. The feature of the person's face is described as a second feature.

  The movement determination unit 316 analyzes the image of the user captured by the on / off monitoring cameras CAMa and CAMb to determine whether the user has got on or off. For example, the movement determination unit 316 uses the on / off monitoring camera based on the imaging directions of the on / off monitoring cameras CAMa and CAMb and information on which side of the on / off openings is opened and closed for each station. It is determined whether the captured image is an image captured at the time of getting on or an image captured at the time of getting off. Note that the movement determination unit 316 is not limited to this, and whether the image is captured at the time of getting on or off at the time of getting off based on the moving direction of the user in the images captured in time series You may judge.

  Then, the movement determination unit 316 includes an image estimated to have captured the same person as the user of the frame image included in the entrance ticket user watch list WL in the image captured at the time of getting on the train T, When it is not included in the image captured at the time of getting off the train T, it is determined that the user using the entrance ticket is moving by the train T.

  For example, the movement determination unit 316 determines the positional relationship of the feature points and the contour representing the first feature extracted by the feature extraction unit 314 from the frame images included in the entrance ticket user watch list WL, The image having the second feature is used for the entrance ticket when the positional relationship of the feature point or the contour representative of the second feature extracted by the feature extraction unit 314 from the image captured by CAMa and CAMb matches It is estimated that the user of the frame image included in the watch list WL is an image obtained by imaging the same person. Here, "match" is a case where the positional relationship of the feature point or the contour representing the first feature completely matches the positional relationship of the feature point or the contour representing the second feature. It may be the case that they match or they match at a certain rate.

  In addition, the movement determination unit 316 includes an image estimated to have captured the same person as the frame image included in the entrance ticket user watch list WL in both of the images captured by the on / off monitoring cameras CAMa and CAMb. If not, it is determined that the user using the admission ticket has not moved by the train T.

  In addition, the movement determination unit 316 is configured to capture an image estimated to have captured the same person as the frame image included in the entrance ticket user watch list WL by the on / off monitoring cameras CAMa and CAMb when getting on the train T. The user using the admission ticket is moving by the train T if it is included in the captured image and is also included in the images captured by the on / off cameras CAMa and CAMb when getting on the train T when getting off the train T It is determined that there is not.

  FIG. 10 is a sequence diagram showing an example of a process flow of the ticket inspection system 1 in the embodiment.

  First, the automatic ticket gate 100 reads ticket information from the ticket TIX while imaging the user with the camera 118 (138) (step S100). Next, the automatic ticket gate 100 transmits the moving image captured by the camera 118 (138) and the ticket information read from the ticket TIX to the station server device 200 (step S102).

  Next, the station server device 200 selects a frame image based on the moving image and the ticket information received from the automatic ticket gate 100, and generates an admission ticket user watch list WL (step S104). Next, the station server device 200 transmits the generated admission ticket user watch list WL to the vehicle server device 300 (step S106).

  Next, the vehicle server device 300 extracts the second feature from the image of the user captured by the getting on / off surveillance cameras CAMa and CAMb, and the first feature from the frame image included in the entrance ticket user watch list WL Are extracted (step S108). Next, when the first feature and the second feature match, the vehicle server device 300 has the same person as the user of the frame image whose image having the second feature is included in the admission ticket user watch list WL. Of the same person, whether or not it is included in the image taken when getting on the train T, or included in the image taken when getting on the train T It is determined whether the user using the admission ticket is moving by the train T depending on whether it is included in the image captured at the time of getting off the train T (step S110).

  Next, when the user who used the admission ticket is moving by the train T, the vehicle server device 300 indicates that the user who used the admission ticket is getting on the train T illegally (hereinafter referred to as The unfair boarding information is transmitted to the crew terminal 400 (step S112). The crew terminal 400 is, for example, a terminal operated by a crew member such as a conductor, and displays an image based on the information output by the vehicle server device 300. The crew terminal 400 includes, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence) display. The crew terminal 400 displays an image based on the unauthorized boarding information transmitted by the vehicle server device 300 (step S114). As a result, the crew operating the crew terminal 400 can recognize that there is a user who is illegally riding in the train T.

  Hereinafter, the flow of processing of each device of the ticket inspection system 1 in the embodiment will be described using a flowchart. Drawing 11 is a flow chart which shows an example of a flow of processing of automatic ticket gate 100 in an embodiment.

  First, when the user of the user is detected by the human sensor Sc or the like (step S200), the imaging control unit 154 causes the camera 118 (138) to start imaging (step S202). Next, the reading unit 111 (131) reads ticket information from the ticket TIX inserted into the ticket entry port 116 (136) (step S204). Next, the passage determination unit 156 determines whether to allow the user to pass based on the ticket information read by the reading unit 111 (131) (step S206).

  When the passage permission determination unit 156 does not permit the passage of the user, the upper surface display unit 112 (132), the front display unit 113 (133), and / or the speaker 140 are error information indicating that the ticket TIX can not be used. The output is performed, the doors 114 (115) and 134 (135) are controlled to be closed to prohibit the user from passing, and the inserted ticket TIX is discharged from the ticket inlet 116 (136) (step S208) ).

  On the other hand, when the passage permission determination unit 156 permits the passage of the user, after waiting for a predetermined time to elapse (step S210), the passage permission determination unit 156 controls the reading unit 111 (131) to enter / exit code of the ticket TIX. Information indicating that admission is permitted is written (step S212). The predetermined time is set, for example, to a time sufficient for the camera 118 (138) to image the face of the user who is going to pass the ticket gate. As a result, the user stays within the imaging range (viewing angle FOV) of the camera 118 (138) for a predetermined time, and the camera 118 (138) can capture a plurality of images including the user's face. .

  Next, the passage determination unit 156 controls the doors 114 (115) and 134 (135) to be in the open state to allow the user to pass, and discharges the ticket TIX from the ticket outlet 117 (137). (Step S214). Next, the ticket gate side communication unit 152 picks up the ticket information read by the reading unit 111 (131) and the camera 118 (138) by the time the ticket TIX is read by the reading unit 111 (131) The selected moving image is associated with the moving image and transmitted to the station server device 200 (step S216). Next, the imaging control unit 154 causes the camera 118 (138) to end imaging (step S218). By this, the processing of this flowchart ends.

  Hereinafter, the flow of processing of the station server device 200 will be described. Drawing 12 is a flow chart which shows an example of the flow of processing of station server device 200 in an embodiment. The process of this flowchart is started, for example, when the station server device 200 receives ticket information and a moving image from the automatic ticket gate 100.

  First, the image selection unit 214 selects a frame image from the moving image received by the station server side communication unit 212 (step S300). Next, the information management unit 216 associates the frame image selected by the image selection unit 214 with the ticket information received by the station server side communication unit 212, stores it in the station server side storage unit 230, and uses it. Person database DB is constructed (step S302). Next, the information management unit 216 extracts only the data string having the ticket type information indicating the entrance ticket from the user database DB, and generates the entrance ticket user watch list WL (step S304).

  Next, the station server side communication unit 212 refers to the timetable information TTB stored in advance in the station server side storage unit 230, and uses the admission ticket user watch list WL generated by the information management unit 216 as an admission ticket. It transmits to the vehicle server apparatus 300 mounted in the train T which the user who used can ride in (step S306).

  FIG. 13 is a diagram for explaining a transmission method of the entrance ticket user watch list WL. For example, when an admission ticket is used at a time between 14:00 and 15:00 at station B, station server device 200 at station B is scheduled to stop at station B after the time the admission ticket is used. The entrance ticket user watch list WL is transmitted to each of the vehicle server devices 300 of the trains T3 to T5. Thus, when the vehicle server device 300 in each of the trains T3 to T5 stops at the station B, the user using the admission ticket sees the own train T with reference to the admission ticket user watch list WL. It is determined whether or not you are moving at. In the same manner, when an admission ticket is used at another station such as A station or C station, the station server apparatus 200 at another station is scheduled to stop at this station after the time the admission ticket is used. The entrance ticket user watch list WL is transmitted to the vehicle server devices 300 of all the trains T.

  Hereinafter, the flow of processing of the vehicle server device 300 will be described. Drawing 14 is a flow chart which shows an example of the flow of processing of vehicles server device 300 in an embodiment. First, when the admission ticket user watch list WL is received by the vehicle server side communication unit 312 (step S400), the movement determination unit 316 transmits the admission ticket user watch list WL to the station that is scheduled to stop next It is judged whether it stops at the station corresponding to the station server apparatus 200 which has sent (step S402). If the station to be stopped next is a station corresponding to the station server apparatus 200 that has transmitted the entrance ticket user watch list WL, the vehicle server side control unit 310 monitors the getting on and off when stopping at this station Imaging is started on the cameras CAMa and CAMb (step S404). Note that the end timing of imaging by the on / off monitoring cameras CAMa and CAMb may be arbitrarily determined, for example, the timing at which the processing in step S410 or step S416 described below is performed.

  The movement determination unit 316 analyzes the image of the user captured by the on / off monitoring cameras CAMa and CAMb, and determines whether the user shown in the image has got on the train or got off the train. For example, when the feature extraction unit 314 extracts a certain or more features of the user's face from the image captured by the getting-on / off monitoring camera that captures from the front direction the door of the entrance that opens and closes when stopping at the station. The movement determination unit 316 estimates that the user shown in this image is a person who has got on the boarding from the entrance. On the other hand, the feature extraction unit 314 is an image captured by a door that faces the door of the entrance that is opened and closed when stopping at the station, that is, an image captured by When the feature of the user's face is extracted by a certain amount or more, the movement determination unit 316 estimates that the user shown in the image is a person who is going to get off the entrance. In addition, the movement determination unit 316 derives a motion vector (movement amount) such as an optical flow based on the image of the user continuous in time series captured by the boarding surveillance camera CAMa and CAMb and obtains the motion vector from the motion vector. By detecting the moving direction of the user, it may be estimated whether the user is a person who has got on or off the entrance.

  When a certain user gets on the train T, the movement determination unit 316 features the face of the user and the face of the frame image included in the admission ticket user watch list WL received from the station server device 200 at the stop station. It is determined whether or not the features of the above match, and it is determined whether the user who has used the admission ticket has taken the train T (step S406). The movement determination unit 316 determines, for example, the positional relationship between the second features (face feature points and the like) extracted from the images of the getting-on / off surveillance cameras CAMa and CAMb, and the frame images included in the entrance ticket user watch list WL. When the positional relationship of the extracted first feature (facial feature point etc.) matches, the user who got on and the user who used the admission ticket are the same person, that is, using the admission ticket If it is determined that the user has ridden and it does not match, it is determined that the user who has ridden and the user who used the admission ticket are not the same person, that is, it is determined that the user who used the admission ticket is not riding.

  When the user who used the admission ticket is not on board until the stopped train T leaves the station (step S408), the movement judgment unit 316 does not move the user who used the admission ticket by the train T It is determined that the admission ticket user watch list WL received from the station server device 200 at the stop station is erased from the vehicle server storage unit 330 (step S410), and the processing of this flowchart is ended. For example, the movement determination unit 316 may measure the time (period) until the stopped train T departs from the station by referring to the timetable information TTB received from the station server device 200, or in advance Timekeeping may be performed by storing the timetable information TTB in the vehicle server side storage unit 330.

  On the other hand, when the user using the admission ticket gets in, the movement determination unit 316 determines whether the user using the admission ticket has got off until the stopped train T leaves the station (step S412). ). For example, this determination is performed in the same manner as the above-described method of determining whether the user has got on the train T. For example, when a certain user dismounts from the train T, the movement determination unit 316 determines that the dismounted user is identical to the user using the admission ticket when the second feature matches the first feature. It is a person, that is, it is judged that the user who used the admission ticket got off, and when it does not match, the user who got off and the user who used the admission ticket are not the same person, ie, used the admission ticket It is determined that the user continues to get on without getting off.

  If the user who used the admission ticket does not get off until the stopped train T leaves the station (step S414), the user who used the admission ticket is moving in the relevant train T until the movement judgment unit 316 stops the train T which has stopped (step S414) It is determined that (step S416). Next, the movement determination unit 316 sets the face of the user captured in the image captured by the in-vehicle camera including the on / off surveillance cameras CAMa and CAMb or a surveillance camera (not shown) monitoring the interior of the vehicle from above the seat or the like. It is determined whether the feature matches the first feature of the frame image included in the entrance ticket user watch list WL (step S418), and a user using the entrance ticket is searched from inside the car.

  If the feature of the user's face in the image captured by the in-vehicle camera does not match the first feature of the frame image included in the entrance ticket user watch list WL, the movement determination unit 316 performs the above-described step S406. It is determined that the determination by the image processing is incorrect (step S420), the process of step S410 described above is performed, and the process of this flowchart ends.

  On the other hand, when the facial feature of the user captured in the image captured by the in-vehicle camera matches the first feature of the frame image included in the admission ticket user watch list WL, the vehicle server side communication unit 312 Information combining the frame image having the first feature and the position information of the in-vehicle camera is transmitted to the crew terminal 400 as unauthorized boarding information (step S422). As a result, the crew member can confirm to the user who has used the admission ticket whether or not it is an illegal ride. The vehicle server side communication unit 312 may transmit the unauthorized boarding information to the station server device 200 of the station that may stop, referring to the timetable information TTB. In this case, the station server device 200 that has received the illegal boarding information compares the image by the camera 118 (138) mounted on the automatic ticket gate 100 with the frame image included in the illegal boarding information, and uses the admission ticket. It may be controlled to prohibit the passage of the user when the participating user participates outside the station.

  According to the ticket inspection system 1 in the embodiment described above, the information based on the image of the user taken by the camera 118 (138) mounted on the automatic ticket gate 100 and the ticket TIX by the reading unit 111 (131) The information management unit 216 that generates an admission ticket user watch list WL in which the ticket type information is associated with the ticket information that represents the entrance ticket among the ticket information read from and the use of getting on and off the train T On the images taken by the on / off surveillance cameras CAMa and CAMb in the period from the time the train T stops at the station to the time the train leaves the station. A movement determination unit 316 that determines whether the user using the admission ticket is moving on the train T based on the information based on By Rukoto, it is possible to suppress the occurrence of unauthorized ride by the user using the admission ticket.

  Moreover, according to the ticket gate monitoring system 1 in the embodiment, when the user using the entrance ticket is moving by the train T, the user using the ticket TIX is searched from inside the car, and the illegal boarding information is found by the crew By transmitting the information to the crew terminal 400 operated by the crew member, the crew who has confirmed the illegal boarding information can confirm to the user using the entrance ticket whether the illegal boarding is performed or not.

  According to at least one embodiment described above, the information based on the image of the user taken by the camera 118 (138) mounted on the automatic ticket gate 100 and the reading unit 111 (131) read from the ticket TIX An information management unit 216 that generates an admission ticket user watch list WL that associates ticket information in which ticket type information represents an admission ticket among the ticket information, and a user who gets on / off the train T Information based on images taken by the on / off surveillance cameras CAMa and CAMb in a period from when the train T stops at the station to when the train T stops at the station. And a movement determination unit 316 that determines whether the user who has used the admission ticket is moving on the train T. Ri, it is possible to suppress the occurrence of unauthorized ride by the user using the admission ticket.

The above embodiment can be expressed as follows.
An entrance surveillance camera that captures an image of a user entering the station yard,
A reading unit that reads identification information of an admission ticket for identifying the admission ticket from the admission ticket used by the user by a magnetic method;
A generation unit configured to generate correspondence information in which information based on the image of the user captured by the entrance surveillance camera is associated with identification information of the entrance ticket read by the reading unit;
An on-off camera that captures the image of the user who gets on and off the train;
The image estimated to have captured the same person as the image included in the correspondence information generated by the generation unit is included in the image captured at the time of getting on the train, and is captured at the time of getting off the train A movement determination unit that determines that the user using the admission ticket is moving on the train if the image is not included in the image;
Ticket surveillance system equipped with.

  While certain embodiments of the present invention have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the invention. These embodiments can be implemented in other various forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the invention described in the claims and the equivalents thereof as well as included in the scope and the gist of the invention.

DESCRIPTION OF SYMBOLS 1 ... Ticket gate surveillance system, 100 ... Automatic ticket gate, 111, 131 ... Reading part, 118, 138 ... Camera, 150 ... Ticket gate side control part, 152 ... Ticket gate side communication part, 154 ... Imaging control part, 156 ... Pass Availability determination unit 170: ticket gate side storage unit 200: station server device 210: station server side control unit 212: station server side communication unit 214: image selection unit 216: information management unit 230: station server Side storage unit, DB: User database, WL: Admission ticket user watch list, TTB: Timetable information, 300: Vehicle server device, 310: Vehicle server side control unit, 312: Vehicle server side communication unit, 314: Features Extraction part, 316 ... movement judgment part, 330 ... vehicle server side storage part, CAMa, CAMb ... getting on / off surveillance camera, 400 ... crew terminal

Claims (6)

An entrance surveillance camera that captures an image of a user entering the station yard,
A reading unit that reads identification information of an admission ticket for identifying the admission ticket from the admission ticket used by the user;
A generation unit configured to generate correspondence information in which information based on the image of the user captured by the entrance surveillance camera is associated with identification information of the entrance ticket read by the reading unit;
An on-off camera that captures the image of the user who gets on and off the train;
The admission ticket is used based on the correspondence information generated by the generation unit and the information based on the image captured by the getting on / off monitoring camera during the period from when the train stops at the station to when it leaves the station. A movement determination unit that determines whether the user is moving on the train;
Ticket surveillance system equipped with. The movement determination unit
It is determined whether the image picked up by the getting on / off surveillance camera is an image picked up at the time of getting on or an image picked up at the time of getting off.
The image estimated to have captured the same person as the image included in the correspondence information generated by the generation unit is included in the image captured at the time of getting on the train, and the image captured at the time of getting off the train When it is not included in the above, it is determined that the user using the admission ticket is moving on the train,
The ticket inspection system according to claim 1. The getting on and off monitoring camera includes at least one set of cameras for capturing an entrance provided on both sides of the side of the train from inside the train
The movement determination unit is imaged by the boarding and unloading camera based on an imaging direction of the boarding and unloading camera and information on which side of the board is opened and closed at each station. It is determined whether the captured image is an image captured at the time of getting on or an image captured at the time of getting off.
The ticket inspection system according to claim 2. The image processing apparatus further includes a feature extraction unit that extracts the feature of the user's face from the image of the user captured by the entrance surveillance camera or the image of the user captured by the getting-off surveillance camera.
The movement determination unit is a face feature extracted by the feature extraction unit from an image captured by the entrance surveillance camera, and a face feature extracted by the feature extraction unit from an image captured by the on / off surveillance camera. When the feature matches, it is estimated that the image captured by the entrance surveillance camera and the image captured by the boarding surveillance camera are images of the same person.
The ticket inspection system according to claim 2 or claim 3. The movement determining unit may be configured to determine that the image estimated to have captured the same person as the image included in the correspondence information generated by the generation unit is not included in the image captured by the getting on / off monitoring camera. It is determined that the user who used the admission ticket has not moved by the train,
The ticket inspection system according to any one of claims 2 to 4. The movement determination unit is included in the image captured at the time of getting on the train, and the image estimated to have captured the same person as the image included in the correspondence information generated by the generation unit, and to the train It is determined that the user who used the admission ticket has not moved by the train if it is also included in the image captured at the time of getting off the vehicle,
The ticket inspection system according to any one of claims 2 to 5.

Images