JP6567369B2 - Ticket gate monitoring system - Google Patents

Description

  Embodiments described herein relate generally to a ticket gate monitoring system.

  2. Description of the Related Art There are known automatic ticket gates that use a magnetic ticket having a magnetic recording surface or a ticket such as an IC card that can read information by communication in a ticket gate at a station. In addition, there is known a ticket that can be used when the user satisfies usage conditions such as an elderly person or a child, and that is used for convenience such as a discount. However, in the conventional technology, there are cases where a user who does not satisfy the use conditions such as an elderly person or a child uses the boarding ticket illegally.

JP 2010-097272 A

  The problem to be solved by the present invention is to provide a ticket gate monitoring system capable of suppressing unauthorized use of a ticket provided with a use condition.

The ticket gate monitoring system according to the embodiment includes a camera, a reading unit, an attribute estimation unit, and an output unit. The camera images a user who is about to pass through the automatic ticket gate. The reading unit is installed in the automatic ticket checker, and reads information indicating the use condition from a boarding ticket provided with the use condition according to the user attribute of the user. The attribute estimation unit estimates the user's personal attribute from the image captured by the camera. The output unit determines whether the user using the boarding ticket satisfies the use condition based on the information indicating the person attribute estimated by the attribute estimation unit and the information indicating the use condition read by the reading unit. Output. In addition, the ticket gate monitoring system according to the embodiment arranges the cameras at a plurality of stations, and the attribute estimation unit generates an image captured by the camera when the user passes from the station premises to the station premises. Based on the output information of the output unit, when the user passes from the station premises to the station premises, the user attribute of the station is estimated from the station premises. The automatic ticket gate for outputting whether or not the vehicle can pass outside the premises is provided.

The figure which shows an example of a structure of the ticket gate monitoring system 1 in 1st Embodiment. The figure which looked at automatic ticket gate 100 in a 1st embodiment from the upper part. The figure which looked at the main machine 110 of the automatic ticket gate 100 of 1st Embodiment from the channel | path side. The figure which shows an example of a function structure of the automatic ticket gate 100 in 1st Embodiment. The figure which shows an example of a function structure of the station server apparatus 200 in 1st Embodiment. The figure which shows an example of user database DB stored in the station server side memory | storage part 230 in 1st Embodiment. The sequence diagram which shows an example of the flow of a process of the ticket gate monitoring system 1 in 1st Embodiment. The flowchart which shows an example of the flow of a process of the automatic ticket gate 100 in 1st Embodiment. The flowchart which shows an example of the flow of a process of the station server apparatus 200 in 1st Embodiment. The figure which shows an example of a structure of the ticket gate monitoring system 1 in 2nd Embodiment. The figure which shows an example of a function structure of the integrated management server apparatus 400 in 2nd Embodiment. The sequence diagram which shows an example of the flow of a process of the ticket gate monitoring system 1 in 2nd Embodiment. The figure which shows an example of a structure of the ticket gate monitoring system 1 in other embodiment. The figure which shows an example of a function structure of 100 A of automatic ticket gates in other embodiment. The sequence diagram which shows an example of the flow of a process of the ticket gate monitoring system 1 in other embodiment.

  Hereinafter, a ticket gate monitoring system according to an embodiment will be described with reference to the drawings.

(First embodiment)
FIG. 1 is a diagram illustrating an example of a configuration of a ticket gate monitoring system 1 according to the first embodiment. The ticket gate monitoring system 1 of the present embodiment is used, for example, to monitor entry / exit at a railway station. The ticket gate monitoring system 1 includes, for example, a plurality of automatic ticket gates 100, station server devices 200-1 to 200-n, and a terminal device 300. In addition to the above-described example, the ticket gate monitoring system 1 may be applied to, for example, a system that monitors boarding (boarding) or getting off (boarding) of a vehicle such as a bus or a ferry.

  For example, a plurality of automatic ticket gates 100 are provided at a ticket gate of a station. As shown in the figure, when there are a plurality of ticket gates at a station, an automatic ticket gate 100 is provided for each ticket gate. The automatic ticket gate 100 restricts entry and exit of the user by reading information from a ticket TIX issued by a ticket machine (not shown). The ticket TIX of the present embodiment is provided with usage conditions according to personal attributes such as the user's age and gender. For example, a user who satisfies the usage conditions can use the ticket TIX at a lower price than the normal fee. Can be purchased. The usage condition is, for example, a condition that the user's age is 60 years old or more, or the user's age is 12 years old or less, as a personal attribute. In addition, the use condition may be, for example, a condition that the sex of the user is female or male as a person attribute. The above-described ticket TIX may be, for example, a magnetic ticket having a magnetic recording surface on the front surface or the back surface of the ticket, a paper ticket printed with a two-dimensional code such as a QR code (registered trademark), or electronic money. It is also possible to use a transportation IC card that can store information such as. Hereinafter, the boarding ticket TIX will be described as a magnetic ticket. For example, the ticket information is recorded on the magnetic recording surface of the ticket TIX. The ticket information includes, for example, a valid period, a boarding station (departure station), a boarding available section, a ticket identification information (ticket ID) for identifying each of the tickets, a boarding time, participation from the station premises, or a station Information such as an entrance / exit code indicating entrance to the premises and the use conditions described above is included.

  The station server device 200 is provided for each station, for example, communicates with the above-described automatic ticket gate 100, the terminal device 300, and the like by wireless or wired, processes information acquired from the automatic ticket gate 100, and obtains information from It transmits to the automatic ticket gate 100, the terminal device 300, etc. The station server device 200 is an example of an information processing device.

  For example, the terminal device 300 is installed at a position where a station clerk (station worker) or the like can visually recognize, and displays an image based on information received from the station server device 200. The terminal device 300 includes, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence) display.

  Hereinafter, the automatic ticket gate 100 and the station server device 200 described above will be described. First, the automatic ticket gate 100 will be described.

  FIG. 2 is a view of the automatic ticket gate 100 according to the first embodiment as viewed from above. The automatic ticket checker 100 includes, for example, a main machine 110 and a slave machine 130 that are opposed to each other across a passage. The main machine 110 includes, for example, a reading unit 111, a top display unit 112, a front display unit 113, doors 114 and 115, a ticket slot 116, a ticket slot 117, a camera 118, and a ticket gate. Side control unit 150. The slave unit 130 includes a reading unit 131, a top display unit 132, a front display unit 133, doors 134 and 135, a ticket slot 136, a ticket slot 137, and a camera 138. Prepare.

  The reading unit 111 of the main machine 110 is, for example, a magnetic ticket reader / writer. The reading unit 111 reads the ticket information recorded on the ticket TIX inserted into the ticket slot 116 by the user who wants to pass in the direction a shown in FIG. It transmits to the control part 150. Further, the reading unit 111 rewrites the ticket information of the ticket TIX based on the information output by the ticket gate side control unit 150 and discharges it from the ticket discharge port 117. The upper surface display unit 112 displays an image based on the result processed by the ticket gate control unit 150 or information received from the station server device 200 when the ticket TIX is inserted into the ticket slot 116. The front display unit 113 displays a mark, a figure, a character, or the like indicating whether or not it can pass in the direction a shown in FIG. The display contents of the front display unit 113 or the presence or absence of display is determined by the ticket gate side control unit 150.

  On the other hand, the reading unit 131 of the slave device 130 is, for example, a magnetic ticket reader / writer. The reading unit 131 reads the ticket information recorded on the ticket TIX inserted into the ticket slot 136 by the user who wants to pass in the direction b shown in FIG. 2, and reads the read ticket information on the ticket gate side. It transmits to the control part 150. Further, the reading unit 131 rewrites the ticket information of the ticket TIX based on the information output by the ticket gate control unit 150 and discharges it from the ticket discharge port 137. The upper surface display unit 132 displays an image based on the result processed by the ticket gate control unit 150 or information received from the station server device 200 when the ticket TIX is inserted into the ticket slot 136. The front display unit 133 displays a mark, a figure, a character, or the like indicating whether or not it can pass in the b direction shown in FIG. The display contents of the front display unit 133 or the presence / absence of display is determined by the ticket gate side control unit 150.

  When the automatic ticket checker 100 is set in the operation mode that allows the user to pass in the direction a shown in FIG. 2, the ticket checker side control unit 150 maintains the doors 115 and 135 in the open state, By controlling the doors 114 (115) and 134 (135) to an open state or a closed state, the passage of the user in the direction a is permitted or prohibited. When the automatic ticket checker 100 is set to the operation mode that permits the user to pass in the direction b shown in FIG. 2, the ticket checker side control unit 150 has doors 114 (115) and 134 (135). Is maintained in the open state, and the doors 115 and 135 are controlled to be in the open state or the closed state, thereby permitting or prohibiting the passage of the user in the b direction.

  In addition, the operation mode of the automatic ticket gate 100 may include an operation mode that permits both passage in the a direction and passage in the b direction shown in FIG. In this case, for example, the ticket gate-side control unit 150 displays a mark, a figure, a character, or the like indicating that passage is permitted on both the front display unit 113 and the front display unit 133 unless the user is passing. I do. In addition, the ticket gate side control unit 150, for example, the user enters from either the a direction or the b direction, and the ticket TIX is inserted into one of the ticket slot 116 and the ticket slot 136. When it is inserted, the opening of the other ticket slot is closed to prohibit the insertion of the ticket TIX, and the display unit (the front display unit 113 or the front display unit 133) on the side where the user has not entered, Control is performed to display marks, figures, characters, etc. indicating that passage is prohibited.

  In FIG. 2, the automatic ticket checker 100 is described as a dedicated ticket for a magnetic ticket in which the ticket information is recorded on the magnetic recording surface. However, the automatic ticket checker 100 further includes a two-dimensional QR code or the like. It may be a device capable of processing a paper ticket on which a code is printed or a traffic IC card capable of storing information such as electronic money. In addition, the automatic ticket gate 100 is not limited to one that allows the user to pass in both directions, and may be configured by a main machine and an auxiliary machine (slave machine) that allows the user to pass only in one direction. Good.

  FIG. 3 is a view of the main unit 110 of the automatic ticket gate 100 according to the first embodiment viewed from the passage side. Main machine 110 further includes transmission photoelectric sensor St and reflection photoelectric sensor Sr in addition to doors 114 and 115 and camera 118 described above. For example, a plurality of transmission photoelectric sensors St (26 in the example of FIG. 3) are provided at equal intervals on the passage side housing surface of the housing surface of the main unit 110. In this embodiment, a pair of a transmissive photoelectric sensor St that functions as a projector and a transmissive photoelectric sensor St that functions as a light receiver are used. For example, when the transmissive photoelectric sensor St provided in the main device 110 is a projector, the transmissive photoelectric sensor St provided on the slave device 130 side functions as a light receiver. The ticket gate-side control unit 150 to be described later specifies the position in the passage where the user is based on the detection signals of the plurality of transmission photoelectric sensors St and the arrangement positions. Similarly to the transmissive photoelectric sensor St, for example, a plurality of reflective photoelectric sensors Sr are formed at equal intervals on the passage side surface of the partition portion protruding upward from the casing of the main unit 110 (in the example of FIG. 3). 3 cases are provided). The reflective photoelectric sensor Sr projects light in a predetermined direction. The reflective photoelectric sensor Sr receives light reflected from the projected direction after projecting light. The reflective photoelectric sensor Sr generates a detection signal indicating whether or not the user's body that reflects the light is present in the passage based on the intensity of the received light. The reflective photoelectric sensor Sr is mainly used to specify the height of the user present in the passage. The ticket gate side control unit 150 to be described later distinguishes whether the user is an adult or a child, for example, according to the height of the user. Although the above-described reflective photoelectric sensor Sr has been described as being provided in the main unit 110, the present invention is not limited to this, and may be provided in the sub unit 130, or may be provided in both the main unit 110 and the sub unit 130. Good.

  The camera 118 includes an image sensor such as a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). For example, the angle of the camera 118 is set so that the face of the user who inserts the ticket TIX into the ticket slot 116 is within the viewing angle FOV. Under the control of the ticket gate side control unit 150, the camera 118 captures an image of a user who is about to insert the ticket TIX into the ticket slot 116 or has inserted the ticket TIX. The camera 118 captures time-series continuous images, that is, moving images, for example, at about 5 to 10 fps (frame per second). The camera 118 outputs the captured moving image (image) to the ticket gate side control unit 150. Note that the camera 138 of the slave unit 130 is set so that the face of the user who inserts the ticket TIX into the ticket slot 136 is within the viewing angle FOV, similarly to the camera 118. As a result, the camera 138 takes an image of a user who is going to or has entered the ticket TIX into the ticket slot 136 under the control of the ticket gate control unit 150. The camera 138 outputs the captured moving image (image) to the ticket gate side control unit 150.

  FIG. 4 is a diagram illustrating an example of a functional configuration of the automatic ticket checker 100 according to the first embodiment. In addition to the configuration shown in FIG. 2, the automatic ticket checker 100 further includes a speaker 140 that outputs sound and a ticket checker side storage unit 170 that stores various information in accordance with instructions from the ticket checker control unit 150. The ticket gate-side control unit 150 includes a ticket gate-side communication unit 152, an imaging control unit 154, and a passability determination unit 156.

  Part or all of the functional units of the ticket gate-side control unit 150 is realized by a processor such as a CPU (Central Processing Unit) executing a program stored in the ticket gate-side storage unit 170. For example, the program may be downloaded from an application server via a network, or a program stored in a portable storage medium such as an SD card may be installed in the automatic ticket checker 100. In addition, part or all of the functional units of the ticket gate-side control unit 150 is realized by hardware such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), and FPGA (Field-Programmable Gate Array). Also good.

  The ticket gate side storage unit 170 includes, for example, a nonvolatile storage medium such as a ROM (Read Only Memory), a flash memory, an HDD (Hard Disk Drive), and an SD card, and a volatile property such as a RAM (Random Access Memory) and a register. And a storage medium. The ticket gate side storage unit 170 stores a program executed by the processor, and stores ticket gate identification information and the like to be described later.

  For example, the ticket gate-side communication unit 152 associates the moving image captured by the camera 118 (138) with the ticket information read from the processing target ticket TIX and transmits it to the station server device 200.

  Further, the ticket gate side communication unit 152 receives the information transmitted by the station server device 200 and outputs this information to the passability determination unit 156.

  The ticket gate-side communication unit 152 receives a detection signal detected by the transmissive photoelectric sensor St or the reflective photoelectric sensor Sr when the user enters or exits the station premises. 200 may be transmitted.

  The imaging control unit 154 causes the camera 118 (138) to start capturing a moving image when the approach of the user can be detected by, for example, the human sensor Sc or the like provided on the casing surface of the main unit 110 or the slave unit 130. . In addition, the imaging control unit 154 performs the camera 118 (according to a series of processes from when the reading process of the boarding ticket TIX by the reading unit 111 (131) is started until the determination process by the passability determination unit 156 is completed. 138) is finished.

  Passability determination unit 156 performs control to permit or prohibit passage of the user based on the ticket information read by reading unit 111 (131). For example, the pass / fail determination unit 156 compares the information such as the valid period, boarding station (departure station), and boardable section included in the ticket information with the fare table, so that the automatic ticket gate 100, which is its own device, Whether the installed station matches the boarding station, whether the station where the automatic ticket gate 100 is installed is in a boarding area, that is, whether the user's boarding area matches the purchase price at the time of the ticket It is determined whether or not the time when the ticket TIX is inserted into the ticket slot 116 (136) is within the valid period, and the user is allowed to pass if all the determination conditions are satisfied. If one or more determination conditions are not satisfied, the passage of the user is prohibited. The passage permission / inhibition determination unit 156 determines whether the passage is permitted or prohibited by the doors 114, 115, 134, 135, the speaker 140, the upper surface display units 112, 132, the front display units 113, 133, or a combination thereof. Control things.

  Further, the pass / fail judgment unit 156 passes the user when the user passes the passage to the position of the prescribed transmission photoelectric sensor St without the ticket TIX being inserted into the ticket slot 116 (136). Is prohibited.

  Hereinafter, the station server apparatus 200 will be described. FIG. 5 is a diagram illustrating an example of a functional configuration of the station server device 200 according to the first embodiment. The station server device 200 includes, for example, a station server side control unit 210 and a station server side storage unit 230.

  The station server side control unit 210 includes, for example, a station server side communication unit 212, an image selection unit 214, a feature extraction unit 216, an attribute estimation unit 218, and a use condition determination unit 220. Some or all of these functional units are realized by a processor such as a CPU executing a program stored in the station server-side storage unit 230. The program may be downloaded from an application server via a network including, for example, a LAN (Local Area Network), a WAN (Wide Area Network), or the like, or stored in a portable storage medium such as an SD card. The server device 200 may be installed. Also, some or all of the functional units of the station server-side control unit 210 may be realized by hardware such as an LSI, an ASIC, and an FPGA.

  The station server-side storage unit 230 is realized by, for example, a nonvolatile storage medium such as a ROM, a flash memory, an HDD, and an SD card, and a volatile storage medium such as a RAM and a register. In addition to storing programs executed by the processor, the station server-side storage unit 230 stores, for example, moving images (time-series data of images) captured by the camera 118 (138), learning data LD and a user database DB described later. Store.

  The station server side communication unit 212 receives information transmitted by the automatic ticket gate 100. Further, the station server side communication unit 212 transmits the processing result of the station server side control unit 210 to the automatic ticket gate 100. Note that the station server side communication unit 212 may transmit the processing result of the station server side control unit 210 to the terminal device 300.

  Based on the processing time of the automatic ticket gate 100, the image selection unit 214 is a frame containing a figure using a ticket TIX when a user enters the station premises from a moving image captured by the camera 118 (138). Select an image. For example, the image selection unit 214 selects an image having a predetermined number of frames that move around in time with the processing time of the automatic ticket checker 100 as the center. Then, the image selection unit 214 selects a frame image containing a figure using the boarding ticket TIX when the user enters from the station premises. Here, the “appearance using the ticket TIX” is, for example, the body above the human chest, and more preferably the head including the user's face. The image selection unit 214 selects a frame image in which the most part (for example, the part having the largest skin area) of the human head is contained by a method such as pattern matching.

  The “processing time of the automatic ticket gate 100” is, for example, the time when the ticket TIX is inserted into the ticket slot 116 (136), or the time when the pass / fail determination unit 156 determines whether or not it can pass. is there. Further, the “processing time of the automatic ticket checker 100” may be a time when a detection signal of the transmission photoelectric sensor St or the reflection photoelectric sensor Sr of the automatic ticket checker 100 is generated.

  The image selection unit 214 associates the ticket information received by the station server side communication unit 212 with the frame image selected by the image selection unit 214 and stores them in the station server side storage unit 320, and stores the ticket TIX. A user database DB for monitoring users to be used is constructed.

  FIG. 6 is a diagram illustrating an example of a user database DB stored in the station server side storage unit 230 according to the first embodiment. In the user database DB, for example, the processing time of the automatic ticket checker, ticket checker identification information (ticket checker ID), use conditions, and frame image are associated with each ticket identification information (ticket ID). Is a set of data strings.

  The feature extraction unit 216 extracts the facial features of the user from the frame image selected by the image selection unit 214. The facial features include, for example, feature points such as ears, nose, mouth, eyes, and facial contours (edges). For example, the feature extraction unit 216 corrects the brightness (luminance) and contrast of the frame image selected by the image selection unit 214, and normalizes the frame image. The feature extraction unit 216 extracts a facial feature by applying a spatial filter such as a Gabor filter to the normalized frame image.

  The attribute estimation unit 218 compares the facial features extracted by the feature extraction unit 216 with the features of the learning data LD, and estimates the personal attributes of the user in the frame image. In the learning data LD, features are extracted in advance from images of a plurality of user faces whose person attributes such as age and gender are known, and the user's sex and This is feature data classified by age. For example, the attribute estimation unit 218 searches the learning data LD, and extracts feature data that matches the positional relationship such as the facial feature points extracted from the frame image by the feature extraction unit 216. Here, “match” may be a case where the positional relationships of feature points, contours, and the like are completely matched, or a case where they are matched at a certain rate. The attribute estimation unit 218 estimates the user's person attribute that appears in the frame image from the user's known person attribute indicated by the feature data extracted from the learning data LD. For example, when the positional relationship of the facial feature points extracted by the feature extraction unit 216 matches the positional relationship of the feature data classified as age teenage, the attribute estimation unit 218 displays the user in the frame image. Is estimated to be a teenager.

  Based on the information indicating the person attribute estimated by the attribute estimation unit 218 and the information indicating the use condition included in the ticket information, the use condition determining unit 220 determines the use condition by the user using the ticket TIX. It is determined whether or not it is satisfied. For example, the use condition determination unit 220 refers to the information stored in the use condition item of the user database DB, and if the person attribute estimated by the attribute estimation unit 218 satisfies this use condition, the boarding ticket TIX. When the user who uses the ticket determines that the use condition is satisfied and the person attribute estimated by the attribute estimation unit 218 does not satisfy the use condition, the user who uses the ticket TIX determines that the use condition is not satisfied. .

  FIG. 7 is a sequence diagram illustrating an example of a process flow of the ticket gate monitoring system 1 according to the first embodiment. The processing shown below may be performed when the user enters the station premises, or may be performed when the user enters outside the station premises.

  First, the automatic ticket gate 100 reads the ticket information from the ticket TIX while imaging the user with the camera 118 (138) (step S100). Next, the automatic ticket gate 100 transmits the moving image captured by the camera 118 (138) and the ticket information read from the ticket TIX to the station server device 200 (step S102).

  Next, the station server device 200 selects a frame image based on the moving image and the ticket information received from the automatic ticket checker 100, and estimates the personal attribute of the user (step S104). Next, the station server device 200 determines whether or not the user using the ticket TIX satisfies the usage condition based on the information indicating the estimated person attribute and the information indicating the usage condition included in the ticket information. Is determined (step S106).

  Next, when the user using the ticket TIX does not satisfy the use conditions, the station server device 200 transmits information indicating that the user is prohibited from passing to the automatic ticket checker 100 (step S108). Hereinafter, the information output by the station server device 200 that prohibits the passage of the user will be referred to as passage prohibition information. The automatic ticket checker 100 receives the passage prohibition information and determines whether or not it can pass (step S110). Thereby, the automatic ticket gate 100 can prohibit the passage of the unauthorized user when a user different from the originally available user illegally uses the ticket TIX.

  On the other hand, when the user using the ticket TIX does not satisfy the use condition, the station server device 200 transmits information indicating the selected frame image to the terminal device 300 (step S112). Receiving this information, the terminal device 300 displays an image based on the frame image (step S114). Thereby, the station staff who operates the terminal device 300 can recognize the user who used the boarding ticket TIX illegally.

  Hereinafter, the processing flow of each device of the ticket gate monitoring system 1 in the first embodiment will be described with reference to flowcharts. FIG. 8 is a flowchart showing an example of the processing flow of the automatic ticket gate 100 in the first embodiment. The process of this flowchart is performed, for example, when the operation mode of the automatic ticket gate 100 is set so as to control the passage of the user who enters the station.

  First, when detecting the approach of the user by the human sensor Sc or the like (step S200), the imaging control unit 154 causes the camera 118 (138) to start imaging (step S202). Note that the imaging stop timing of the camera 118 (138) may be arbitrarily determined, for example, the timing at which the process of step S204 described below is performed. Next, the reading unit 111 (131) reads the ticket information from the ticket TIX inserted into the ticket slot 116 (136) (step S204). Next, the ticket gate side communication unit 152 captures the image with the camera 118 (138) by the ticket information read by the reading unit 111 (131) and the time when the ticket TIX is read by the reading unit 111 (131). The associated moving image is transmitted in association with the station server device 200 (step S206).

  Next, the passage permission determination unit 156 determines whether or not the passage prohibition information has been received by the ticket gate side communication unit 152 (step S208). When the pass prohibition information is received by the ticket gate side communication unit 152, the pass permission determination unit 156 uses the ticket TIX for the upper surface display unit 112 (132), the front display unit 113 (133), and / or the speaker 140. Error information indicating the inability to output is output, the doors 114 (115) and 134 (135) are controlled to be closed to prevent the user from passing, and the inserted ticket TIX is inserted into the ticket input slot 116 (136). (Step S210).

  On the other hand, when the pass prohibition information is not received by the ticket gate side communication unit 152, the pass permission determination unit 156 determines whether or not to allow the user to pass based on the ticket information read by the reading unit 111 (131). Is determined (step S212).

  When permitting the passage of the user, the passability determination unit 156 controls the reading unit 111 (131) to write information indicating that the admission is permitted in the entrance / exit code of the ticket TIX (step S214). Next, the pass / fail determination unit 156 controls the doors 114 (115) and 134 (135) to be opened to allow the user to pass through, and discharges the ticket TIX from the ticket discharge port 117 (137). (Step S216). Thereby, the process of this flowchart is complete | finished.

  On the other hand, when the passage permission determination unit 156 does not permit the passage of the user, the processing of step S210 described above is performed, and the processing of this flowchart is ended.

  In addition, although the process of this flowchart demonstrated as what is performed when the operation mode of the automatic ticket gate 100 is set so that the passage of the user who enters a station premises may be controlled, it is not restricted to this. For example, the processing of this flowchart may be performed when the operation mode of the automatic ticket checker 100 is set to control the passage of a user who goes out of the station. In this case, in the processing of step S214 and step S216 described above, the passability determination unit 156, when allowing the user to pass, collects the ticket TIX inserted into the ticket slot 116 (136) (not shown). The doors 114 (115) and 134 (135) are controlled to be opened to allow the user to pass therethrough.

  Hereinafter, the flow of processing of the station server device 200 will be described. FIG. 9 is a flowchart illustrating an example of a process flow of the station server device 200 according to the first embodiment. The process of this flowchart is started, for example, when the station server apparatus 200 receives the ticket information and the moving image from the automatic ticket gate 100.

  First, the image selection unit 214 selects a frame image from the moving image received by the station server side communication unit 212 (step S300). Next, the image selection unit 214 stores the selected frame image and the ticket information received by the station server side communication unit 212 in association with each other in the station server side storage unit 230, and constructs a user database DB. (Step S302). Next, the feature extraction unit 216 extracts the facial features of the user from the frame image selected by the image selection unit 214 (step S304).

  Next, the attribute estimation unit 218 compares the facial features extracted by the feature extraction unit 216 with the features of the learning data LD, and estimates the user's personal attributes that appear in the frame image (step S306). Next, the use condition determination unit 220 compares the user attribute of the user estimated by the attribute estimation unit with the use condition included in the ticket information, and the user using the ticket TIX sets the use condition. It is determined whether or not it is satisfied (step S308). When the user using the ticket TIX satisfies the use condition, the station server side control unit 210 ends the process of this flowchart.

  On the other hand, if the user using the ticket TIX does not satisfy the usage conditions, the station server side communication unit 212 transmits the passage prohibition information to the ticket gate information and the automatic ticket gate 100 that receives the moving image (step S310). ). Next, the station server side communication unit 212 transmits information indicating the frame image selected by the image selection unit 214 to the terminal device 300 (step S312). The station server side communication unit 212 may transmit the passage prohibition information to the terminal device 300. Thereby, the process of this flowchart is complete | finished.

  According to the ticket gate monitoring system 1 in the first embodiment described above, the camera 118 (138) that captures an image of a user who is about to pass through the automatic ticket gate 100 and the user's person are installed in the automatic ticket gate 100. From the ticket 111 (131) that reads the ticket information including information indicating the use condition from the ticket TIX provided with the use condition according to the attribute, and the image captured by the camera 118 (138), the user's An attribute estimation unit 218 for estimating a person attribute; information indicating a person attribute estimated by the attribute estimation unit 218; and information indicating a use condition included in the ticket information read by the reading unit 111 (131). And a use condition determination unit 220 that determines whether or not the user using the ticket TIX satisfies the use condition, it is possible to use the originally usable benefit. If the person with a different user has illegally use the ticket TIX, it is possible to prohibit the passage of this unauthorized user. As a result, the ticket gate monitoring system 1 can suppress unauthorized use of the boarding ticket TIX provided with usage restrictions.

  In addition, according to the ticket gate monitoring system 1 in the first embodiment, the person attribute is estimated from an image obtained by capturing the user using the ticket TIX, and if the estimated person attribute does not satisfy the use condition, By transmitting an image of a user who has used the ticket TIX to the terminal device 300, the station staff operating the terminal device 300 can recognize the user who has illegally used the boarding ticket TIX.

(Second Embodiment)
Hereinafter, the ticket gate monitoring system 1 according to the second embodiment will be described. The ticket gate monitoring system 1 according to the second embodiment is different from the ticket gate monitoring system 1 according to the first embodiment in that a part of the processing of the plurality of station server devices 200 is concentrated in one device. . Therefore, it demonstrates centering on such a difference and the description about a common part is abbreviate | omitted.

  FIG. 10 is a diagram illustrating an example of a configuration of the ticket gate monitoring system 1 according to the second embodiment. The ticket gate monitoring system 1 according to the second embodiment further includes an integrated management server device 400 in addition to the configurations of the plurality of automatic ticket gates 100, the station server devices 200-1 to 200-n, and the terminal device 300 described above. The integrated management server device 400 communicates with each of the station server devices 200-1 to 200-n provided for each station via a network NW including a LAN, a WAN, and the like, and the station server devices 200-1 to 200-200. A part of the processing performed by each of −n is concentrated. Hereinafter, when the station server apparatuses 200-1 to 200-n are not particularly distinguished, the station server apparatuses 200-1 to 200-n are simply referred to as the station server apparatus 200 in the same manner as the above-described embodiment.

  FIG. 11 is a diagram illustrating an example of a functional configuration of the integrated management server device 400 according to the second embodiment. For example, the integrated management server device 400 includes a management server side control unit 410 and a management server side storage unit 430. The management server side control unit 410 includes, for example, a management server side communication unit 412, a feature extraction unit 414, an attribute estimation unit 416, and a use condition determination unit 418. Part or all of the functional units of the management server-side control unit 410 is realized by a processor such as a CPU executing a program stored in the management server-side storage unit 430. For example, the program may be downloaded from an application server via a network, or a program stored in a portable storage medium such as an SD card may be installed in the integrated management server device 400. Also, some or all of the functional units of the management server side control unit 410 may be realized by hardware such as an LSI, an ASIC, and an FPGA.

  The management server side storage unit 430 is realized by, for example, a non-volatile storage medium such as a ROM, flash memory, HDD, or SD card, and a volatile storage medium such as a RAM or a register. The management server side storage unit 430 stores the program executed by the processor, as well as the learning data LD and the user database DB described above.

  The management server side communication part 412 communicates with each station server apparatus 200 via the network NW, and receives the information transmitted by each station server apparatus 200. Also, the management server side communication unit 412 transmits the processing result of the management server side control unit 410 to each station server device 200. Each of the functional units of the management server side communication unit 412, the feature extraction unit 414, the attribute estimation unit 416, and the use condition determination unit 418 includes the feature extraction unit 216 of the station server device 200 in the first embodiment, Since it corresponds to the estimation unit 218, the use condition determination unit 220, and the station server side storage unit 230, description thereof is omitted.

  FIG. 12 is a sequence diagram illustrating an example of a processing flow of the ticket gate monitoring system 1 according to the second embodiment. First, the automatic ticket gate 100 reads the ticket information from the ticket TIX while imaging the user with the camera 118 (138) (step S400). Next, the automatic ticket gate 100 transmits the moving image captured by the camera 118 (138) and the ticket information read from the ticket TIX to the station server device 200 (step S402).

  Next, the image selection unit 214 of the station server device 200 selects a frame image based on the moving image and the ticket information received from the automatic ticket gate 100 (step S404). Next, the station server side communication unit 212 of the station server device 200 transmits the frame image selected by the image selection unit 214 and the ticket information in association with each other to the integrated management server device 400 (step S406).

  Next, the feature extraction unit 414 of the integrated management server device 400 extracts the facial features of the user from the frame image received from the station server device 200, and the attribute estimation unit 416 is extracted by the feature extraction unit 414. The feature of the user's face is compared with the learning data LD stored in the management server-side storage unit 430 to estimate the user's personal attribute (step S408). Next, the use condition determining unit 418 of the integrated management server device 400 uses the ticket TIX based on the information indicating the person attribute estimated by the attribute estimating unit 416 and the information indicating the use condition included in the ticket information. It is determined whether or not the user who uses the function satisfies the use condition (step S410).

  Next, the management server side communication unit 412 of the integrated management server device 400 sends the passage prohibition information and the information indicating the frame image to the station server device 200 when the user using the ticket TIX does not satisfy the use conditions. Transmit (step S412). The station server device 200 transmits the passage prohibition information received from the integrated management server device 400 to the automatic ticket gate 100 (step S414). The automatic ticket checker 100 that has received the passage prohibition information from the station server device 200 performs control for prohibiting the passage of the user (step S416). As a result, as in the first embodiment, the automatic ticket gate 100 prohibits the passage of an unauthorized user when a user different from the originally available user illegally uses the ticket TIX. Can do.

  The station server device 200 transmits information indicating the frame image received from the integrated management server device 400 to the terminal device 300 (step S418). The terminal device 300 that has received the information indicating the frame image from the station server device 200 displays an image based on the frame image (step S420).

  In addition, the use condition determination unit 418 of the integrated management server device 400 determines that among the frame images received from the plurality of station server devices 200, the frame images determined that the user using the boarding ticket TIX does not satisfy the use conditions. Are compared to determine whether or not the same user repeats unauthorized use (step S422). For example, when the same user repeats unauthorized use, the management server side communication unit 412 of the integrated management server apparatus 400 repeatedly performs unauthorized use to the station server apparatus 200 at a station where the unauthorized use is repeatedly performed. The warning information indicating that it is being performed and the information indicating the frame image in which this unauthorized user is captured are transmitted (step S424). In response, the station server device 200 transmits the warning information received from the integrated management server device 400 and information indicating the frame image to the terminal device 300 (step S426). The terminal device 300 displays an image based on the warning information and information indicating the frame image (step S428). As a result, the station staff can recognize a user who repeats unauthorized use.

Hereinafter, other embodiments (modifications) will be described.
FIG. 13 is a diagram illustrating another example of the configuration of the ticket gate monitoring system 1 in the above-described embodiment. The ticket gate monitoring system 1 includes a monitoring camera 500 in addition to a configuration including a plurality of automatic ticket gates 100, a station server device 200, and a terminal device 300, for example, as in the above-described embodiment. The surveillance camera 500 is provided for each ticket gate, for example, like the plurality of automatic ticket gates 100 described above, and is fixed to the ceiling or wall surface of the station. The surveillance camera 500 images a user who enters the station, a user who enters from the station, or a user who exists in the station. The monitoring camera 500 transmits the captured moving image (or image) to the station server device 200. Thereby, the station server apparatus 200 can estimate a user's personal attribute from the moving image of the monitoring camera 500, similarly to using the moving image imaged by the camera 118 (138) of the automatic ticket gate 100.

  Further, when a user who has illegally used the ticket TIX has already passed through the automatic ticket gate 100, the station server device 200 captures an image from the video of the monitoring camera 500 by the camera 118 (138) of the automatic ticket gate 100. A frame image having a feature that matches the feature of the selected frame image is searched from the selected moving image. As a result, the station server device 200 can determine which of the station premises from the installation position and the viewing angle of the monitoring camera 500 even when a user who has illegally used the ticket TIX has already passed the automatic ticket gate 100. It is possible to specify whether there is a user at the place.

  In the ticket gate monitoring system 1 in the above-described embodiment, the station server device 200 may be omitted. In this case, the automatic ticket gate 100 further includes a configuration included in the station server device 200. Hereinafter, description will be made assuming that the automatic ticket gate having the functional configuration of the station server apparatus 200 is denoted by 100A. FIG. 14 is a diagram illustrating an example of a functional configuration of an automatic ticket checker 100A according to another embodiment. As illustrated, the ticket gate side control unit 150A of the automatic ticket gate 100A includes an image selection unit 158, a feature extraction unit, in addition to the ticket gate side communication unit 152, the imaging control unit 154, and the pass / fail determination unit 156 described above. 160, an attribute estimation unit 162, and a use condition determination unit 164. In addition to the fare table, the ticket gate storage unit 170A of the automatic ticket gate 100A further stores learning data LD and a user database DB. Thereby, the automatic ticket gate 100 can suppress the illegal use of the boarding ticket TIX provided with the use restriction as in the above-described embodiment.

  Further, based on the image captured by the camera 118 (138) when the user passes from the station premises to the station premises, the feature extraction unit 216, the attribute estimation unit 218, and the use condition determination unit 220 respectively perform processing. If the usage conditions are not satisfied, the automatic ticket gate 100 of the participating station may prohibit the user from passing through the station premises. In this case, the station server device 200 or the integrated management server device 400 broadcasts, for example, the ticket identification information of the ticket TIX used by the user who has determined that the usage conditions are not satisfied, to the station server device 200 of another station. . Further, the station server device 200 or the integrated management server device 400 may transmit information related to the destination station estimated from the contents of the ticket TIX. Upon receiving this information, the automatic ticket checker 100 at the station acquires the ticket identification information from the station server device 200 of the own station, and prohibits entry when the ticket TIX having the ticket identification information is used. Thereby, even when image processing takes time, unauthorized use of the ticket TIX provided with the use restriction can be suppressed.

  FIG. 15 is a sequence diagram illustrating an example of a flow of processing executed when the above processing is performed. First, the automatic ticket gate 100A installed at the station A reads the ticket information and performs imaging by the camera 118 (138) (step S500). The automatic ticket checker 100A transmits these pieces of information to the station server device 200A at the station A (step S502). In the station server device 200A, the feature extraction unit 216, the attribute estimation unit 218, and the use condition determination unit 220 each perform processing (step S504). When it is determined that the use condition is not satisfied, the station server device 200A transmits the ticket information including the ticket identification information to the station server device 200B at the B station (step S506). The station server device 200B transfers this to the automatic ticket gate 100B at station B (step S508). The automatic ticket checker 100B retains the ticket identification information therein, and prohibits passage when the ticket TIX having the same ticket identification information is used (step S510).

  According to at least one embodiment described above, a camera 118 (138) that captures an image of a user who is about to pass through the automatic ticket gate 100, and a usage that is installed in the automatic ticket gate 100 and that corresponds to the personal attribute of the user. A person attribute of the user is estimated from an image captured by a reading unit 111 (131) that reads information on a ticket including information indicating a use condition from a ticket TIX provided with a condition, and a camera 118 (138). On the basis of the attribute estimation unit 218, information indicating the person attribute estimated by the attribute estimation unit 218, and information indicating the use conditions included in the ticket information read by the reading unit 111 (131) By using a use condition determination unit 220 that determines whether or not a user using TIX satisfies the use condition, the use is different from the originally available user There can be in the case of unauthorized use of the ticket TIX, to prohibit the passage of this unauthorized user. As a result, the ticket gate monitoring system 1 can suppress unauthorized use of the boarding ticket TIX provided with usage restrictions.

The above embodiment can be expressed as follows.
A camera that captures an image of a user attempting to pass through an automatic ticket gate,
A reading unit that is installed in the automatic ticket gate and reads information indicating the use conditions from a ticket provided with use conditions according to the age of the user;
An attribute estimation unit that estimates the age of the user from an image captured by the camera;
Based on the information indicating the age estimated by the attribute estimating unit and the information indicating the use condition read by the reading unit, whether or not the user using the ticket satisfies the use condition is determined. A use condition determining unit for determining;
A ticket gate monitoring system comprising:

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 ... Ticket gate monitoring system, 100 ... Automatic ticket gate, 111, 131 ... Reading part, 118, 138 ... Camera, 150 ... Ticket gate side control part, 152 ... Ticket gate side communication part, 154 ... Imaging control part, 156 ... Passing Acceptability determination unit, 170 ... ticket gate side storage unit, 200 ... station server device, 210 ... station server side control unit, 212 ... station server side communication unit, 214 ... image selection unit, 216 ... feature extraction unit, 218 ... attribute estimation , 220 ... usage condition determination unit, 230 ... station server side storage unit, LD ... learning data, DB ... user database, TIX ... boarding ticket

Claims (7)

A camera that captures an image of a user attempting to pass through an automatic ticket gate,
A reading unit that is installed in the automatic ticket checker and reads information indicating the use conditions from a ticket provided with use conditions according to the user's personal attributes;
An attribute estimation unit that estimates a person attribute of the user from an image captured by the camera;
Whether or not the user using the ticket satisfies the usage condition based on the information indicating the person attribute estimated by the attribute estimation unit and the information indicating the usage condition read by the reading unit An output unit for outputting
With
The cameras are arranged at a plurality of stations,
The attribute estimation unit estimates the user attribute of the user based on an image captured by the camera when the user passes from outside the station to the station premises,
The automatic ticket gate that outputs whether or not the user can pass from the station premises to the station premises according to the output information of the output unit when the user passes from the station premises to the station premises to a plurality of stations. Equipped with a machine,
Ticket gate monitoring system. In accordance with the output information of the output unit, further comprising the automatic ticket gate that outputs whether or not to pass from the station premises to the station premises,
The ticket gate monitoring system according to claim 1. A feature extraction unit for extracting features of the user's face from an image captured by the camera;
The attribute estimation unit estimates the user's personal attributes from the facial features of the user extracted by the feature extraction unit;
The ticket gate monitoring system according to claim 1 or 2 . The reading unit reads information indicating the use condition from a ticket provided with a use condition according to the age of the user,
The attribute estimation unit estimates the age of the user as the person attribute from information based on an image captured by the camera,
The output unit is based on the information indicating the age of the user estimated by the attribute estimation unit and the information indicating the use condition read by the reading unit. Output whether age meets the usage condition,
The ticket gate monitoring system according to any one of claims 1 to 3 . It is installed at a position where a station staff can visually recognize, and further comprises a display section for displaying an image based on output information of the output section ,
The ticket gate monitoring system according to any one of claims 1 to 4 . An automatic ticket gate installed at a plurality of stations, and an information processing device capable of communicating with the automatic ticket gates installed at the plurality of stations,
The automatic ticket gate includes the camera and the reading unit,
The information processing apparatus includes the attribute estimation unit and the output unit .
The ticket gate monitoring system according to any one of claims 1 to 5 . Automatic ticket gates installed at a plurality of stations include the camera, the reading unit, the attribute estimation unit, and the output unit ,
The ticket gate monitoring system according to any one of claims 1 to 5 .

Images