TWI782926B - Hands-free and ticketless fare collection system - Google Patents

Abstract

The present invention describes a hands-free or ticketless fare collection system (100, 200) for a entering a designated pay area, such as a mass transit system. Commuters are identified by a face recognition subroutine (144) and commuter identities are additional split up and stored in ID categories according to name, gender, date of birth, race, height, privilege group and so on. Splitting up the commuter identities under different ID categories allow quick and accurate identification of commuters in the commuter ID database (160) and deduction of payment from the commuters account kept in the respective commuter accounts database (170). A commuter may carry a long range RFID card (119b) to allow for even quicker commuter identification.

Description

Hands-free and ticket-free toll collection system

The invention relates to a hands-free and ticketless toll collection system, for example for entering payment areas or restricted areas. In particular, the present invention dispenses with physical tickets and relies on facial recognition of commuters or customers for identification.

Traditional mass transit fare gates rely on commuters carrying stored-value fares. Each ticket includes a near-field electronic chip for short-range, contactless sensing at the reader/writer when entering or exiting a transfer station. The disadvantage of this charge is that the customer must carry a ticket card with sufficient stored value to pass.

Thus, it can be seen that there is a need for another method of using facial recognition to bill commuters or customers in a fast and reliable manner without relying on fares.

The simplified summary presented below provides a basic understanding of the invention. This summary is not an extensive overview of the invention, nor is it intended to identify key features of the invention. Rather, some inventive concepts of the invention are presented in a generic form as a prelude to the description that follows.

The present invention seeks to provide an alternative tolling system, for example, for mass transit for commuters or customers entering and leaving payment areas. The fare system is ticketless, commuters/customers do not have to carry stored-value tickets; this will allow hands-free entry and exit of mass transit systems, buses, stadiums, concert halls, passenger lounges in departure or arrival halls, etc. Wait.

In one embodiment, the present invention provides a novel hands-free, ticketless toll collection system. The hands-free, ticketless toll collection system includes: a server executing software including a facial recognition subroutine; a commuter identification (ID) database and a commuter account database linked to the server; Gates for entering or leaving designated payment areas demarcated by the toll system; and kiosks for registering commuters, where cameras capture portraits of commuters and A recognition subroutine associates the commuter's unique facial features with a customer identity, and the billing system stores the commuter identity in the commuter ID database and the commuter account database such that in Once registered, the commuter may enter or leave designated payment areas without having to carry a stored-value ticket.

In another embodiment, the present invention provides a system or method for billing commuters/customers by: registering commuters, storing portraits of commuters in an ID database, Payment and banking records are stored in a commuter account database and commuters/customers are identified via facial recognition and/or long-range RFID. Preferably, commuter IDs are stored in individual categories such as name, gender, ethnic group race, date of birth, height, authorized group, etc. to allow quick and accurate identification.

Preferably, the server executes a subroutine to insert a greeting to the commuter/customer when the commuter/customer identity is found in the ID database. When a system fault is triggered, the commuter/customer who triggered the system fault is identified by the beam tracer and highlighted on a monitor screen or augmented reality (AR) glasses worn by the controller . Preferably, the display screens on the multi-function kiosks are operable to display an advertisement/information screen and an operation menu screen when the presence of commuters/customers is detected; , when the presence of commuters/customers is not detected within a predetermined range, the advertisement/information screen is dynamically composed of two or more display screens.

10‧‧‧Gateway

100‧‧‧Toll System

110, 110a, 110b, 110c‧‧‧gate

112‧‧‧upright arch

114, 114a, 114b, 114c‧‧‧camera

116, 116a‧‧‧Green light indicator

117, 117a‧‧‧Red light indicator

118, 118a‧‧‧obstacle baffle

119‧‧‧Separation member

119a‧‧‧RF detector

119b‧‧‧RFID media

120‧‧‧Multifunctional Information Station

122‧‧‧Touch screen

122a‧‧‧Large synthetic display screen

122b‧‧‧Additional screen

123‧‧‧Microphone

124‧‧‧Camera

125‧‧‧Coin insertion slot

126‧‧‧Electronic transaction terminal

127‧‧‧Proximity Card Reader

128‧‧‧Receipt printer

128a‧‧‧RFID Media Slot

129‧‧‧Banknote Slot

130a‧‧‧Advertising or information display screen

130b‧‧‧menu screen

131‧‧‧call button

132‧‧‧Speakers

138‧‧‧keyboard

139‧‧‧Tilt panel

140‧‧‧Servers

140a‧‧‧Server

142‧‧‧Software

144‧‧‧Face recognition subroutine

150‧‧‧Workstations

160‧‧‧Commuter ID database

170‧‧‧commuter account database

180‧‧‧Bank

200‧‧‧Gate

210‧‧‧bus

The present invention is illustrated with reference to the accompanying drawings and through non-limiting embodiments of the present invention, wherein: FIG. 1 shows a charging system for public transportation according to an embodiment of the present invention; Arched gates used with the toll system, while Figure 2B shows barrier gates, and Figures 2C and 2D show two barrier-free gates; Figures 3A and 3B show multifunctional grouped information used with the system shown in Figure 1 Figure 4A shows a portrait of a commuter seen by the camera of the toll collection system mentioned above, Figure 4B shows the face used for face recognition; and Figure 5A shows a group of commuters Face recognition, Figure 5B Showing the usage when the passenger is about to board the bus, Figure 5C shows the usage when the passenger is about to get off the bus.

One or more specific and alternative embodiments of the invention will now be set forth with reference to the accompanying drawings. It will be apparent, however, to one skilled in the art that the present invention may be practiced without these specific details. Some details may not be described in detail so as not to obscure the invention. For ease of reference, a common reference number or series of numerals will be used throughout the drawings when referring to the same or like features in the drawings.

FIG. 1 shows a hands-free and ticketless toll collection system 100 according to an embodiment of the present invention. Broadly speaking, the toll collection system 100 includes gates 110, 110a, 110b that separate payment entry areas from public areas (e.g. at transfer stations); in addition, a plurality of multi-function kiosks 120 for registering commuters/customers are located at in public areas. Gates 110 , 110 a , 110 b and kiosk 120 are linked to server 140 via gateway 10 . Servers 140 execute software 142 and are connected to workstations 150 located at all transfer stations; also, some workstations 150 may be located in some backend control rooms. After registration, the commuter's identity is stored in ID database 160 and the commuter account is stored in account database 170 . The commuter account database 170 is also linked via the software 142 to the bank 180 associated with the commuter account. The operation of the fare collection system 100 will become clearer when the components of the system are described below; in this description, commuter, passenger, customer, or customer are used synonymously.

Figure 2A shows a gate 110 according to one embodiment. The gate 110 includes upstanding arches 112 sized for the height and width for the passage of commuters, preferably one at a time. A camera 114 is mounted on the arched top member and is directed to capture a commuter's face, such as the portrait shown in Figure 4A and the face shown in Figure 4B, before the commuter enters through the gate 110. When the gate 110 is configured for two-way access, another camera 114 is mounted on the opposite side of the top member to photograph the faces of commuters exiting through the gate. Gate 110 also includes a pair of green and red light indicators 116 , 117 . The green light indicator 116 is illuminated when a commuter entering or exiting the gate 110 is actively identified and the associated commuter account is time stamped or recorded for calculating the correct fare payment. When a commuter enters or leaves the gate 110, the toll collection system 100 cannot actively identify the identity of the commuter, or when the charge of the correct fare cannot be registered from the account of the commuter, the red light indicator 117 is lit; When illuminated, commuters can retrace and approach the gates again; in the event of a persistent failure, commuters can approach station controllers to manually resolve system failures. In another embodiment, the toll collection system includes a buzzer connected to the red light indicator 117 to give an additional audible warning in case of a toll error.

Figure 2B shows two gates 110a according to another embodiment. Each gate 110a has two snag flaps 118, 118a that are retractable or rotatable into its associated cabinet. Two cameras 114a are suspended above each gate; one camera 114a is directed to photograph the faces of commuters entering the gates 110a, while the other camera is directed to photograph the faces of commuters exiting when the gates 110a are configured for two-way traffic. The face of a commuter at gate 110a. When a commuter's identity is found to match that registered in the ID database 160, the barrier flaps 118, 118a are actuated to retract/rotate and allow the commuter to pass; record the commuter's account during entry, and Debiting money from the commuter's account during exit, such as after completing a trip, and preferably, the green light indicator 116a is illuminated; when the commuter identity cannot be found in the commuter ID database 160, or When a charge or debit is incorrectly recorded in the operator's account, the barrier baffles 118, 118a remain in the blocking position and the red light indicator 117a is illuminated; an additional audible warning can be issued so that commuters can notify station management to correct the charge mistake.

FIG. 2C shows an accessible gate 110b according to another embodiment of the present invention. The barrier-free gate 110b has a pair of partition members 119 and a pair of cameras 114a suspended above the barrier-free gate 110b; preferably, the partition members 119 define separate channels for passing through the barrier-free gate; The passage of 110b can also be defined by markings on the ground. When a commuter enters or exits near the barrier-free gate 110b, one of the pair of cameras 114a detects the commuter and takes a picture of the commuter; 140a, and matched against records in the ID database 160; once the toll collection system 100 actively identifies the commuter, the commuter account is time stamped or recorded into the payment/designation area; preferably, the commuter ID and/or The commuter account is tagged or entered into an entry record in ID database 160 and/or a list of pending deductibles stored in account database 170 . In a similar manner, when a commuter leaves the payment/designation area and comes within range of the camera 114a, a portrait of the commuter is captured and relayed to the servers 140, 140a and compared with the record in the ID database 160 , ID database 160; once the commuter is actively identified, a charge is recorded and debited from the commuter's account. If the toll collection system malfunctions, eg, fails to actively identify commuters, fails to charge or debit commuters' accounts, a red light indicator 117a can be illuminated to notify commuters and station controllers of a system error.

To notify commuters of an error, a tracking beam may be emitted to identify the commuter triggering the system error, for example by shining the tracking beam on or around the commuter. Additionally or alternatively, commuters who trigger system errors are highlighted on monitor screens in the station control room; furthermore, station controllers can be equipped with augmented reality (AR) glasses, and commuters can be spotted by the station controller at any time. Identification/Tracking. Using AR glasses, the commuter ID (such as name), fare amount, admission time, station ID entering the payment/designated area, transaction records, and other relevant information can be provided to the station controller through the AR glasses.

FIG. 2D shows an accessible gate 110c according to a variation of the above-described embodiments. Each accessibility gate 110c has a pair of RF detectors 119a and a pair of cameras 114a suspended above the accessibility gate 110c. The RF detector 119a is built into an associated partition member 119 and is configured as a long-range antenna. Preferably, the size of each RF detector 119a is substantially the height of an adult commuter; and preferably, the long-distance antenna 119a has a detection range of approximately 1-1.5m and is tuned to communicate with each commuter The frequency at which the RFID chip embedded in the commuter RFID media 119b carried by the commuter is interrogated. For example, as shown in Figure 2D, the RFID medium 119b is worn as a wristband. One of the pair of cameras 114a detects the commuter and takes a picture of the commuter as he approaches the barrier-free gate 110c and enters or exits; as the commuter approaches and comes within range of the RF detector 119a , the commuter ID and/or commuter photo are sent to a local workstation 150, such as at a local transfer station. The commuter ID and commuter photo are then forwarded to the server 140, 140a together with the entrance station ID and delivery record, and matched with the record in the ID database 160 or the entry record in the ID database; Commuters are actively identified and commuter accounts are time-stamped or logged for use in calculating the correct fare to be paid when departing from a paid/designated area; additionally or alternatively, a pending list of deductible charges as Subsets are stored in account database 170 . In a similar manner, when a commuter is about to leave the payment/designation area and comes within range of the RF detector 119a, the commuter ID and/or commuter photo are relayed to the ID database, which then Entry records in 160 and/or a list of pending debits and charges in account database 170 are recorded and debited from the commuter's account when the commuter leaves the payment/designated area. In this embodiment, both commuter photos and commuter RFID are used for identification or verification; in this embodiment, the response time of the toll collection system is shortened to roughly less than 1 second, which improves the reliability of ID verification. The commuter RFID is only required for verification when debiting the commuter's account, further adding to the advantages of using this hassle-free tolling system 100 .

Commuters RFID can still be used to identify individual commuters when they are focused on electronics and their faces cannot be captured by the camera 114a or when their faces are partially covered by a hood; an advantage. In the case of commuters whose faces cannot be captured by the camera 114a and who do not carry any commuter RFIDs, these commuters can be identified by directing a tracking beam over the person or by highlighting the commuters on a monitor screen ; the station controller, preferably wearing AR glasses (as described above), can then approach these commuters and allow the toll error to be compensated.

Figure 3A shows a group of multi-purpose kiosks 120 located in a public area (e.g., outside a transfer station). Each kiosk 120 has a touch screen 122 . Above the touchscreen is a camera 124, and below the touchscreen are: a coin insertion slot 125, an electronic transaction terminal with keypad 126; a near field card reader 127; a receipt printer 128; and a bill slot 129. The microphone 123 can also be located near one side of the touch screen, or the directional microphone 123 can be located at the lower part of the kiosk. A speaker 132 is also located at the lower part of the kiosk, while a virtual call button 131 is located on the menu screen 130b on the touch screen 122 . Call button 131 , microphone 123 and speaker 132 allow the customer to communicate with an operator in a call center connected to billing system 100 . In another embodiment, an RFID media slot 128a may be provided; upon successful registration by the commuter, the RFID media slot 128a may dispense the commuter RFID media 119b; the commuter may also self-register remotely, e.g., from home, and A QR code digitally sent to someone's mobile device; using the QR code, commuters come to the kiosk 120 and authenticate their identity before the RFID media 119b is issued; preferably, the authentication process uses Two-factor two-channel authentication, where the first factor is a QR code and the second factor can be a random code generated by an encoder and sent to the commuter's mobile device. These RFID media 119b may be in the form of cards, rings, wristbands, key fobs, credentials, and the like. The positions of the components on the kiosk 120 can be changed according to the design without affecting its function. In one embodiment, when in use, the touch screen 122 can be virtually and dynamically divided into an upper advertisement or information display screen 130a and a lower operation menu screen 130b.

Several kiosks 120 are placed side by side, and the touch screen 122 or any number of adjacent touch screens 122 can be dynamically configured as a large composite display screen 122a, for example for commuting when the camera 124 is not detected within a predetermined distance In the case of an advertisement or to display some public information; the large composite display screen 122a may cover the display screens 122 of two or more kiosks for displaying advertisements or public information. As a commuter approaches a kiosk 120, the camera 124 detects the person and the menu screen 130b appears, while the touch screen 122 of the adjacent kiosk dynamically adjusts to the new composite display size.

At the kiosk 120, the commuter has the option to perform several functions from the menu screen 130b. For example, a commuter can enter a name by entering a name, then select a portrait that has been captured by the camera 124, tap a payment card on a near-field reader, enter a payment card personal identification number (PIN) on an electronic transaction terminal 126, and select Enter your own gender, race, date of birth, height, traffic type, etc. on the screen 130b to identify yourself, and choose to register a new account. Pass categories may include students, national service members, persons with disabilities, seniors, travelers, or workers for special discounts, privileges, or promotions. After enrollment, commuter identities are stored in the commuter ID database 160, and individual records are additionally stored under respective ID categories; individual records are additionally stored under different ID categories, allowing very fast and accurate Commuters are identified in the ID database 160 such that the time required to identify the commuter from the commuter ID database and debit the commuter from the account database 170 is substantially invisible to the commuter. For commuters entering the payment area, a dynamic list of commuters is stored as a subset in the ID database 160, thereby enabling faster identity matching in the ID database; Commuters who are commuters outside or outside the payment zone are dynamically divided into two subsets for faster commuter identification; in this way, the account database 170 dynamically into two subsets.

Commuters can also replenish their account at the kiosk 120 when the amount in the commuter's account is low, by using payment cards, banknotes, or coins, or by using a mobile device via a near-field reader 127 . In another embodiment, commuters can set a predetermined low amount for the toll system 100 to automatically replenish their commuter account.

From the menu screen 130b on the touch screen 122, commuters can also access information about the transportation system (eg, maps) or connect to reservation pages on the Internet. Alternatively, browsing of web pages in the Internet can be provided by configuring an additional screen 122b on the rear side of each kiosk 120, as shown in FIG. Get coins in 125, 129 or maintain parts from the rear of the information station.

As shown in FIG. 1 , the system software 142 is executed on the server 140 . According to the toll collection system 100, the server 140 is in turn connected to a workstation 150 located remotely, for example at all transfer stations. In one embodiment, the server 140 includes a master server and a plurality of slave servers 140a to distribute the computational workload and respond as quickly as commuters enter or leave designated payment areas; The processor 140 performs parallel operations. In another system, the server 140 includes a plurality of slave servers 140a operating trellis operations. The servers 140, 140a may also operate a combination of parallel computing, grid computing, and other forms of distributed computing. The system software 142 includes a facial recognition subroutine 144 . During registration, the face recognition subroutine 144 analyzes the unique characteristics of the commuter's face from the portrait/photograph (shown in FIGS. 4A, 4B ) selected by the commuter during registration; Subroutine 144 is smart enough to distinguish between commuting and wearing glasses. The face recognition subroutine 144 may also analyze the commuter's emotions, such as happiness, sadness, etc.; when used, the face recognition subroutine 144 is configured to , to insert a personalized greeting to each commuter; such a personalized greeting could be "Good morning, sir...", "Come on, sir...", "Smile, sir..." etc. Another feature of this billing system 100 is targeted marketing; for example, when commuters are actively identified, the facial recognition subroutine 144 can be configured with another subroutine to execute appropriate advertisements for commuters; for example, the advertisements can Be gender specific, for people who wear glasses, for kids, etc. In another embodiment, the billing system 100 allows the import of a desired or lost personal database 161 . The wanted/lost personal database 161 can be useful when there is a need to locate and track wanted/lost persons who may be present in the payment area or in public areas outside the payment area.

Still other features make the toll collection system 100 easier to use. The toll collection system 100 may also include subroutines for crowd detection, for example, using cameras at each of the entry/exit gates 110, 110a, 110b. When crowds form at gates 110, 110a, 110b, 110c, the toll system can respond by sending an alert to the station controller at the local transfer station, who then diverts the flow of people to other gates 110, 110a~110c.

The transportation system described above is complex and many system and subsystem errors can occur. For example, a commuter might wear a hat or sunglasses when entering or exiting a gate. Hats or sunglasses can obscure certain facial features of commuters, making identification difficult and causing the system to malfunction. Such malfunctions could be rectified by commuters seeking assistance from a station controller, who could use a camera to take a portrait of the commuter and link the commuter ID to the portrait. Such manually linked commuter IDs may be stored in a separate ID category in the ID database 160 .

Another feature of the face recognition subroutine 144 is the ability to recognize faces in a crowd, as shown in FIG. 5A, using the camera 114b. This feature is useful when using the fare collection system 100 on a bus 210, as shown in FIG. in the crowd). As with the above embodiments, when a passenger identity is not found in the commuter ID database, when an error occurs in recording a charge or debit from the corresponding commuter account, the person is identified on the monitor screen so that system failures can be resolved. In another embodiment, a pair of RF detectors 119a can be deployed at the entry and exit gates of the bus 210 (as shown in FIG. 5C ) to augment the facial recognition, identification, and surveillance described above.

While specific embodiments have been described and illustrated, it should be understood that many changes, modifications, variations, and combinations may be made to the invention without departing from the scope of the invention. For example, gate 110a in FIG. 2B may use additional barcode, QR code, and/or NFC scanners.

10‧‧‧Gateway

100‧‧‧Toll System

110, 110a, 110b‧‧‧gate

114, 114a‧‧‧camera

119‧‧‧Separation member

120‧‧‧Multifunctional Information Station

122‧‧‧Touch screen

124‧‧‧Camera

140‧‧‧Servers

140a‧‧‧Server

142‧‧‧Software

144‧‧‧Face recognition subroutine

150‧‧‧Workstations

160‧‧‧Commuter ID Database

170‧‧‧commuter account database

180‧‧‧Bank

Claims (16)

A hands-free toll collection system comprising: a server executing software including a facial recognition subroutine; a commuter identity (ID) database for storing commuter identities, wherein the stored commuter Commuter identities are categorized into name, gender, ethnicity, date of birth, height, and authorized groups to allow quick and accurate identification, wherein the commuter ID database is linked to the server, wherein the Commuter ID database dynamically split into two subsets based on commuters inside or outside the payment area for faster commuter identification; commuter account database for storing account information for said commuters , wherein the commuter account database is linked to the server, wherein the commuter account database is dynamically divided into two subsets; gates for entering or leaving designated payment areas delineated by the toll collection system; and multi-function information kiosks for registering the commuters, wherein a camera takes a portrait of the commuters, and The facial recognition subroutine associates the commuter's unique facial features with a customer identity, and the billing system stores the commuter identity in the commuter ID database and the commuter account database so that after registration, the commuter may enter or leave the designated payment area without carrying a stored-value ticket. The system described in claim 1 of the patent application, wherein the authorized groups include: children, the elderly, the disabled, students, national service personnel, tourists, and staff. The system as described in item 1 of the scope of the patent application, wherein the facial recognition subroutine is in the Further classifications are made in the commuter ID database described above, the further classifications include a list of people wearing glasses, or a list of wanted or lost persons. In the system described in item 1 of the scope of the patent application, wherein, the server includes a master server and a plurality of slave servers. The system according to claim 4, wherein the master server and the slave server are configured for parallel computing. The system of claim 4, wherein the master server and the slave server are configured for grid computing. The system described in claim 1, further comprising: when the commuter identity is found in the commuter ID database, at the multi-function kiosk, entering the gate, or exiting the gate A subroutine that inserts a greeting to the commuter. The system of claim 1, wherein said gate for entry or exit is barrier-free. A system as claimed in claim 8, wherein the commuter or customer triggering the system failure is identified by a beam tracker, highlighted on a monitor screen, or on an augmented apron worn by the system controller. be highlighted on reality (AR) glasses. The system of claim 8, wherein the gate includes a pair of long-range RF detectors. The system of claim 8, wherein the gates are deployed in passenger lounges of mass transit stations, buses, stadiums, concert halls, or departure or arrival halls. The system described in item 1 of the scope of the patent application, wherein the display of the multifunctional information station The display screen is operable to display an advertisement or information screen and an operation menu screen when the camera detects the presence of the commuter. The system described in item 12 of the scope of the patent application, which has a plurality of multi-functional kiosks, and each multi-functional kiosk is placed side by side with each other, when there is no commuter within the predetermined range, the advertisement or information screen Dynamically composed of two or more display screens. The system described in claim 1 further includes a touch screen and a keyboard, both of which are arranged behind the multifunctional kiosk for the commuters to access the Internet. A method for billing commuters, the method comprising: splitting records of commuter identities and storing the records in a commuter identities database under respective commuter identities categories, wherein, The record of the commuter identity is categorized into name, gender, ethnic group race, date of birth, height, and authorization group to allow quick and accurate identification, wherein the commuter identity database is based on internal or external said commuters are dynamically divided into two subsets for faster commuter identification; storing said commuter identity in said commuter identity database; account information is stored in a commuter account database, wherein the commuter account database is dynamically divided into two subsets based on pending debits or the commuters being outside the payment area; capturing a portrait of the commuter with a camera; and capturing facial features of the commuter using a facial recognition subroutine, and identifying the commuter based on one or more of the commuter identity categories . The method described in claim 15 of the scope of patent application, wherein the facial recognition subroutine Cooperate dynamically with the toll system to establish a list of said commuters who have entered a designated payment area or a list of said commuters whose payment charges are pending.

Images