JP5940331B2 - Ticket gate system, automatic ticket gate device and portable terminal device - Google Patents

Description

  Embodiments described herein relate generally to a ticket gate system, an automatic ticket gate device and a mobile terminal device used in the ticket gate system.

  Recently, for example, in a railway organization or an airport organization, a ticket gate process is performed by placing a non-contact type IC card possessed by a user or a portable telephone with a built-in non-contact type IC card function over a reading unit of an automatic ticket gate device. A ticket gate system has been developed and is actually in operation.

  However, the conventional ticket gate system requires a user's manual operation such as inserting a magnetic ticket or placing an IC card or a portable telephone on the reading unit of the automatic ticket gate.

  In addition, in order to prevent unauthorized users who do not have an IC card or a portable telephone from passing through, an open / close door is provided for each automatic ticket gate device, but this is a very inconvenient for users. But there is.

  Furthermore, IC cards and portable telephones that are used are not widely used outside Japan. For example, foreign tourists need to purchase IC cards and portable telephones only for travel. There is a problem.

JP 2010-97272 A

  The problem to be solved by the present invention is to provide a ticket gate system, an automatic ticket gate device, and a mobile terminal device which can use the automatic ticket gate device without using a hand, and the convenience is remarkably improved.

  The ticket gate system according to the embodiment includes a storage unit that stores identification information unique to a user and a face image of the user in association with each other, and a portable terminal device possessed by the user and having a wireless communication function includes a ticket gate. When entering the area, the first means for acquiring the user-specific identification information stored in advance in the mobile terminal device by wireless communication, the second means for capturing an image near the ticket gate area, Third means for acquiring a face image of a user who has crossed a boundary line for intention confirmation of user entry / exit preset in the ticket gate area, based on an image captured by the second means; A fourth means for acquiring a face image having identification information corresponding to the identification information acquired by the first means from the storage means; and a face image acquired by the third means by the fourth means. The A fifth means for determining whether or not the face image matches, and when the fifth means determines that the both face images match, the user sets the boundary line to either the entry side or the entry side. A sixth means for determining whether the user has moved in the direction of the user, and a seventh means for performing an entrance process for the user when the sixth means determines that the user has moved the boundary line to the entrance side. And an eighth means for performing an entry process for the user when it is determined by the sixth means that the user has moved the boundary line to the entry side.

The schematic diagram which shows schematically the structure of the ticket gate system which concerns on embodiment. The block diagram which shows roughly the structure of the portable terminal device which concerns on embodiment. The block diagram which shows roughly the structure of the automatic ticket vending machine which concerns on embodiment. The block diagram which shows roughly the structure of the automatic ticket gate which concerns on embodiment. The flowchart explaining user registration performed in advance according to the first embodiment. The flowchart explaining remaining charge and regular section purchase of SF card concerning a 1st embodiment. The flowchart explaining the entrance / exit processing which concerns on 1st Embodiment. The flowchart explaining the unauthorized user detection process which concerns on 1st Embodiment. The flowchart explaining the self-reporting process at the time of the face recognition impossibility which concerns on 1st Embodiment. The flowchart explaining the user registration performed in advance which concerns on 2nd Embodiment. The flowchart explaining the remaining amount charge of SF card and periodical section purchase which concern on 2nd Embodiment. The flowchart explaining the entrance / exit processing which concerns on 2nd Embodiment. The flowchart explaining the self-reporting process at the time of the face recognition impossibility which concerns on 2nd Embodiment.

Hereinafter, a ticket gate system according to an embodiment will be described with reference to the drawings.
In the following explanation, a case where the present invention is applied to a ticket gate system that performs a ticket gate process in a railway organization will be described. However, the present invention is not limited to this. For example, a ticket gate that performs a ticket gate process at a boarding gate or an arrival gate of an airport. The same applies to the system.

  FIG. 1 schematically shows the configuration of a ticket gate system according to this embodiment. This ticket gate system performs ticket gate processing using, for example, a mobile terminal device possessed by a user in a railway organization, and is possessed by a user M and has a mobile phone function and a medium-distance wireless communication function (for example, wireless LAN communication). A mobile terminal device (for example, a smartphone, a mobile phone, etc.) 11 having a function), a mid-range wireless communication function (for example, a wireless LAN communication function), and a user having a boarding ticket (for example, an admission ticket, a wireless IC card) Commuter pass, ordinary ticket, toll ticket, limited express ticket, SF card made up of wireless IC card, etc.), information on purchased commuter pass or purchased SF card information to portable terminal device 11 An automatic ticket vending machine 12 that downloads or charges the mobile terminal device 11 with the amount of money in the SF card information; Automatic ticket gate 13 having a wireless LAN communication function and performing middle-distance wireless communication with the mobile terminal device 11, and ticket ticket management (online ticket sales, reservation sales, automatic And a host device (center server) 14 that performs various types of information processing and the like.

  The mobile terminal device 11 communicates with the host device 13 via the wireless public line 10 to download an application for using the ticket gate system (hereinafter referred to as a ticket gate application) or the like. Tickets can be reserved and purchased.

  The automatic ticket vending machine 12 communicates with the host device 14 via the communication line 15, thereby transmitting the ticket information of the sold ticket to the host device 14 or wirelessly connecting with the mobile terminal device 11. By performing communication by communication, the ticket information (commuter pass information, SF card information, etc.) of the sold ticket is transmitted to the mobile terminal device 11.

The automatic ticket gate device 13 determines whether admission is possible by performing communication with the mobile terminal device 11 by mid-range wireless communication, or by communicating with the host device 14 via the communication line 16. Judgment of whether to participate or not.
The automatic ticket gate 13 includes a camera 17 as an image pickup unit that captures an image in the vicinity of the ticket gate area, an antenna unit 18 for medium-range wireless communication, and a control unit 19 that performs various processes. Are arranged as follows.

That is, a ticket gate area 53 having a predetermined area is formed between the walls 51 and 52 at a ticket gate of a station in a railway organization, and this ticket gate area 53 serves as a boundary line for confirming the intention of entering and leaving the user. It is assumed that a local / external boundary line 54 is provided. Here, the inside of the on-premise / outer boundary line 54 (upper side of the drawing) is inside the station, and the outside of the on-premise / outer boundary line 54 (lower side of the drawing) is outside the station.
It is assumed that the inside / outside boundary line 54 is displayed with, for example, a paint of a color that can be seen on the floor surface.

The camera 17 is installed, for example, on the ceiling or wall surface of the ticket gate area 53 so as to capture an image in the vicinity of the ticket gate area 53 including at least the face of the user who passes through the ticket gate area 53.
The antenna unit 18 is installed on, for example, a ceiling or a wall surface on the inside / outside boundary line 54 and covers a predetermined range (for example, a radius of about 10 m) covering the entire inside / outside boundary line 54 in the ticket gate area 53. The wireless communication area 55 is used.
The control unit 19 is installed in the vicinity of the ticket gate area 53 and is connected to the camera 17 and the antenna unit 18, respectively.

  The host device 14 communicates with the mobile terminal device 11 through a public line to sell tickets online and make reservations, or through the communication line 16 to the automatic ticket gate 13 (control unit 19). ) And the ticket information received from the automatic ticket vending machine 12 and the ticket information of the reserved tickets sold are sent to the automatic ticket gate 13.

The host device 14 includes memories (databases) 14a and 14b. The memory 14a stores the ID number (identification information unique to the user) of the user M currently participating in the medium-range wireless communication. The memory 14b holds (registers) user information (common to all stations) of all registered users. As this registered user information, for example,
・ ID number
・ Address, name, phone number, etc.
・ Face recognition data
・ Ticket information (commuter pass information (periodic section), SF card information (remaining amount, etc.), entry / exit status, etc.)
・ Credit card number (when using credit card)
Etc. are considered.

  FIG. 2 schematically shows the configuration of the mobile terminal device 11. The mobile terminal device 11 is, for example, a multi-function mobile phone called a smartphone, and includes a camera 20, an operation unit 21, a display unit 22, a transmission unit 23, a reception unit 24, a transmission / reception antenna unit 25, a mid-range wireless communication device. A communication unit 26 for communication, a communication unit 27 for mobile phone communication, a memory 28 for storing various types of information, a main control unit 29 that controls these components, and a battery power supply unit 30 that supplies an operating voltage to each unit. Has been.

  The operation unit 21 performs various settings when used as a mobile phone, inputs a telephone number, performs various settings when used as a mobile terminal device, and instructs to change mode settings. is there. The display unit 22 displays various operation guides.

The transmitter 23 is constituted by a microphone or the like, and converts words uttered by the user when used as a mobile phone into voice data and outputs the voice data.
The receiver 24 is constituted by a speaker or the like, reproduces the received audio data supplied from another device, and outputs it from the speaker.

The communication unit 26 for medium distance wireless communication is connected to the antenna unit 25, and when using the ticket gate system, the medium distance wireless communication (wireless LAN communication) with the automatic ticket vending machine 12 and the automatic ticket gate device 13 is performed. To do.
The communication unit 27 for mobile phone communication is connected to the antenna unit 25 and communicates with the host device 14 via the public line 10 when used as a mobile phone.

  The communication units 26 and 27 are controlled by different applications stored in the memory 28 when used as a mobile phone and when using the ticket gate system.

  The memory 28 implements a user ID area 28a in which identification information (ID number) unique to the user carrying the mobile terminal device 11 is stored, a ticket gate application for using this ticket gate system (medium distance wireless communication function). An additional program area 28b for storing a processing program for storing the user information, and a user information area 28c for storing registered user information.

  The ticket gate application stored in the additional program area 28b is downloaded by communicating with the host device 14 via the public line 10.

  FIG. 3 schematically shows the configuration of the automatic ticket vending machine 12. The automatic ticket vending machine 12 communicates with, for example, an operation display unit 31 that performs a purchase operation of a ticket or displays various operation guidance, a ticket sales unit 32 that issues a specified ticket, and a host device 14. An interface 33 that performs communication via the line 15, a transmission / reception antenna unit 34, a communication unit 35 for medium-range wireless communication, an IC card issuing unit 36, and a main control unit 37 that controls these functions as a whole. ing.

The communication unit 35 is connected to the antenna unit 34, and performs medium-range wireless communication (wireless LAN communication) with the mobile terminal device 11 when performing ticket gate processing using the mobile terminal device 11.
The IC card issuing unit 36 issues a commuter pass or SF card made up of a designated wireless IC card.

  FIG. 4 schematically shows the configuration of the control unit 19 of the automatic ticket gate 13. The control unit 19 includes, for example, a display unit 41 that provides various guidance to users, station staff, and the like, a door mechanism unit 42 that drives a door (not shown) that controls opening and closing of the user, and a host device. 14, an interface 43 that communicates with the network 14 via the communication line 16, a communication unit 44 for medium-range wireless communication, and a main control unit 45 that controls these components.

  The communication unit 44 is connected to the antenna unit 18, and performs medium-range wireless communication (wireless LAN communication) with the mobile terminal device 11 when performing ticket gate processing using the mobile terminal device 11. The camera 17 is connected to the main control unit 45.

  The main control unit 45 has a memory 45a that stores (stores) user information of the user M currently participating in the medium-range wireless communication.

  Next, the operation of the ticket gate system according to this embodiment in the above configuration will be described.

  When the user M uses the ticket gate system, for example, the portable terminal device 11 is connected to the host device 14 via the public line 10 so as to use the ticket gate application (medium-distance wireless). It is assumed that a processing program for realizing the communication function, a boarding ticket information processing program, and the like are downloaded to the additional program area 28b of the memory 28.

  First, a case where a face image registered in the host device 14 according to the first embodiment is provided will be described.

  First, user registration performed in advance will be described with reference to a flowchart shown in FIG.

  The user M activates the ticket gate application by operating the portable terminal device 11 possessed, and selects and activates user registration from the menu (step S1).

Next, the user M inputs user information (step S2). As user information to be input at this time, for example,
・ Address, name, age, phone number, etc.
・ Credit card number (when using credit card)
Etc. are considered.

  Next, the user M captures his / her face image by activating the camera 17 (step S3). When the face image capturing is completed, the mobile terminal device 11 attaches the input user information (hereinafter referred to as input user information) and the captured face image to the user registration request, via the public line 10. It transmits to the host device 14 (step S4).

  When the host device 14 receives the user registration request from the mobile terminal device 11 (step S6), the host device 14 acquires the input user information and the face image attached thereto, and the credit settlement server of the credit company via the public line 10 To check whether the user can use credit payment (when using credit payment) and double registration check whether the user is not registered twice (step S7). ).

Next, the host device 14 generates face recognition data (for example, facial feature amount data that can identify the person at a certain level or more) from the face image acquired from the mobile terminal device 11, and the ID unique to the user. A number is generated, and the generated face recognition data, ID number, and input user information acquired from the portable terminal device 11 are stored (registered) in the memory 14b as registered user information (step S8).
Next, the host device 14 attaches the generated ID number to the registration end message and transmits it to the mobile terminal device 11 via the public line 10 (step S9).

  When receiving the registration end message from the host device 14, the portable terminal device 11 stores (registers) the ID number attached thereto in the user ID area 28a of the memory 28 (step S5).

  Next, the remaining charge of the SF card and the regular section purchase will be described with reference to the flowchart shown in FIG.

First, the case of credit use will be described.
In the case of credit use, the user M operates the operation unit 21 of the portable terminal device 11 that he / she owns to select the charge amount and the regular section (step S11), and the credit settlement of the credit company via the public line 10 is performed. Credit communication is performed by communicating with the server (step S12).

  Next, when the credit terminal is completed, the mobile terminal device 11 receives the ID number stored in the user ID area 28a of the memory 28, the charged amount (charge amount), and the purchased periodic section in the charge / periodic section purchase request. Is transmitted to the host device 14 through the public line 10 (step S13).

  When the host device 14 receives the charge / regular section purchase request from the mobile terminal device 11 (step S14), the host device 14 searches the memory 14b for registered user information having an ID number that matches the ID number attached thereto. The remaining amount in the registered user information is added for the amount of charge attached to the charge / periodic interval purchase request, and the periodic interval is saved (step S15).

  Next, the host device 14 transmits a registration end message to the mobile terminal device 11 via the public line 10 (step S16).

Next, the case of using an automatic ticket vending machine will be described.
In the case of using an automatic ticket vending machine, the user M selects a charge amount and a regular section by operating the operation display unit 31 of the automatic ticket vending machine 12 (step S17).
Next, the automatic ticket vending machine 12 acquires the ID number stored in the user ID area 28a of the memory 28 by performing medium-range wireless communication with the mobile terminal device 11 (step S18).

  Next, the user M inserts a necessary amount of cash into the automatic ticket vending machine 12, so that the automatic ticket vending machine 12 receives the ID stored in the user ID area 28 a of the memory 28 in the charge / periodic section purchase request. The number, the charged amount (charge amount), and the purchased regular section are attached and transmitted to the host device 14 via the public line 15 (step S19).

When the host device 14 receives the charge / periodic section purchase request from the automatic ticket vending machine 12 (step S20), the host device 14 searches the memory 14b for registered user information having an ID number that matches the ID number attached thereto. The remaining amount in the registered user information is added for the charge amount attached to the charge / periodic section purchase request and the periodic section is stored (step S21).
Next, the host device 14 transmits a registration end message to the automatic ticket vending machine 12 via the public line 15 (step S22).

  Next, the entrance / exit process will be described with reference to the flowchart shown in FIG.

The control unit 19 of the automatic ticket gate 13 develops mid-range wireless communication from the antenna unit 18 (step S31).
When the user M possessing the mobile terminal device 11 enters the intermediate-range wireless communication area 55 (step S32), the mobile terminal device 11 participates in the intermediate-range wireless communication with the control unit 19 (step S33), and the memory 28 The ID number stored in the user ID area 28a is transmitted to the control unit 19 (step S34).

When receiving the ID number transmitted from the mobile terminal device 11, the control unit 19 transmits the ID number to the host device 14 via the public line 16 (step S36).
When receiving the ID number from the control unit 19 (step S37), the host device 14 stores the ID number in the memory 14a (step S38).

  Next, the control unit 19 activates the camera 17 to capture an image in the vicinity of the inside / outside boundary line 54 in the ticket gate area 53, and extracts and extracts the face image of the user M from the captured image. Data for face recognition (for example, face feature data that can identify the person at a certain level or more) is generated from the face image (step S39).

  Next, the control unit 19 acquires from the generated face recognition data the face recognition data of the user M who has moved beyond the on-premise / outside boundary line 54 and transmits it to the host device 14 via the public line 16. (Step S40). At this time, an image in the vicinity of the premise / external boundary line 54 captured by the camera 17 is also transmitted to the host device 14.

  Upon receiving the face recognition data from the control unit 19 (step S41), the host device 14 searches the memory 14b for registered user information having an ID number that matches the ID number stored in the memory 14a. The face recognition data in the registered user information and the face recognition data from the control unit 19 are collated (step S42), and it is determined whether or not both face recognition data match (step S43).

  If the result of determination in step S43 is that the data for both face recognition does not match, unauthorized user detection processing will be described later in detail (step S44).

  As a result of the determination in step S43, if the two face recognition data match, the user M uses the face recognition data from the control unit 19 and the image in the vicinity of the premise / external boundary line 54 to set the premise / external boundary line 54 to the entrance side. (In the direction of arrow a shown in FIG. 1), that is, the inside / outside boundary line 54 is moved from the outside of the station to the inside of the station, or the inside / outside boundary line 54 is moved to the participation side (arrow b shown in FIG. 1). Direction), that is, whether or not the inside / outside boundary line 54 has been moved from the inside of the station to the outside of the station (step S45).

  As a result of the determination in step S45, when the user M moves the premise / external boundary line 54 to the entrance side (in the direction of arrow a in FIG. 1), the registered use having an ID number that matches the ID number stored in the memory 14a. The user information is searched from the memory 14b, the entrance process for the user M is performed based on the searched ticket information in the registered user information, and the processing result is stored in the ticket information in the registered user information. Then, a message indicating that the entrance process has been completed is transmitted to the mobile terminal device 11 (step S46).

  As a result of the determination in step S45, when the user M moves the premise / external boundary line 54 to the participation side (in the direction of arrow b shown in FIG. 1), the registered use having an ID number that matches the ID number stored in the memory 14a. The user information is searched from the memory 14b, the participation process for the user M is performed based on the searched ticket information in the registered user information, and the processing result is stored in the ticket information in the registered user information. Then, the message that the participation process has been completed is transmitted to the mobile terminal device 11 (step S47).

  In addition, in the admission / exit process in steps S46 and 47, when the user M roams in the vicinity of the on-premise / outer boundary line 54, the admission / exit process is continuously performed. Is assumed to be a temporary state, and the last temporary state is adopted as the final process when there is no change for a certain period of time.

  When the portable terminal device 11 receives the message indicating that the entry / exit process has been completed from the control unit 19, the portable terminal device 11 provides guidance to that effect on the display unit 22 (step S35).

  Next, the unauthorized user detection process in step S44 will be described with reference to the flowchart shown in FIG.

  First, it is determined whether or not the face recognition data of the user M that has moved beyond the premise / external boundary line 54 exists in the registered user information in the memory 14b (step S51). The face image of the person M is notified to the station staff and is also recorded in the host device 14 so that an addict can be determined (step S52).

  As a result of the determination in step S51, if the face recognition data of the user M that has moved beyond the premise / external boundary line 54 exists in the registered user information in the memory 14b, whether the premise / external boundary line 54 has been exceeded (entrance Inquiry about whether or not to participate is transmitted to the control unit 19 (step S53).

  When receiving an inquiry from the host device 14 (step S54), the control unit 19 transmits an inquiry to the portable terminal device 11 as to whether the premise / external boundary line 54 has been exceeded (entered or participated) (step S55).

  When the mobile terminal device 11 receives the inquiry from the control unit 19 (step S57), the inquiry is displayed on the display unit 22, so that the user M operates the operation unit 21 in response to the inquiry. Is displayed (step S58). As the intention display, for example, “selection 1: I am not myself (not going to the station, etc.)” or “selection 2: I have passed the boundary line on the inside / outside of the premises, but is not using the train” is considered.

The portable terminal device 11 returns the intention display result of the user M to the control unit 19 (step S59).
When receiving the will display result from the mobile terminal device 11, the control unit 19 transmits the will display result to the host device 14 through the public line 16 (step S56).

  Upon receiving the will display result from the control unit 19, the host device 14 determines whether the will display result is “selection 1” or “selection 2” (step S60). The face recognition data in the registered user information of the user M registered in 14b is corrected (step S61). If “selection 2”, the process ends.

  Next, self-reporting processing when face recognition is impossible will be described with reference to the flowchart shown in FIG.

  The self-reporting process is, for example, when the user M is masking and face recognition cannot be performed by the control unit 19 and the host device 14, the user M operates the mobile terminal device 11 by himself / herself. Implement recognition. The reason is that if face recognition cannot be performed correctly and the user continues to use without performing the self-reporting process, the image is registered as an image of an unauthorized user by the unauthorized user detection process in step S44 of FIG. . If the entrance / exit processing result is not displayed in the entrance / exit process shown in FIG. 7 even though the user has entered or participated, the user M is instructed to make a self-report.

  When the user M is guided to self-report without displaying the entry / participation process result on the display unit 22 of the mobile terminal device 11, the user M sets the self-report mode by operating the operation unit 21. The mobile terminal device 11 confirms that it is in the mid-range wireless communication area 55 (step S71), and participates in the mid-range wireless communication with the control unit 19 (step S72).

  Next, the user M operates the operation unit 21 of the mobile terminal device 11 and inputs that he / she has moved the premise / external boundary line 54 to the entrance side or the exit side (step S73). 11 transmits the input result (self-reported content) to the control unit 19 (step S74).

  Upon receiving the input result (self-reported content) transmitted from the mobile terminal device 11, the control unit 19 transmits the input result (self-reported content) to the host device 14 via the public line 16 (step S75).

  When the host device 14 receives the input result (self-declared content) from the control unit 19 (step S76), the host device 14 determines whether the input result is "moved to the entrance side" or "moved to the entry side" ( Step S77).

  If the result of determination in step S77 is that the input result is “moved to the entrance side”, the host device 14 searches the memory 14b for registered user information having an ID number that matches the ID number stored in the memory 14a. Then, based on the searched ticket information in the registered user information, an entrance process for the user M is performed, and the processing result is stored in the ticket information in the registered user information (step S78).

  As a result of the determination in step S77, if the input result is “moved to the entry side”, the host device 14 searches the memory 14b for registered user information having an ID number that matches the ID number stored in the memory 14a. Then, the participation process for the user M is performed based on the searched ticket information in the registered user information, and the processing result is stored in the ticket information in the registered user information (step S79).

  Next, a case where a face image registered in the mobile terminal device 11 according to the second embodiment is described will be described.

  First, user registration performed in advance will be described with reference to a flowchart shown in FIG.

  The user M activates the ticket gate application by operating the portable terminal device 11 possessed, and selects and activates user registration from the menu (step S81).

Next, the user M inputs user information (step S82). As user information to be input at this time, for example,
・ Address, name, phone number, etc.
・ Credit card number (when using credit card)
Etc. are considered.

  Next, the user M captures his / her face image by activating the camera 17 (step S83). When the face image capturing is completed, the mobile terminal device 11 communicates with the credit settlement server of the credit company via the public line 10 to check whether or not the user can use the credit settlement. (At the time of settlement use) is performed (step S84).

  Next, the mobile terminal device 11 generates face recognition data (for example, face feature data that can identify a person at a certain level or more) from the captured face image, and also generates an ID number unique to the user. The generated face recognition data, ID number, and input user information (hereinafter referred to as input user information) are stored (registered) in the user information area 28c of the memory 28 as registered user information (step S85). ).

  Next, the remaining charge of the SF card and the regular section purchase will be described with reference to the flowchart shown in FIG.

First, the case of credit use will be described.
In the case of credit use, the user M operates the operation unit 21 of the portable terminal device 11 that he / she owns to select the charge amount and the regular section (step S91), and the credit settlement of the credit company via the public line 10 is performed. Credit communication is performed by communicating with the server (step S92).

  Next, when the credit terminal is completed, the mobile terminal device 11 adds the remaining amount in the registered user information stored in the user information area 28c of the memory 28 by the charged amount (charge amount), and purchases. The regular period is saved (step S93).

Next, the case of using an automatic ticket vending machine will be described.
In the case of using the automatic ticket vending machine, the user M selects the charge amount and the regular section by operating the operation display unit 31 of the automatic ticket vending machine 12 (step S94).
Next, the automatic ticket vending machine 12 acquires the ID number stored in the user information area 28c of the memory 28 by performing medium-range wireless communication with the mobile terminal device 11 (step S95).

  Next, the user M inserts the necessary amount of cash into the automatic ticket vending machine 12, so that the automatic ticket vending machine 12 receives the charged amount (charge amount) and the purchased periodic interval in the charge / periodic interval purchase request. Attach and transmit to the mobile terminal device 11 by medium-range wireless communication (step S96).

When the portable terminal device 11 receives the charge / periodic section purchase request from the automatic ticket vending machine 12 (step S97), the remaining amount in the registered user information stored in the user information area 28c of the memory 28 is converted into the above charge / The charge amount attached to the periodic segment purchase request is added and the regular segment is saved (step S98).
Next, the portable terminal device 11 transmits a registration end message to the automatic ticket vending machine 12 (step S21).

  Next, entrance / exit processing will be described with reference to the flowchart shown in FIG.

The control unit 19 of the automatic ticket gate 13 develops mid-range wireless communication from the antenna unit 18 (step S101).
When the user M possessing the mobile terminal device 11 enters the mid-range wireless communication area 55 (step S102), the mobile terminal device 11 participates in the mid-range wireless communication with the control unit 19 (step S103), and the memory 28 The registered user information stored in the user information area 28c is transmitted to the control unit 19 (step S104).

When receiving the registered user information transmitted from the mobile terminal device 11, the control unit 19 stores the received registered user information in the memory 45a (step S106).
Next, the control unit 19 activates the camera 17 to capture an image in the vicinity of the inside / outside boundary line 54 in the ticket gate area 53, and extracts and extracts the face image of the user M from the captured image. Data for face recognition (for example, face feature data that can identify the person at a certain level or more) is generated from the face image (step S107).

  Next, the control unit 19 determines whether or not there is a user M (face image) that has moved beyond the on-premises boundary line 54 using the generated face recognition data (step S108). If there is no user M who has moved beyond the boundary line 54, the process returns to step S106, and the same operation as described above is repeated.

  If the result of determination in step S108 is that there is a user M that has moved beyond the on-premise / outside boundary line 54, the control unit 19 will indicate that the user M that has moved beyond the on-premise / outside boundary line 54 is currently in mid-range wireless communication. It is determined whether the user is a participating user (step S109).

  That is, whether or not both face recognition data match by comparing the generated face recognition data with the face recognition data in the registered user information from the mobile terminal device 11 stored in the memory 45a. Determine. If both face recognition data match, it is determined that the user (person) is currently participating in medium-range wireless communication. If both face recognition data does not match, the user is currently participating in medium-range wireless communication. It is determined that it is not a user (not the person).

  If the result of determination in step S109 is that the user is not currently participating in medium-range wireless communication, the control unit 19 notifies the station staff of the face image of the user M and records it in the control unit 19 as well. Then, an addict can be determined (step S110).

  If the result of determination in step S109 is that the user is currently participating in mid-range wireless communication, the control unit 19 uses the captured image near the on-premises / outside boundary line 54 and the generated face recognition data to M has moved the on-premises boundary line 54 to the entrance side (in the direction of arrow a shown in FIG. 1), that is, has moved the on-premises outside boundary line 54 from the outside of the station to the inside of the station, or Is moved to the participation side (in the direction of the arrow b shown in FIG. 1), that is, whether the inside / outside boundary line 54 is moved from the inside of the station to the outside of the station (step S111).

  As a result of the determination in step S111, when the user M moves the inside / outside boundary line 54 to the entrance side (in the direction of arrow a shown in FIG. 1), the control unit 19 includes the registered user information stored in the memory 45a. The entrance process for the user M is performed based on the ticket information, the processing result is stored in the ticket information in the registered user information, and a message indicating that the entrance process is completed is transmitted to the mobile terminal device 11 (step) S112).

  As a result of the determination in step S111, when the user M moves the inside / outside boundary line 54 to the participation side (in the direction of the arrow b shown in FIG. 1), the control unit 19 includes the registered user information stored in the memory 45a. The participation process for the user M is performed based on the ticket information, the processing result is stored in the ticket information in the registered user information, and a message indicating the completion of the participation process is transmitted to the mobile terminal device 11 (step) S113).

  In addition, in the admission / exit processing in steps S112 and 113, when the user M roams in the vicinity of the on-premise / external boundary line 54, the admission / exit processing is continuously performed. Is assumed to be a temporary state, and the last temporary state is adopted as the final process when there is no change for a certain period of time.

  When the portable terminal device 11 receives the message of the entrance / exit processing end from the control unit 19, the portable terminal device 11 provides guidance to that effect on the display unit 22 (step S 105).

  Next, self-reporting processing when face recognition is impossible will be described with reference to the flowchart shown in FIG.

  The self-reporting process is, for example, when the user M is masked and the face cannot be recognized by the control unit 19, and the user M operates the mobile terminal device 11 to execute the entrance / exit process. To do. The reason is to guide the user M to make a self-report if the entrance / exit process results in FIG. 12 are not displayed in the entrance / exit process in spite of having entered or participated. is there.

  When the user M is guided to self-report without displaying the entry / participation process result on the display unit 22 of the mobile terminal device 11, the user M sets the self-report mode by operating the operation unit 21. The mobile terminal device 11 confirms that it is in the mid-range wireless communication area 55 (step S121), and participates in the mid-range wireless communication with the control unit 19 (step S122).

  Next, the user M operates the operation unit 21 of the mobile terminal device 11 and inputs that he / she has moved the inside / outside boundary line 54 to the entrance side or the exit side (step S123), thereby the mobile terminal device. 11 transmits the input result (self-reported content) to the control unit 19 (step S124).

  When the control unit 19 receives the input result (the self-declared content) transmitted from the mobile terminal device 11 (step S125), the control unit 19 determines whether the input result is “moved to the entrance side” or “moved to the entry side”. Determination is made (step S126).

  As a result of the determination in step S126, when the input result is “moved to the entrance side”, the control unit 19 performs an entrance process for the user M based on the ticket information in the registered user information stored in the memory 45a. The processing result is stored in the ticket information in the registered user information (step S127).

  As a result of the determination in step S126, when the input result is “moved to the participation side”, the control unit 19 performs an entry process for the user M based on the ticket information in the registered user information stored in the memory 45a. The processing result is stored in the ticket information in the registered user information (step S128).

  According to the ticket gate system of at least one embodiment described above, a mobile terminal device such as a smartphone is used as a ticket ticket medium, and a face image captured when using the automatic ticket gate device and a face image of the person registered in advance are used. By checking the intention of user entry / exit based on the relationship between the match and the boundary line for confirming the intention of user entry / exit set in the ticket gate area, the user can check the user's entry / exit intention by hand. Can be used, and convenience is remarkably improved. In particular, for example, it can be expected that a traffic weak person such as a handicapped or weak eyesight can easily use the automatic ticket gate device.

Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.
The invention described in the scope of the claims at the beginning of the present application is added below.
[C1]
Storage means for storing user-specific identification information and the user's face image in association with each other;
A first means for acquiring, by wireless communication, identification information unique to the user stored in advance in the mobile terminal device when the mobile terminal device possessed by the user and having a wireless communication function enters the ticket gate area;
A second means for capturing an image near the ticket gate area;
Third means for acquiring a face image of a user who has crossed a boundary line for intention confirmation of user entry / exit preset in the ticket gate area from an image captured by the second means;
Fourth means for acquiring a face image having identification information corresponding to the identification information acquired by the first means from the storage means;
Fifth means for determining whether or not the face image acquired by the third means matches the face image acquired by the fourth means;
A sixth means for determining whether the user has moved the boundary line in the direction of entry or exit when the fifth means determines that both face images match;
If it is determined by the sixth means that the user has moved the boundary line to the entrance side, a seventh means for performing an entrance process for the user;
If it is determined by the sixth means that the user has moved the boundary line to the entry side, an eighth means for performing an entry process for the user;
A ticket gate system comprising:
[C2]
The ticket gate system according to C1, further comprising ninth means for notifying a staff member that there is a possibility of an unauthorized user when both face images are determined to be inconsistent by the fifth means.
[C3]
A portable terminal device possessed by a user and having a wireless communication function, an automatic ticket gate device for performing ticket gate processing by performing wireless communication with the portable terminal device, and a host device communicably connected to the automatic ticket gate device, A ticket gate system comprising:
The host device is
Comprising first storage means for storing identification information unique to a user and the face image and ticket information of the user in association with each other;
The portable terminal device
A second storage means for storing at least user-specific identification information in advance;
A first transmission means for transmitting the identification information stored in the second storage means to the automatic ticket gate device by wireless communication when entering the ticket gate area of the automatic ticket gate device;
The automatic ticket gate is
Imaging means for capturing an image near the ticket gate area;
First acquisition means for acquiring a face image of a user who has crossed a boundary line for intention confirmation of user entry / exit preset in the ticket gate area, based on an image captured by the imaging means;
Receiving the identification information transmitted from the portable terminal device, comprising the second transmission means for transmitting the received identification information and the face image acquired by the first acquisition means to the host device,
The host device further includes:
Second acquisition means for receiving identification information and a face image transmitted from the automatic ticket gate and acquiring a face image having identification information corresponding to the received identification information from the first storage means;
First determination means for determining whether or not the face image acquired by the second acquisition means matches the received face image;
If it is determined by the first determination means that both face images match, the second determination means for determining whether the user has moved the boundary line in the direction of entry or exit;
When it is determined by the second determination means that the user has moved the boundary line to the entrance side, boarding ticket information having identification information corresponding to the received identification information is acquired from the first storage means, An admission processing means for performing admission processing for the user based on the acquired ticket information;
If it is determined by the second determination means that the user has moved the boundary line to the entry side, boarding ticket information having identification information corresponding to the received identification information is acquired from the first storage means, A ticket gate system comprising participation processing means for performing participation processing for the user based on the acquired ticket information.
[C4]
The automatic ticket gate is
The ticket gate system according to C3, further comprising notification means for notifying a staff member that there is a possibility that the user is an unauthorized user when both face images are determined to be inconsistent by the first determination means.
[C5]
An automatic ticket gate device used in the ticket gate system described in C3,
Receiving means for receiving the identification information transmitted from the portable terminal device by wireless communication;
Imaging means for capturing an image near the ticket gate area;
An acquisition means for acquiring a face image of a user who has crossed a boundary line for intention confirmation of user entry / exit preset in the ticket gate area, based on an image captured by the imaging means;
Transmitting means for transmitting the identification information received by the receiving means and the face image acquired by the first acquiring means to the host device;
An automatic ticket gate device comprising:
[C6]
A portable terminal device used in the ticket gate system described in C3,
Wireless communication means for performing wireless communication with the automatic ticket gate,
Storage means for storing at least user-specific identification information in advance;
Transmitting means for transmitting the identification information stored in the storage means to the automatic ticket gate device by the wireless communication means when entering the ticket gate area of the automatic ticket gate device;
A portable terminal device comprising:
[C7]
A first means for acquiring, by wireless communication, a face image of the user stored in advance in the mobile terminal device when the mobile terminal device possessed by the user and having a wireless communication function enters the ticket gate area;
A second means for capturing an image near the ticket gate area;
Third means for acquiring a face image of a user who has crossed a boundary line for intention confirmation of user entry / exit preset in the ticket gate area from an image captured by the second means;
Fourth means for determining whether or not the face image acquired by the first means matches the face image acquired by the third means;
If it is determined by the fourth means that both face images match, the fifth means determines whether the user has moved the boundary line to the entrance side or the exit side;
If it is determined by the fifth means that the user has moved the boundary line to the entrance side, a sixth means for performing an entrance process for the user;
If it is determined by the fifth means that the user has moved the boundary line to the participation side, a seventh means for performing participation processing for the user;
A ticket gate system comprising:
[C8]
The ticket gate system according to C7, further comprising eighth means for notifying a staff member that there is a possibility that the user is an unauthorized user when both face images are determined to be inconsistent by the fourth means.
[C9]
A ticket gate system comprising a portable terminal device possessed by a user and having a wireless communication function, and an automatic ticket gate device that performs ticket gate processing by performing wireless communication with the portable terminal device,
The portable terminal device
Storage means for storing at least the user's face image and ticket information in advance;
When entering the ticket gate area of the automatic ticket gate, comprising a transmission means for transmitting the face image and the ticket information stored in the storage means to the automatic ticket gate device by wireless communication,
The automatic ticket gate is
Imaging means for capturing an image near the ticket gate area;
An acquisition means for acquiring a face image of a user who has crossed a boundary line for intention confirmation of user entry / exit preset in the ticket gate area, based on an image captured by the imaging means;
First determination means for receiving the face image and ticket information transmitted from the portable terminal device, and determining whether the received face image and the face image acquired by the acquisition means match;
If it is determined by the first determination means that both face images match, the second determination means for determining whether the user has moved the boundary line in the direction of entry or exit;
If it is determined by the second determination means that the user has moved the boundary line to the entrance side, an entry processing means for performing an entry process for the user based on the received ticket information;
A ticket gate system comprising entry processing means for performing entry processing for the user based on the received ticket information when the second determination means determines that the user has moved to the entry side on the boundary line.
[C10]
The automatic ticket gate is
The ticket gate system according to C9, further comprising notification means for notifying a staff member that there is a possibility that the user is an unauthorized user when both face images are determined to be inconsistent by the first determination means.
[C11]
An automatic ticket gate device used in the ticket gate system described in C9,
Receiving means for receiving the face image and the ticket information transmitted from the portable terminal device by wireless communication;
Imaging means for capturing an image near the ticket gate area;
An acquisition means for acquiring a face image of a user who has crossed a boundary line for intention confirmation of user entry / exit preset in the ticket gate area, based on an image captured by the imaging means;
First determination means for determining whether or not the face image received by the reception means matches the face image acquired by the acquisition means;
If it is determined by the first determination means that both face images match, the second determination means for determining whether the user has moved the boundary line in the direction of entry or exit;
When it is determined by the second determining means that the user has moved the boundary line to the entrance side, an admission processing means for performing admission processing for the user based on the ticket information received by the receiving means;
An entry processing means for performing an entry process for the user based on the ticket information received by the receiving means when the second determining means determines that the user has moved to the entry side on the boundary line;
An automatic ticket gate device comprising:
[C12]
A portable terminal device used in the ticket gate system according to C9,
Wireless communication means for performing wireless communication with the automatic ticket gate,
Storage means for storing at least the user's face image and ticket information in advance;
Transmitting means for transmitting the face image and the ticket information stored in the storage means to the automatic ticket gate device by the wireless communication means when entering the ticket gate area of the automatic ticket gate device;
A portable terminal device comprising:

  DESCRIPTION OF SYMBOLS 11 ... Mobile terminal device (smart phone, mobile phone etc.), 12 ... Automatic ticket vending machine, 13 ... Automatic ticket gate device, 14 ... Host device (center server), 17 ... Camera (imaging means), 18 ... Antenna part, 19 ... Control , 53 ... ticket gate area, 54 ... premises boundary line, 55 ... medium-range wireless communication area.

Claims (6)

A first means for acquiring, by wireless communication, the user's face image stored in advance in the mobile terminal device when the mobile terminal device possessed by the user and having a wireless communication function enters the ticket gate area;
A second means for capturing an image of the ticket gate area;
Third means for acquiring a face image of a user who has crossed a boundary line for intention confirmation of user entry / exit preset in the ticket gate area from an image captured by the second means;
Fourth means for determining whether or not the face image acquired by the first means matches the face image acquired by the third means;
If it is determined by the fourth means that both face images match, the user moves the boundary line in either the entrance side or the exit side based on the image captured by the second means A fifth means for determining whether or not
A sixth means for performing an entrance process for the user when the fifth means determines that the user has moved the boundary line to the entrance side;
If the fifth means determines that the user has moved the boundary line to the entry side, a seventh means for performing an entry process for the user;
A ticket gate system comprising:   The ticket gate system according to claim 1, further comprising an eighth means for notifying a staff member that the user may be an unauthorized user when both face images are determined to be inconsistent by the fourth means. A ticket gate system comprising a mobile terminal device possessed by a user and having a wireless communication function, and an automatic ticket gate device that performs ticket gate processing by performing wireless communication with the mobile terminal device,
The portable terminal device
Storage means for storing in advance at least the user's face image and ticket information;
When entering the ticket gate area of the automatic ticket gate, comprising a transmission means for transmitting the face image and the ticket information stored in the storage means to the automatic ticket gate device by wireless communication,
The automatic ticket gate is
Imaging means for capturing an image of the ticket gate area;
An acquisition means for acquiring a face image of a user who has crossed a boundary line for intention confirmation of user entry / exit preset in the ticket gate area, based on an image captured by the imaging means;
First determination means for receiving the face image and ticket information transmitted from the portable terminal device, and determining whether the received face image and the face image acquired by the acquisition means match;
When it is determined by the first determination means that both face images match, the user has moved the boundary line in either the entrance side or the exit side based on the image picked up by the image pickup means Second determination means for determining whether or not
When the second determination means determines that the user has moved the boundary line to the entrance side, an entrance processing means for performing an entrance process for the user based on the received ticket information;
A ticket gate system comprising: an entry processing means for performing an entry process for the user based on the received ticket information when the second determination means determines that the user has moved the boundary line to the entry side. . The automatic ticket gate is
The ticket gate system according to claim 3, further comprising notification means for notifying an attendant that the user may be an unauthorized user when the first determination means determines that both face images do not match. An automatic ticket gate device used in the ticket gate system according to claim 3,
Receiving means for receiving the face image and the ticket information transmitted from the portable terminal device by wireless communication;
Imaging means for capturing an image of the ticket gate area;
An acquisition means for acquiring a face image of a user who has crossed a boundary line for intention confirmation of user entry / exit preset in the ticket gate area, based on an image captured by the imaging means;
First determination means for determining whether or not the face image received by the reception means matches the face image acquired by the acquisition means;
When it is determined by the first determination means that both face images match, the user has moved the boundary line in either the entrance side or the exit side based on the image picked up by the image pickup means Second determination means for determining whether or not
An entrance processing means for performing an entrance process for the user based on the ticket information received by the receiving means when the second judging means determines that the user has moved the boundary line to the entrance side;
An entry processing means for performing an entry process for the user based on the ticket information received by the receiving means when it is determined by the second determining means that the user has moved the boundary line to the entry side;
An automatic ticket gate device comprising: A mobile terminal device used in the ticket gate system according to claim 3,
Wireless communication means for performing wireless communication with the automatic ticket gate,
Storage means for storing in advance at least the user's face image and ticket information;
Transmitting means for transmitting the face image and the ticket information stored in the storage means to the automatic ticket gate device by the wireless communication means when entering the ticket gate area of the automatic ticket gate device;
A portable terminal device comprising:

Images