JP7399649B2 - Judgment device, judgment method and judgment program - Google Patents

Description

Embodiments of the present invention relate to a determination device, a determination method, and a determination program.

2. Description of the Related Art Conventionally, techniques are known for performing various payment processing using terminal devices such as smartphones, tablet terminals, wearable devices, and the like. As an example of such technology, when a terminal device is used to read a two-dimensional code such as a QR code (registered trademark) (Quick Response Code) for a store, payment information is sent to the store corresponding to the read two-dimensional code. Techniques for accepting requests via a terminal device are known.

Here, if the 2D code for the 2nd store is mistakenly provided to the 1st store, or if an incorrect 2D code is attached to the 2D code of the 1st store printed on paper, etc. , the payment to the first store will not be made properly. Therefore, there is a technology to authenticate an imaged two-dimensional code by determining whether or not the position where the two-dimensional code imaged by the terminal device matches the position where the two-dimensional code is imaged by the terminal device. Are known.

Japanese Patent Application Publication No. 2015-046052

However, the above-described technology may impair the convenience of payment using two-dimensional codes.

For example, with the above-described technology, if the location of the terminal device cannot be appropriately acquired, such as in a building, authentication cannot be performed.

The present application was made in view of the above, and aims to prevent fraudulent payments without sacrificing convenience.

The determination device according to the present application collects code information indicating a code included in an image taken by a terminal device used by a user, and acquisition information that is information other than the code information that can be obtained from the image. and a determination unit that determines whether or not the code information acquired by the acquisition unit and correspondence information previously associated with the acquisition information acquired by the acquisition unit match. Features.

According to one aspect of the embodiment, it is possible to prevent fraudulent payments without sacrificing convenience.

FIG. 1 is a diagram showing an example of payment using a two-dimensional code. FIG. 2 is a diagram showing an example of an image captured by a terminal device used by a user. FIG. 3 is a diagram illustrating an example of the determination process according to the embodiment. FIG. 4 is a diagram illustrating a configuration example of an information providing system according to an embodiment. FIG. 5 is a diagram illustrating a configuration example of an information providing device according to an embodiment. FIG. 6 is a diagram illustrating an example of the correspondence information database according to the embodiment. FIG. 7 is a flowchart illustrating an example of the procedure of the determination process according to the embodiment. FIG. 8 is a hardware configuration diagram showing an example of a computer that implements the functions of the information providing device.

DESCRIPTION OF THE PREFERRED EMBODIMENTS Below, a mode for implementing a determination device, a determination method, and a determination program (hereinafter referred to as "embodiments") according to the present application will be described with reference to the drawings. Note that the determination device, determination method, and determination program according to the present application are not limited to this embodiment. Furthermore, in the following embodiments, the same parts are denoted by the same reference numerals, and redundant explanations will be omitted.

[1. Embodiment]
As a premise of the determination process according to this embodiment, fraud performed in payment using a two-dimensional code (hereinafter sometimes referred to as "code payment") will be explained using FIG. 1. FIG. 1 is a diagram showing an example of payment using a two-dimensional code.

It is assumed that the terminal device 100 shown in FIG. 1 is an information processing device (smartphone) used by the user U. It is also assumed that the store terminal 201 shown in FIG. 1 is an information processing device (smartphone) used by a manager (seller) S of a store R1, which is a physical store. Further, the store terminal 202 shown in FIG. 1 is an information processing device used by the administrator (fraudulent person) F, who is the administrator of store R2, which is a physical store, and who attempts to fraudulently receive payments from users. (smartphone).

It is also assumed that the payment server 300 shown in FIG. 1 is an information processing device that controls code payment processing. In the example of FIG. 1, the payment server 300 collects code information indicating a two-dimensional code read by the terminal device 100 at a store (actual store) and the total amount (purchase amount) of the transaction object that the user U purchases at the store. By receiving the information shown from the terminal device 100, payment processing (transfer) of the purchase amount is performed to the manager of the store corresponding to the code information. In the example of FIG. 1, it is assumed that the two-dimensional code QR1 corresponding to the seller S has already been distributed to the store terminal 201, and the two-dimensional code QR2 corresponding to the fraudster F has already been distributed to the store terminal 202. .

First, the fraudulent person F superimposes the two-dimensional code of the fraudulent person F on the two-dimensional code of the seller S (step S1). For example, in the example of FIG. 1, the fraudster F overlays the two-dimensional code QR2 on the two-dimensional code QR1 printed on a predetermined medium (for example, printing paper) and installed at the cash register of the store R1.

Here, in the example of FIG. 1, it is assumed that the user U visits the store R1 and wishes to settle the purchase amount at the store R1 by code payment. In this case, the terminal device 100 reads the two-dimensional code installed at the cash register of the store R1, that is, the two-dimensional code QR2 of the fraudster F (step S2). Subsequently, the terminal device 100 notifies (sends) the two-dimensional code QR2 of the fraudster F and the purchase amount of the user U at the store R1 to the payment server 300 (step S3). For example, in the example of FIG. 1, the terminal device 100 sends a payment request to the payment server 300 including code information indicating the two-dimensional code QR2 read in step S2 and the purchase amount input by the user U into the terminal device 100. Notice.

Subsequently, the payment server 300 transfers the purchase amount notified from the terminal device 100 to the fraudster F (step S4). In other words, the payment server 300 transfers the purchase amount input by the user U to the fraudster F corresponding to the two-dimensional code QR2 indicated by the code information notified from the terminal device 100 in step S3. On the other hand, the payment server 300 does not transfer money to the seller S who actually sold the transaction object to the user U.

As mentioned above, when a store uses 2D code for payment, if another store's 2D code is pasted over its own store's 2D code, it may not be able to properly accept payments from users. Can not. Therefore, there is a need for a technology that prevents fraudulent payments caused by overlapping two-dimensional codes. Here, as a technology related to payment using a two-dimensional code, conventionally, it is determined whether the position where the two-dimensional code imaged by the terminal device matches the position where the two-dimensional code is imaged by the terminal device. There is a known technique for authenticating an imaged two-dimensional code. However, the conventional technology has a problem in that it is not convenient because authentication cannot be performed when the location of the terminal device cannot be properly acquired, such as in a building.

Based on the above premises and problems, the determination device, etc. according to the present application performs the determination process according to the embodiment.

Here, an image captured when a terminal device used by a user usually reads a two-dimensional code includes code information indicating the two-dimensional code and information other than the code information (for example, the brightness and color of the image). etc. (hereinafter sometimes referred to as "obtained information"). It is assumed that the circumstances surrounding the two-dimensional code installed in each store are different from store to store. Therefore, an image captured of a two-dimensional code installed in a store will include acquired information specific to the store.

Such acquired information will be specifically explained using FIG. 2. FIG. 2 is a diagram showing an example of an image captured by a terminal device used by a user. In addition, in the explanation of Figure 2, information about the surrounding situation where the 2D code is installed (hereinafter sometimes referred to as "correspondence information") is associated with the code information indicating the 2D code of the store. It is assumed that The correspondence information includes information indicating the brightness around the two-dimensional code (hereinafter sometimes referred to as "brightness information") and information indicating the color around the two-dimensional code (hereinafter referred to as "color information"). ), information indicating the items installed around the two-dimensional code (hereinafter sometimes referred to as "article information"), information indicating the frequency of the image captured around the two-dimensional code (hereinafter sometimes referred to as "frequency information").

In the example of FIG. 2, image P1 is an image captured in store R1 by a terminal device used by a user, and includes medium M1 attached with a two-dimensional code corresponding to store R1, and images installed around medium M1. The objects B1 and B2 are included as subjects. The image P2 is an image captured at the store R2 by a terminal device used by the user, and includes a medium M2 attached with a two-dimensional code corresponding to the store R2, and an article B3 placed around the medium M2. including as a subject.

Here, when image P1 is analyzed using image recognition technology or the like, acquired information #1 corresponding to correspondence information #1 associated with the two-dimensional code printed on medium M1 is extracted. Specifically, the difference between the feature amount indicated by acquired information #1 including brightness information, color information, product information, frequency information, etc. extracted from image P1 and the feature amount indicated by corresponding information #1 is determined by a predetermined difference. It is within the threshold.

Similarly, when image P2 is analyzed using image recognition technology or the like, acquired information #2 corresponding to correspondence information #2 associated with the two-dimensional code printed on medium M2 is extracted.

In other words, if an image captured by a terminal device includes a two-dimensional code (correct two-dimensional code) associated with the store where the image was captured, the acquired information extracted from the image corresponds to the two-dimensional code. Corresponds to the attached correspondence information.

On the other hand, in the example shown in FIG. 2, image P3 is an image captured at store R1 by a terminal device used by a user, but the two-dimensional code of store R2 is pasted over the two-dimensional code of store R1. Accordingly, the subject includes the medium M1 attached with the two-dimensional code corresponding to the store R2, and the articles B1 and B2 placed around the medium M1. In this case, when image P1 is analyzed using image recognition technology or the like, acquired information #1 that does not correspond to correspondence information #2 associated with the two-dimensional code of store R2 printed on medium M1 is extracted. . Specifically, correspondence information #2 indicates that article B3 is installed around medium M2, and acquired information indicates that articles B1 and B2 are installed around medium M1 instead of article B3. With #1, the difference in feature amounts is greater than or equal to a predetermined threshold.

That is, if an image captured by a terminal device includes a two-dimensional code that does not correspond to the store where the image was captured, in other words, if two-dimensional codes are pasted together, the acquired information extracted from the image does not correspond to the correspondence information associated with the two-dimensional code.

By using such a correspondence relationship between acquired information and correspondence information, a determination device or the like according to the present application realizes the determination process according to the embodiment. The determination process realized by the determination device and the like according to the present application will be described below with reference to FIG. FIG. 3 is a diagram illustrating an example of the determination process according to the embodiment. Note that in FIG. 3, it is assumed that the output processing and the like according to the embodiment are realized by the information providing device 10, which is an example of the determination device according to the present application.

Prior to describing FIG. 3, the information providing system 1 according to the embodiment will be described using FIG. 4. FIG. 4 is a diagram illustrating a configuration example of an information providing system according to an embodiment. As shown in FIG. 4, the information providing system 1 according to the embodiment includes an information providing device 10, a terminal device 100, a store terminal 200, and a payment server 300. The information providing device 10, the terminal device 100, the store terminal 200, and the payment server 300 are connected via a network N to be able to communicate with each other by wire or wirelessly. The network N is, for example, a WAN (Wide Area Network) such as the Internet. Note that the information providing system 1 shown in FIG. 4 may include a plurality of information providing apparatuses 10, a plurality of terminal devices 100, a plurality of store terminals 200, and a plurality of payment servers 300.

The information providing device 10 is an information processing device that authenticates payment between a user and a store manager. For example, the information providing device 10 manages code information indicating a two-dimensional code corresponding to a store manager in association with corresponding information regarding the surrounding situation where the two-dimensional code is installed.

The terminal device 100 is an information processing device used by a user. The terminal device 100 is realized by, for example, a smartphone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a PDA (Personal Digital Assistant), or the like. Further, the terminal device 100 displays information related to code payment (for example, information displayed on the screen of the terminal device 100 when making a code payment) distributed by the payment server 300 or the like using a web browser or an application.

The store terminal 200 is an information processing device used by a store manager. That is, in the following, the store manager can also be read as the store terminal 200. The store terminal 200 is realized by, for example, a POS (Point of Sales system) terminal, a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, a PDA, or the like. Additionally, the store terminal 200 receives from the payment server 300 or the like a two-dimensional code that corresponds to the user (administrator) of the store terminal 200 and is read by the terminal device 100 when making a code payment. . Further, the store terminal 200 transmits correspondence information regarding the surrounding situation where the two-dimensional code is installed in the store to the information providing device 10. Note that the correspondence information may be information based on an image (still image or moving image) captured by a terminal device used by a store manager, or an image captured by an imaging device installed in the store.

The payment server 300 is an information processing device that controls code payment processing. For example, the payment server 300 performs payment processing (transfer) to the store manager corresponding to the payment request, based on payment information regarding the payment between the user and the store manager.

The determination process performed by the information providing device 10 will be described below using FIG. 3. In the following description, it is assumed that the terminal device 100 is a smart device such as a smartphone or a tablet that is equipped with an imaging unit and is used by the user U. That is, below, the user U can also be read as the terminal device 100. Further, in the following description, an example will be shown in which a user U visits a store R1, which is a physical store, and makes a code payment for the store R1.

In addition, in the following explanation, it is assumed that the two-dimensional code corresponding to the manager of store R1 is notified to the store terminal 200 from the payment server 300, etc., and that the medium M1 to which the two-dimensional code is attached is installed in store R1. do. In addition, in the following explanation, the information providing device 10 acquires response information regarding the surrounding situation where the two-dimensional code (medium M1) is installed from the store terminal 200 used by the manager of the store R1, and It is assumed that the information is managed in association with code information indicating the two-dimensional code corresponding to the administrator. Note that in the following description, the correspondence information includes brightness information, color information, article information, and frequency information.

First, the terminal device 100 photographs a two-dimensional code installed in the store R1 (step S11). In the example of FIG. 3, it is assumed that the terminal device 100 captures an image P11 of the medium M1 and articles B1 and B2 placed around the medium M1 in response to the operation of the user U. .

Subsequently, the terminal device 100 acquires code information indicated by the two-dimensional code (step S12). For example, in the example of FIG. 3, the terminal device 100 uses image recognition technology or the like to acquire code information indicating a two-dimensional code attached to the medium M1 included in the image P11.

Subsequently, the terminal device 100 extracts information other than the code information that is obtainable from the captured image as the obtained information (step S13). For example, in the example of FIG. 3, the terminal device 100 uses image recognition technology or the like to extract brightness information, color information, article information, and frequency information from the image P11 as acquired information.

Note that the process of extracting the code information and acquisition information from the image P11 may be performed by the information providing device 10 that has acquired the image P11 transmitted from the terminal device 100.

Subsequently, the terminal device 100 transmits the code information and acquisition information along with the payment information (step S14). For example, in the example of FIG. 3, the terminal device 100 transmits the code information and acquisition information extracted from the image P11 to the information providing device 10, along with payment information regarding the payment between the user U and the manager of the store R1. .

Subsequently, the information providing device 10 determines whether or not the correspondence information previously associated with the acquired code information matches the acquired acquisition information (step S15). For example, in the example of FIG. 3, the information providing device 10 acquires the code information and acquisition information transmitted from the terminal device 100 in step S14. Then, the information providing device 10 identifies correspondence information associated with the acquired code information, and determines that the difference between the feature amount indicated by the identified correspondence information and the feature amount indicated by the acquired acquisition information is within a predetermined threshold. Determine whether or not.

Note that to acquire the feature amounts indicated by the correspondence information and acquisition information, the feature amounts that the image has, such as color histogram, color distribution, SIFT (Scale-Invariant Feature Transform), and SURF (Speed-Up Robust Features), are acquired. Any technology can be employed. Additionally, feature amounts generated by a neural network can also be used as the feature amounts indicated by the correspondence information and the acquired information.

Subsequently, if the correspondence information and the acquired information match, the information providing device 10 executes payment according to the payment information (step S16). For example, in the example of FIG. 3, if the difference between the feature amount indicated by the correspondence information and the feature amount indicated by the acquired information is within a predetermined threshold, the information providing device 10 communicates with the user U and the manager of the store R1. The payment during the transaction is authenticated, and the payment information is sent to the payment server 300.

On the other hand, if the difference between the feature amount indicated by the correspondence information and the feature amount indicated by the acquired information is equal to or greater than a predetermined threshold, the information providing device 10 authenticates the payment between the user U and the manager of the store R1. In addition to transmitting information to the terminal device 100 to the effect that this is not possible, the store also sends information to the effect that two-dimensional codes corresponding to managers of other stores have been overlaid on the two-dimensional code installed at store R1. Send to terminal 200.

As described above, the information providing device 10 according to the embodiment uses the correspondence between acquired information and correspondence information to authenticate payment between a user and a store manager. As a result, the information providing device 10 according to the embodiment can authenticate the payment based on the information acquired together with the two-dimensional code, regardless of the terminal device used by the user or the location of the store. To prevent fraudulent payments without sacrificing convenience.

[2. Configuration of information providing device]
Next, the configuration of the information providing device 10 will be described using FIG. 5. FIG. 5 is a diagram illustrating a configuration example of an information providing device according to an embodiment. As shown in FIG. 5, the information providing device 10 includes a communication section 20, a storage section 30, and a control section 40.

(About the communication department 20)
The communication unit 20 is realized by, for example, a NIC (Network Interface Card). The communication unit 20 is connected to the network N by wire or wirelessly, and transmits and receives information between the terminal device 100, the store terminal 200, the payment server 300, and the like.

(About the storage unit 30)
The storage unit 30 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 5, the storage unit 30 has a correspondence information database 31.

(About the correspondence information database 31)
The correspondence information database 31 associates and stores code information indicating a two-dimensional code corresponding to a store manager and correspondence information regarding the surrounding situation where the two-dimensional code is installed. Here, an example of information stored in the correspondence information database 31 will be explained using FIG. 6. FIG. 6 is a diagram illustrating an example of the correspondence information database according to the embodiment. In the example of FIG. 6, the correspondence information database 31 has items such as "correspondence information ID,""codeinformation," and "correspondence information."

"Correspondence information ID" indicates identification information for identifying correspondence information. "Code information" indicates a two-dimensional code corresponding to the store manager. "Correspondence information" indicates information about the surrounding situation where the two-dimensional code is installed, such as brightness information indicating the brightness around the two-dimensional code, color information indicating the color around the two-dimensional code, This includes article information indicating articles placed around the two-dimensional code, frequency information indicating the frequency of an image captured around the two-dimensional code, and the like.

The response information database 31 contains response information for each time period such as morning (4-10 o'clock, etc.), afternoon (10-16 o'clock, etc.), evening (16:00-19:00), night (19-3 o'clock, etc.). may be memorized. Further, the correspondence information database 31 may store correspondence information for each weather such as sunny, cloudy, rainy, etc.

That is, FIG. 6 shows an example in which correspondence information "correspondence information #1" identified by correspondence information ID "SID #1" is associated with code information "code #1".

(About the control unit 40)
The control unit 40 is a controller, and various programs stored in the storage device inside the information providing device 10 use the RAM as a work area by, for example, a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). This is achieved by executing as . Further, the control unit 40 is a controller, and is realized by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). As shown in FIG. 5, the control unit 40 according to the embodiment includes a registration unit 41, an acquisition unit 42, a determination unit 43, and an authentication unit 44, and has information processing functions and operations described below. to realize or carry out.

(About the registration section 41)
The registration unit 41 registers, in the correspondence information database 31, correspondence information regarding the surrounding situation where the code is installed in association with code information indicating the code. For example, the registration unit 41 receives information such as an image captured by a terminal device used by a store manager or an image captured by an imaging device installed in the store from the store terminal 200, and based on the received information. The correspondence information is registered in the correspondence information database 31 in association with code information indicating the two-dimensional code of the administrator.

Note that the registration unit 41 may register information indicating the color temperature of the lighting around the code as the correspondence information. Further, the registration unit 41 may register information indicating a lighting mode by a lighting fixture or the like installed around the cord as the correspondence information. Further, the registration unit 41 may register, as the correspondence information, information that can be obtained from an image taken after the code is calibrated. Further, the registration unit 41 may register correspondence information for each time zone or weather in the correspondence information database 31 in association with the code information.

(About the acquisition unit 42)
The acquisition unit 42 acquires code information indicating a code included in an image taken by a terminal device used by the user, and acquisition information that is information that can be acquired from the image but is other than the code information. do. For example, in the example of FIG. 3, the acquisition unit 42 uses image recognition technology or the like to acquire the code information indicating the two-dimensional code attached to the medium M1 included in the image P11 and the acquisition information.

Further, the acquisition unit 42 may acquire information indicating the brightness of each photographic target included in the image as the acquisition information. For example, in the example of FIG. 3, the acquisition unit 42 acquires brightness information indicating the brightness around the two-dimensional code from the image P11 as the acquisition information.

Further, the acquisition unit 42 may acquire information indicating the color of each photographic target included in the image as the acquisition information. For example, in the example of FIG. 3, the acquisition unit 42 acquires color information indicating the color around the two-dimensional code from the image P11 as the acquisition information.

Further, the acquisition unit 42 may acquire information indicating the color temperature of each photographic target included in the image as the acquisition information. For example, the acquisition unit 42 acquires information indicating the color temperature of the lighting around the two-dimensional code as the acquisition information.

Further, the acquisition unit 42 may acquire, as the acquisition information, information indicating the illumination mode for each photographic target included in the image. For example, the acquisition unit 42 acquires, as the acquisition information, information indicating an illumination mode by a lighting fixture or the like installed around the two-dimensional code.

Further, the acquisition unit 42 may acquire time zone information indicating the time zone in which the image was photographed. For example, the acquisition unit 42 acquires, together with the acquisition information, time zone information indicating the time zone in which the image from which the acquired information is acquired was photographed.

In addition to the acquisition information, the acquisition unit 42 may also acquire band information indicating the weather when the image from which the acquisition information was acquired was taken.

Further, the acquisition unit 42 may acquire acquisition information that can be acquired from an image taken by the terminal device after calibration. For example, the acquisition unit 42 acquires acquisition information from an image taken after the two-dimensional code is calibrated.

(About the determination unit 43)
The determination unit 43 determines whether the code information acquired by the acquisition unit 42 and the correspondence information previously associated with each other match the acquired information acquired by the acquisition unit 42. For example, the determining unit 43 refers to the correspondence information database 31 and determines whether correspondence information that has been previously associated with the acquired code information matches acquired information acquired from the image together with the code information. . Specifically, the determination unit 43 determines whether the difference between the feature amount indicated by the correspondence information and the feature amount indicated by the acquired acquisition information is within a predetermined threshold.

Further, the determining unit 43 may determine whether the acquired information matches the correspondence information indicating the brightness of each photographic target included in the image when the code indicated by the code information is photographed in advance. For example, the determination unit 43 determines whether the brightness information included in the correspondence information that is previously associated with the code information matches the brightness information that is included in the acquired information acquired from the image together with the code information. do.

Further, the determining unit 43 may determine whether the acquired information matches the correspondence information indicating the color of each photographed object included in the image when the code indicated by the code information is photographed in advance. For example, the determining unit 43 determines whether the color information included in the correspondence information associated with the code information in advance matches the color information included in the acquired information acquired from the image together with the code information.

Further, the determination unit 43 may determine whether the acquired information matches the correspondence information indicating the color temperature of each photographed object included in the image when the code indicated by the code information is photographed in advance. For example, the determination unit 43 determines whether the information indicating the color temperature included in the correspondence information associated with the code information in advance matches the information indicating the color temperature included in the acquired information acquired from the image together with the code information. Determine whether or not.

Further, the determining unit 43 may determine whether the acquired information matches the correspondence information indicating the illumination mode for each photographic target included in the image when the code indicated by the code information is photographed in advance. For example, the determination unit 43 determines whether the information indicating the illumination mode included in the correspondence information associated with the code information in advance matches the information indicating the illumination mode included in the acquired information acquired from the image together with the code information. Determine whether or not.

The determining unit 43 also acquires correspondence information indicating information other than the code information indicating the code, which is information that can be obtained from an image taken in advance in the time zone indicated by the time zone information, and the code indicated by the code information. It may be determined whether or not the information matches. For example, the determination unit 43 determines whether the corresponding information corresponding to the time period in which the image from which the acquired information was acquired and the code information acquired from the image matches the acquired information. do.

Further, the determination unit 43 determines whether or not the obtained information matches correspondence information that is previously associated with the code information as information that can be obtained from the image taken after the code indicated by the code information is calibrated. You can. For example, the determination unit 43 determines the correspondence information corresponding to the acquired information acquired from the image photographed after calibration and the code information acquired from the image, and the correspondence information acquired from the image photographed after calibration. Determine whether or not they match.

(About the authentication section 44)
When the correspondence information and the acquired information match, the authentication unit 44 authenticates the payment between the user and the target person corresponding to the code information acquired by the acquisition unit. For example, in the example of FIG. 3, if the difference between the feature amount indicated by the correspondence information and the feature amount indicated by the acquired information is within a predetermined threshold, the authentication unit 44 authenticates the relationship between the user U and the manager of the store R1. The payment information is sent to the payment server 300.

[3. Judgment processing flow]
Here, the procedure of the determination process of the information providing apparatus 10 according to the embodiment will be described using FIG. 7. FIG. 7 is a flowchart illustrating an example of the procedure of the determination process according to the embodiment.

As shown in FIG. 7, the information providing device 10 determines whether or not initial registration of corresponding information has been received from the store terminal (step S101). Here, if it is determined that the initial registration has not been accepted (step S101; No), it is determined whether or not a payment request has been accepted from the terminal device used by the user (step S104). On the other hand, if it is determined that the initial registration has been accepted (step S101; Yes), the information providing device 10 receives code information and acquisition information from the store terminal (step S102). For example, the information providing device 10 receives an image including a two-dimensional code from a store terminal, and acquires code information indicating the two-dimensional code and acquisition information that is information other than the code information included in the image. Subsequently, the information providing device 10 registers the received acquired information as correspondence information in association with the code information (step S103).

Subsequently, the information providing device 10 determines whether a payment request has been received from the terminal device used by the user (step S104). Here, if it is determined that the payment request has not been accepted (step S104; No), the information providing device 10 accepts the initial registration of corresponding information from the store terminal or the payment request from the terminal device used by the user. Wait until.

On the other hand, if it is determined that the payment request has been accepted (step S104; Yes), the information providing device 10 acquires the code information and acquisition information included in the image captured by the terminal device used by the user (step S105). . Subsequently, the information providing device 10 determines whether the correspondence information associated with the code information and the acquired information match (step S106).

Here, if it is determined that the correspondence information and the obtained information match (step S106; Yes), the information providing device 10 authenticates the payment (step S107) and ends the process. On the other hand, if it is determined that the correspondence information and the obtained information do not match (step S106; No), the information providing device 10 notifies the terminal device used by the user that the authentication has failed (step S108), Finish the process.

[4. Modified example]
The embodiments described above are merely examples, and various modifications and applications are possible.

[4-1. About the code]
In the above embodiment, an example was shown in which the code is a two-dimensional code (for example, a QR code (registered trademark), a barcode, etc.), but the code is not limited to such an example, and the code can be used on a terminal used by a user. Any information can be used as long as it can be read by the device. For example, the code may be a personal identification number, a character string (password), or the like.

[4-2. About acquired information〕
In the above-described embodiment, an example in which the acquisition unit 42 acquires brightness information, color information, article information, and frequency information as acquisition information from an image (a still image or a moving image) of a two-dimensional code taken by the terminal device 100. However, the function of the acquisition unit 42 is not limited to this configuration, and various types of information that can be acquired from an image of a two-dimensional code may be acquired as the acquisition information.

For example, the acquisition unit 42 uses various conventional techniques related to human face recognition to acquire the employee's face image included in the image of the two-dimensional code as the acquisition information. Then, the determining unit 43 determines whether the facial image acquired by the acquiring unit 42 matches the facial image of any of the store employees associated with the code information.

The acquisition unit 42 also includes a two-dimensional code, such as a gesture of a store employee or a predetermined pattern output on the screen of an output device installed at the store (for example, the store terminal 200), in the photographed image. Obtain information about the moving object as the acquisition information. Then, the determining unit 43 determines whether the information regarding the moving object acquired by the acquiring unit 42 matches the information associated with the code information.

Further, the acquisition unit 42 acquires random information included in an image of the two-dimensional code as acquisition information. Specifically, the acquisition unit 42 acquires the one-time password issued by the information providing device 10 to the store terminal 200 as the acquisition information. Then, the determining unit 43 determines whether the one-time password acquired by the acquiring unit 42 matches the one issued to the manager of the store corresponding to the code information.

Note that the acquisition unit 42 acquires not only information that can be acquired from an image of a two-dimensional code, but also information that can be acquired by the terminal device 100 when photographing a two-dimensional code (for example, when the terminal device 100 photographs a two-dimensional code). (information acquired by a function of an application started for this purpose) may be acquired as the acquisition information.

For example, when photographing a two-dimensional code, the acquisition unit 42 acquires beacon information received by the terminal device 100 (for example, beacon information transmitted from a transmitter installed in a store) as acquisition information. Then, the determination unit 43 determines whether the beacon information acquired by the acquisition unit 42 matches the beacon information transmitted at the store corresponding to the code information.

Furthermore, when the terminal device 100 photographs a two-dimensional code, the acquisition unit 42 acquires information that can be acquired by various sensors included in the terminal device 100 as acquisition information. Specifically, the acquisition unit 42 collects sound information (for example, audio, environmental sounds such as BGM) collected by the terminal device 100 using a microphone or the like when photographing the two-dimensional code, or converts the sound information. Acquire sound waves as acquisition information. Then, the determining unit 43 determines whether the sound information or the sound wave acquired by the acquiring unit 42 matches the sound information associated with the code information (for example, the sound collected in advance in the store). do.

[5. effect〕
As described above, the information providing device 10 according to the embodiment includes the registration section 41, the acquisition section 42, the determination section 43, and the authentication section 44. The registration unit 41 registers correspondence information regarding the surrounding situation where the code is installed in association with code information indicating the code. The acquisition unit 42 acquires code information indicating a code included in an image taken by a terminal device used by the user, and acquisition information that is information that can be acquired from the image but is other than the code information. do. The determination unit 43 determines whether the code information acquired by the acquisition unit 42 and the correspondence information previously associated with each other match the acquired information acquired by the acquisition unit 42. When the correspondence information and the acquired information match, the authentication unit 44 authenticates the payment between the user and the target person corresponding to the code information acquired by the acquisition unit.

As a result, the information providing device 10 according to the embodiment can authenticate the payment based on the information acquired together with the two-dimensional code, regardless of the terminal device used by the user or the location of the store. To prevent fraudulent payments without sacrificing convenience.

Further, in the information providing apparatus 10 according to the embodiment, for example, the acquisition unit 42 acquires information indicating the brightness of each photographic target included in the image as the acquisition information. Then, the determination unit 43 determines whether or not the acquired information matches the correspondence information indicating the brightness of each photographic target included in the image when the code indicated by the code information is photographed in advance. The acquisition unit 42 also acquires information indicating the color of each photographic target included in the image as acquisition information. Then, the determination unit 43 determines whether or not the acquired information matches the correspondence information indicating the color of each photographed object included in the image when the code indicated by the code information is photographed in advance. The acquisition unit 42 also acquires, as acquisition information, information indicating the color temperature of each photographic target included in the image. Then, the determination unit 43 determines whether or not the acquired information matches the correspondence information indicating the color temperature of each photographic target included in the image when the code indicated by the code information is photographed in advance. The acquisition unit 42 also acquires, as acquisition information, information indicating the illumination mode for each photographic target included in the image. Then, the determining unit 43 determines whether or not the acquired information matches the correspondence information indicating the illumination mode for each photographic target included in the image when the code indicated by the code information is photographed in advance.

Thereby, the information providing device 10 according to the embodiment can authenticate a payment based on various types of information acquired together with the code, thereby improving the accuracy of the authentication of a payment.

The acquisition unit 42 also acquires time zone information indicating the time zone in which the image was photographed. The determination unit 43 then acquires the code indicated by the code information, which is information that can be obtained from an image taken in advance in the time zone indicated by the time zone information, and which indicates information other than the code information indicating the code. Determine whether the information matches. Further, the acquisition unit 42 acquires acquisition information that can be acquired from an image taken by the terminal device after calibration. Then, the determination unit 43 determines whether or not the obtained information matches correspondence information that is previously associated with the code information as information that can be obtained from the image taken after the code indicated by the code information is calibrated. .

Thereby, the information providing apparatus 10 according to the embodiment can perform payment authentication based on information acquired together with the two-dimensional code in various situations, and thus can improve the accuracy of payment authentication.

[6. Hardware configuration]
Further, the information providing apparatus 10 according to each of the embodiments described above is realized by, for example, a computer 1000 having a configuration as shown in FIG. The information providing device 10 will be described below as an example. FIG. 8 is a hardware configuration diagram showing an example of a computer that implements the functions of the information providing device. Computer 1000 has CPU 1100, RAM 1200, ROM 1300, HDD 1400, communication interface (I/F) 1500, input/output interface (I/F) 1600, and media interface (I/F) 1700.

CPU 1100 operates based on a program stored in ROM 1300 or HDD 1400, and controls each part. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started, programs depending on the hardware of the computer 1000, and the like.

The HDD 1400 stores programs executed by the CPU 1100, data used by the programs, and the like. Communication interface 1500 receives data from other devices via communication network 500 (corresponding to network N in the embodiment) and sends it to CPU 1100, and also sends data generated by CPU 1100 to other devices via communication network 500. Send to device.

The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and mouse via an input/output interface 1600. CPU 1100 obtains data from an input device via input/output interface 1600. Further, CPU 1100 outputs the generated data to an output device via input/output interface 1600.

Media interface 1700 reads programs or data stored in recording medium 1800 and provides them to CPU 1100 via RAM 1200. CPU 1100 loads this program from recording medium 1800 onto RAM 1200 via media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. etc.

For example, when the computer 1000 functions as the information providing device 10, the CPU 1100 of the computer 1000 realizes the functions of the control unit 40 by executing a program loaded onto the RAM 1200. Further, each data in the storage device of the information providing device 10 is stored in the HDD 1400. The CPU 1100 of the computer 1000 reads these programs from the recording medium 1800 and executes them, but as another example, these programs may be acquired from another device via a predetermined communication network.

[7. others〕
Some of the embodiments of the present application have been described above in detail based on the drawings, but these are merely examples, and various modifications and variations may be made based on the knowledge of those skilled in the art, including the embodiments described in the disclosure section of the invention. It is possible to carry out the invention in other forms with modifications.

Furthermore, the configuration of the information providing apparatus 10 described above can be changed flexibly, such as implementing some functions by calling an external platform or the like using an API (Application Programming Interface), network computing, or the like.

Further, the "unit" described in the claims can be read as "means", "circuit", etc. For example, the acquisition unit can be read as an acquisition means or an acquisition circuit.

10 information providing device 20 communication unit 30 storage unit 31 correspondence information database 40 control unit 41 registration unit 42 acquisition unit 43 determination unit 44 authentication unit 100 terminal device 200 store terminal 300 payment server

Claims (9)

an acquisition unit that acquires code information indicating a code included in an image taken by a terminal device used by a user, and acquisition information that is information other than the code information that can be acquired from the image;
a determination unit that determines whether or not correspondence information associated in advance with the code information acquired by the acquisition unit matches the acquired information acquired by the acquisition unit ;
The acquisition unit includes:
obtaining time zone information indicating a time zone in which the image was taken;
The determination unit includes:
The acquired information is information that can be obtained from an image taken in advance in the time zone that the time zone information indicates, and that corresponds to information other than the code information that indicates the code, and the acquired information matches. determine whether or not
A determination device characterized by: The acquisition unit includes:
As the acquired information, information indicating the brightness of each photographic target included in the image is acquired,
The determination unit includes:
According to claim 1, it is determined whether the obtained information matches correspondence information indicating the brightness of each photographed object included in an image when a code indicated by the code information is photographed in advance. judgment device. The acquisition unit includes:
As the acquired information, information indicating the color of each photographic target included in the image is acquired,
The determination unit includes:
According to claim 1 or 2, it is determined whether the obtained information matches correspondence information indicating the color of each photographed object included in the image when the code indicated by the code information is photographed in advance. Determination device described. The acquisition unit includes:
As the acquired information, information indicating the color temperature of each photographic target included in the image is acquired,
The determination unit includes:
Claims 1 to 3, characterized in that, when a code indicated by the code information is photographed in advance, it is determined whether or not correspondence information indicating the color temperature of each photographed object included in the image matches the acquired information. The determination device according to any one of these. The acquisition unit includes:
As the acquired information, information indicating an illumination mode for each photographic target included in the image is acquired,
The determination unit includes:
Claims 1 to 4, characterized in that, when a code indicated by the code information is photographed in advance, it is determined whether or not correspondence information indicating an illumination mode for each photographed object included in the image matches the acquired information. The determination device according to any one of these. The acquisition unit includes:
acquiring acquisition information that can be obtained from an image taken by the terminal device after calibration;
The determination unit includes:
It is characterized in that it is determined whether or not the obtained information matches correspondence information that is previously associated with the code information as information that can be obtained from an image taken after calibrating the code indicated by the code information. The determination device according to any one of claims 1 to 5. The claim further comprises: an authentication unit that authenticates payment between the user and the target person corresponding to the code information acquired by the acquisition unit when the corresponding information and the acquired information match. The determination device according to any one of items 1 to 6 . A determination method executed by a determination device, comprising:
an acquisition step of acquiring code information indicating a code included in an image taken by a terminal device used by the user, and acquisition information that is information other than the code information that can be acquired from the image;
a determination step of determining whether or not the code information acquired in the acquisition step and the correspondence information previously associated with the acquisition information acquired in the acquisition step match ;
The acquisition step includes:
obtaining time zone information indicating a time zone in which the image was taken;
The determination step includes:
The acquired information is information that can be obtained from an image taken in advance in the time zone that the time zone information indicates, and that corresponds to information other than the code information that indicates the code, and the acquired information matches. determine whether or not
A determination method characterized by: an acquisition procedure for acquiring code information indicating a code included in an image taken by a terminal device used by a user, and acquisition information that is information other than the code information that can be acquired from the image;
causing a computer to execute a determination procedure for determining whether or not the code information acquired in the acquisition procedure and the correspondence information previously associated with the acquisition information acquired in the acquisition procedure match ;
The acquisition procedure is as follows:
obtaining time zone information indicating a time zone in which the image was taken;
The determination procedure is
The acquired information is information that can be obtained from an image taken in advance in the time zone that the time zone information indicates, and that corresponds to information other than the code information that indicates the code, and the acquired information matches. determine whether or not
A determination program characterized by :

Images