JP2020184209A - Information processing method, information processing device, and information processing program - Google Patents

Abstract

To provide technology accurately detecting illegal settlements in two-dimensional code settlements.SOLUTION: An information processing method includes the steps performed by an information processing device, the steps comprising: acquiring first code image information and first image information that is image information around the first code image; associating and storing the first code image information and the first image information; acquiring second code image information and second image information that is image information around the second code image; and outputting a notification for warning of an illegal settlement using the second code image based on the first image information and the second image information.SELECTED DRAWING: Figure 4

Description

The present disclosure relates to information processing methods, information processing devices, and information processing programs.

In electronic commerce, a method of reading a two-dimensional code (registered trademark) such as a QR code (registered trademark) indicating information related to the transaction (product name, amount, etc.) with a terminal and performing payment processing based on the information contained in the two-dimensional code, that is, two-dimensional Code payment is known (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2006-268302

In two-dimensional code payment, for example, when a two-dimensional code affixed to an article is replaced with a two-dimensional code affixed to another article and the payment is made at a price lower than the actual product price. There is.

An object of the present disclosure is to provide a technique capable of accurately detecting fraudulent payments in two-dimensional code payments.

The information processing method according to the embodiment of the present disclosure includes a step in which the information processing apparatus acquires the first code image information and the first image information which is the image information around the first code image, and the first. The step of associating and storing the code image information with the first image information, the step of acquiring the second code image information and the second image information which is the image information around the second code image, and the above. Based on the first image information and the second image information, a step of outputting a notification warning of fraudulent settlement using the second code image is executed.

It is a figure which shows the structure of the communication system which concerns on one Embodiment of this disclosure. It is a figure which shows an example of the hardware composition of the server and the terminal which concerns on embodiment. It is a figure which shows an example of the block diagram which shows the functional structure of the server and the terminal which concerns on embodiment. It is a figure which shows an example of the sequence of fraudulent settlement detection processing of the communication system which concerns on embodiment. It is a schematic diagram explaining the fraudulent settlement of the first embodiment. It is a figure explaining the determination method of fraudulent settlement in 1st Example. It is a figure which shows an example of the feature amount table used in 1st Example. It is a schematic diagram explaining the fraudulent settlement of the 2nd Example. It is a figure explaining the determination method of fraudulent settlement in the 2nd Example. It is a figure which shows an example of the feature amount table used in 2nd Example.

<Law compliance>
The disclosures described herein, if implemented, shall be made in compliance with the laws and regulations of each country in which this disclosure is implemented. In addition, the disclosures described herein are made with all modifications, substitutions, modifications, alterations, and amendments that can be made by those skilled in the art necessary to comply with national legislation.

A mode for implementing a technique capable of accurately detecting fraudulent payment in the two-dimensional code payment according to the present disclosure will be described with reference to the drawings.

<System configuration>
FIG. 1 is a diagram showing a configuration of a communication system 1 according to an embodiment of the present disclosure. As disclosed in FIG. 1, in the communication system 1, the server 110A and the server 110B are connected to the terminal 120A, the terminal 120B, and the terminal 120C via the network 130.

In the present disclosure, when it is not necessary to distinguish between the server 110A and the server 110B, the server 110A and the server 110B may be expressed as the server 110, respectively.

In the present disclosure, when it is not necessary to distinguish between the terminal 120A, the terminal 120B, and the terminal 120C, the terminal 120A, the terminal 120B, and the terminal 120C may be expressed as the terminal 120, respectively.

In the present disclosure, when it is not necessary to distinguish between the server 110 and the terminal 120, the server 110 and the terminal 120 may be referred to as an information processing device 200, respectively. The number of information processing devices 200 connected to the network 130 is not limited to the example shown in FIG.

The server 110 provides a predetermined service to the terminal 120 used by the user via the network 130. Prescribed services are not limited to, for example, payment services, financial services, electronic commerce services, SNS (Social Networking Service) represented by messaging services using instant messenger, etc., content provision services such as songs, videos, books, etc. including. When the user uses a predetermined service via the terminal 120, the server 110 can provide the predetermined service to one or more terminals 120.

The terminal 120 is, for example, a terminal such as a user's smartphone, and performs a payment service or the like provided by the server 110.

In the present disclosure, the settlement service means a service that allows one or more users to give and receive money or money equivalents. Not limited, but as an example, one-dimensional code (bar code, etc.), two-dimensional code (QR code (registered trademark), etc.) (Hereafter, the one-dimensional code and the two-dimensional code are collectively referred to as "two-dimensional code, etc." .), Short-range wireless communication (NFC (Near Field Communication), BLE (Bluetooth (registered trademark) Low Energy), Wi-Fi (registered trademark), ultrasonic communication, infrared communication, etc.) including. In addition, the fact that the terminal 120 of the user (payer) who pays the price makes a payment by reading a two-dimensional code or the like is expressed as "user-readable code payment" or "MPM (Merchant Presented Mode)" and payment is made. The terminal 120 of the user who performs the payment displays the two-dimensional code or the like, and the terminal 120 of the user (seller, claimant) such as the store who charges the price reads the displayed two-dimensional code or the like to make a payment. This is expressed as "store reading type code payment" or "CPM (Consumer Presented Mode)". The MPM and CPM may be dynamic or static.

If necessary, the terminal used by the user X is expressed as the terminal 120X, and the user information in the predetermined service associated with the user X or the terminal 120X is expressed as the user information X. The user information is user information associated with an account used by the user in a predetermined service. The user information is not limited but, as an example, input by the user or given by a predetermined service, the user's name, the user's icon image, the user's age, the user's gender, the user's address, and the user's hobby. Includes information associated with the user, such as preferences and user identifiers, electronic value (electronic money) balance information associated with the user, and credit card information (credit card number, etc.) associated with the user. Any one or a combination of the above may be used.

The network 130 plays a role of connecting two or more information processing devices 200. The network 130 means a communication network that provides a connection route so that data can be transmitted and received after the terminal 120 connects to the server 110.

One or more parts of the network 130 may be a wired network or a wireless network. The network 130 is not limited to, for example, an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), and a wireless network. LAN (Wireless LAN: WLAN), Wide Area Network (WAN), Wireless WAN (Wireless WAN: WWAN), Metropolitan Area Network (MAN), Part of the Internet, Public Exchange Telephone Network (Public) Switched Telephone Network: Part of PSTN, Mobile Phone Network, ISDNs (Integrated Service Digital Networks), Wireless LANs, LTE (Long Term Evolution), CDMA (Code Division Multiple Access), Bluetooth (Bluetooth®), Satellite It can include communications, etc., or a combination of two or more of these. The network 130 can include one or more networks 130.

The information processing device 200 may be any information processing device as long as it can realize the functions and methods described in the present disclosure.

The information processing device 200 is not limited but, for example, a smartphone, a mobile phone (feature phone), a computer (not limited, for example, a desktop, a laptop, a tablet, etc.), a server device, a media computer platform (not limited, as an example). , Cables, satellite set top boxes, digital video recorders, etc.), handheld computer devices (PDA (Personal Digital Assistant), e-mail clients, etc., not limited), wearable terminals (glasses, not limited, examples, etc.) Includes clock-type devices, etc.), other types of computers, or communication platforms.

<Hardware configuration>
The hardware configuration of the information processing apparatus 200 included in the communication system 1 will be described with reference to FIG. FIG. 2 is a diagram showing an example of the hardware configuration of the information processing apparatus 200 according to the embodiment.

The information processing device 200 includes a processor 201, a memory 202, a storage 203, an input / output interface (input / output I / F) 204, and a communication interface (communication I / F) 205. Each component of the hardware of the information processing apparatus 200 is connected to each other via a bus B, for example, without limitation.

The information processing device 200 realizes the functions and / or methods described in the present disclosure in cooperation with the processor 201, the memory 202, the storage 203, the input / output I / F 204, and the communication I / F 205. To do.

The processor 201 executes a function and a method realized by a code or an instruction contained in a program stored in the storage 203. The processor 201 is not limited, but is, for example, a central processing unit (CPU), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), a microprocessor, a processor core, and a multiprocessor. , ASIC (Application-Specific Integrated Circuit), FPGA (Field Programmable Gate Array), etc., and logic circuits (hardware) formed in integrated circuits (IC (Integrated Circuit) chips, LSI (Large Scale Integration)), etc. Each process disclosed in each embodiment may be realized by a dedicated circuit. Further, these circuits may be realized by one or a plurality of integrated circuits, and a plurality of processes shown in each embodiment may be realized by one integrated circuit. Further, the LSI may be referred to as a VLSI, a super LSI, an ultra LSI, or the like depending on the degree of integration.

The memory 202 temporarily stores the program loaded from the storage 203 and provides a work area for the processor 201. Various data generated while the processor 201 is executing the program are also temporarily stored in the memory 202. The memory 202 includes, but is not limited to, a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.

The storage 203 stores the program. The storage 203 includes, but is not limited to, an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, and the like.

The communication I / F 205 transmits / receives various data via the network 130. The communication may be executed by wire or wirelessly, and any communication protocol may be used as long as mutual communication can be executed. The communication I / F 205 has a function of executing communication with another information processing device via the network 130. The communication I / F 205 transmits various data to another information processing device according to an instruction from the processor 201. Further, the communication I / F 205 receives various data transmitted from other information processing devices and transmits the various data to the processor 201.

The input / output I / F 204 includes an input device for inputting various operations to the information processing device 200 and an output device for outputting the processing result processed by the information processing device 200. The input / output I / F 204 may be integrated with the input device and the output device, or may be separated into the input device and the output device.

The input device is realized by any or a combination of all kinds of devices capable of receiving an input from a user and transmitting information related to the input to the processor 201. The input device includes, but is not limited to, hardware keys such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (operation input via an image), and a microphone (operation input by voice).

The output device is realized by any one of all kinds of devices capable of outputting the processing result processed by the processor 201, or a combination thereof. When the processing result is output as a video or moving image, the output device is realized by any or a combination of all kinds of devices capable of displaying the display data according to the display data written in the frame buffer. To. Output devices include touch panels, touch displays, monitors (not limited to examples, liquid crystal displays, OELD (Organic Electroluminescence Display), etc.), head-mounted displays (HDMs), projection mapping, holograms. Includes devices, speakers (audio output), printers, etc. that can display images, text information, etc. in the air (which may be vacuum). In addition, these output devices may be able to display display data in 3D.

The program of each embodiment of the present disclosure may be provided stored in a computer-readable storage medium. The storage medium can store the program in a "non-temporary tangible medium". Programs include, but are not limited to, software programs and computer programs as examples.

When appropriate, the storage medium may be one or more semiconductor-based or other integrated circuits (ICs) (for example, without limitation, field programmable gate arrays (FPGAs), application-specific ICs (ASICs), etc. ), Hard disk drive (HDD), hybrid hard drive (HHD), optical disk, optical disk drive (ODD), optical magnetic disk, optical magnetic drive, floppy diskette, floppy disk drive (FDD), magnetic It can include tapes, solid drive (SSD), RAM drives, secure digital cards or drives, any other suitable storage medium, or any suitable combination of two or more of these. The storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate.

Further, the program of the present disclosure may be provided to the information processing apparatus 200 via an arbitrary transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program.

Each embodiment of the present disclosure can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

The program of the present disclosure is implemented using, for example, JavaScript (registered trademark), a script language such as Python, C language, Go language, Swift, Kotlin, Java (registered trademark), and the like.

At least a part of the processing in the information processing apparatus 200 may be realized by cloud computing composed of one or more computers.

At least a part of the processing in the information processing apparatus 200 may be performed by another information processing apparatus. In this case, at least a part of the processing of each functional unit realized by the processor 201 may be performed by another information processing device.

<Others>
Unless explicitly stated, the configuration of the determination in the embodiment of the present disclosure is not essential, and a predetermined process is operated when the determination condition is satisfied, or a predetermined process is performed when the determination condition is not satisfied. You may.

In the present disclosure, "at least one of A and B" means "A, B, or both" unless otherwise stated or indicated by context. Furthermore, unless otherwise stated or indicated by context, "a", "an", or "the" shall mean "one or more". Thus, herein, "an A" or "the A" means "one or more A" unless otherwise stated or otherwise indicated by context.

The present disclosure includes all modifications, substitutions, modifications, modifications, or modifications made by those skilled in the art to the embodiments and examples of the present disclosure. Also, the appended claims include all modifications, substitutions, modifications, modifications, or modifications made by those skilled in the art with respect to the embodiments and examples of the present disclosure. Further, the present disclosure includes any combination of one or more features of an embodiment or example in the present disclosure that can be made by one of ordinary skill in the art and one or more features of another embodiment or example in the present disclosure. To do.

In addition, a device or system or device or system component that is adapted, arranged, capable, configured, usable, operational, or operational to perform a particular function. The appended claims reference to is made the device, system, or component so adapted, arranged, capable, configured, enabled, and operational. As long as it can or can operate, it includes the device, system, component, whether or not the device, system, component or its particular function is activated, turned on, or unlocked.

Unless explicitly stated, the present disclosure may obtain the consent of the user in advance or immediately before the implementation of any embodiment or embodiment. In addition, the consent to be obtained may be comprehensive or may be obtained on a case-by-case basis.

<Embodiment>
The embodiment of the present disclosure is an embodiment of detecting fraudulent two-dimensional code payment based on the information of the neighborhood images B1 and B2 (see FIG. 6 and the like) around the two-dimensional code.

According to the embodiment, fraud is detected based on the neighborhood image around the two-dimensional code, which is also taken when the two-dimensional code is photographed for payment. Therefore, fraudulent two-dimensional code payment such as acquisition of position information is performed. There is no need for a procedure to separately acquire special information for detection, and there is an effect that fraudulent payment in two-dimensional code payment can be detected accurately and easily.

<Functional configuration of the embodiment>
The functional configuration of the server 110 and the terminal 120 will be described with reference to FIG. FIG. 3 is a diagram showing an example of a block diagram showing a functional configuration of the server 110 and the terminal 120 according to the embodiment. The functional unit disclosed in FIG. 3 is realized by the cooperation of the processor 201, the memory 202, the storage 203, the input / output I / F 204, and the communication I / F 205 included in the information processing device 200.

(1) Functional configuration of the server
The server 110 includes a reception unit 311, a transmission / reception unit 312, a control unit 313, and a storage unit 314. The function or processing of each functional unit may be realized by machine learning or AI (Artificial Intelligence) to the extent feasible.

The reception unit 311 receives various setting operations and the like from a business operator that operates various services provided by the server 110.

The transmission / reception unit 312 transmits / receives data to / from the terminal 120 according to the instruction of the control unit 313. The transmission / reception unit 312 is, for example, a session for communication with the terminal 120 or the like using HTTPS or the like when the user of the terminal 120 or the like is authenticated by the user ID and the password included in the login request from the terminal 120 or the like. To connect. Then, the communication address of the terminal 120 and the like, the user ID, and the like are stored in association with the ID of the connected communication session. Then, the data is transmitted to the terminal 120 or the like by using the connected communication session.

The control unit 313 performs a process of providing a predetermined service such as a payment service, an electronic coupon distribution service, a financial service, and an electronic commerce service to the user of the terminal 120. The control unit 313 causes the transmission / reception unit 312 to transmit information for controlling the display screen of the terminal 120.

The storage unit 314 stores user information of the terminal 120 and various information such as payment history and attributes of each user. In the present embodiment, the feature amount table 3141 for fraud determination is stored.

(2) Functional configuration of the terminal
The terminal 120 has a reception unit 321, a transmission / reception unit 322, a control unit 323, and a storage unit 324. The function or processing of each functional unit may be realized by machine learning or AI (Artificial Intelligence) to the extent feasible.

The reception unit 321 receives various operations and the like from the user of the terminal 120.

The transmission / reception unit 322 transmits / receives data to / from the server 110 or the like in accordance with the instructions of the control unit 323. The transmission / reception unit 322 connects to the server 110 for a communication session using HTTPS or the like when logging in to the server 110, for example. Then, the communication address and the like of the server 110 are stored in association with the ID of the connected communication session. Then, data is transmitted to the server 110 using the connected communication session.

The control unit 323 performs a process of using a predetermined service such as a payment service, a financial service, and an electronic commerce service provided by the server 110. The control unit 323 controls the display screen of the terminal 120 based on the information received from the server 110 and the like.

The storage unit 324 stores information for using various services such as a payment service provided by the server 110.

<Processing of Embodiment>
The processing of the communication system 1 according to the embodiment will be described with reference to FIG. FIG. 4 is a diagram showing an example of a sequence of fraudulent settlement detection processing of the communication system 1 according to the embodiment. It is assumed that the terminal 120 has been authenticated by the server 110 by using the user's account when communicating with the server 110. Further, in the present embodiment, the terminal 120 includes a POS cash register terminal 120-1 installed in a store and a mobile terminal 120-2 operated by a product purchaser or a store clerk (see FIG. 5 and the like).

In step S1, the control unit 313 of the server 110 stores the feature amount table 3141 for fraud detection of the two-dimensional code payment in the storage unit 314. The feature amount table 3141 includes information on the two-dimensional code related to the two-dimensional code settlement (first code image information) and information on the feature amount of the neighboring image which is image information around the two-dimensional code (first image information). Is associated and stored. The feature amount table 3141 may be created by, for example, registering one or a plurality of data as initial values by the service provider, or the data obtained by capturing the two-dimensional code to be determined by the user of the terminal 120 from the terminal 120 to the server. It may be transmitted to 110 and created using the data received by the server 110. The details of the feature amount table 3141 will be described later with reference to FIGS. 7 and 10.

In step S2, the control unit 323 of the terminal 120 reads the two-dimensional code for payment and acquires the two-dimensional code image. In addition to the image information of the two-dimensional code (second code image information), the two-dimensional code image also includes information (second image information) of nearby images (see FIG. 6 and the like) around the two-dimensional code image.

In step S3, the control unit 323 of the terminal 120 transmits the payment request information including the two-dimensional code image read in step S2 to the server 110 via the transmission / reception unit 322.

In step S4, the control unit 313 of the server 110 analyzes the two-dimensional code image included in the payment request information received from the terminal 120. Specifically, the control unit 313 performs image analysis on the two-dimensional code image, and the identification information (QR_ID) of the two-dimensional code included in the two-dimensional code image and the feature amount of the neighboring image around the two-dimensional code image. Is calculated. The feature amount of a nearby image is a feature amount based on colors that can be extracted from the image. For example, one or more color types having a large proportion, the proportion of colors in the image, the lightness, the brightness, and the colors in the image. Includes average value, specific color position, texture type, etc.

In step S5, the control unit 313 of the server 110 subsequently determines whether or not the payment is fraudulent based on the image analysis result of the two-dimensional code image. Specifically, the control unit 313 refers to the feature amount table 3141 to identify the two-dimensional code identification information (QR_ID) included in the two-dimensional code image and the feature amount of the neighboring image also included in the two-dimensional code image. When the combination with and is not registered, it is determined that the two-dimensional code added to the payment request is illegally used and the payment is illegal. The details of the two-dimensional code fraudulent settlement method based on the neighborhood image will be described later with reference to FIGS. 5 and 8.

If it is determined in step S5 that the payment is fraudulent, in step S6, the control unit 313 of the server 110 warns of the fraudulent payment using the two-dimensional code added to the payment request via the transmission / reception unit 312. The detection notification is transmitted to the terminal 120.

In step S7, the control unit 323 of the terminal 120 indicates that the two-dimensional code related to the payment request transmitted in step S3 is illegally used in response to the receipt of the fraud detection notification in step S6. It is displayed on the display screen of 120.

In step S8, the reception unit 321 of the terminal 120 receives an operation input indicating that the payment is not fraudulent by the user when the user can determine that the payment is not fraudulent payment in response to the display indicating the fraudulent payment in step S7.

In step S9, the control unit 323 of the terminal 120 transmits a notification to the server 110 that it is not fraudulent received in step S8 via the transmission / reception unit 322.

In step S10, the control unit 313 of the server 110 executes the payment process according to the payment request received in step S3 in response to the notification that it is not fraudulent received from the terminal 120.

In step S11, the control unit 313 of the server 110 responds that the information of the two-dimensional code image determined to be fraudulent settlement in step S5 is not fraudulent by the user of the terminal 120 in steps S8 and S9. , The feature amount table 3141 stored in the storage unit 314 is updated so that the two-dimensional code image will not be determined to be invalid in the future.

As a method of updating the feature amount table 3141, for example, the feature amount information of the neighboring image included in the two-dimensional code image acquired in step S2 is additionally registered in association with the two-dimensional code of the feature amount table 3141. Will be done. As a result, data that is not fraudulent settlement is added to the feature amount table 3141, so that the detection accuracy of fraudulent settlement can be improved. The update timing of the feature amount table 3141 may be not only every time the notification that the feature amount table 3141 is not illegal is received, but also when the notification is received a predetermined number of times.

If it is determined in step S5 that the payment is not fraudulent, the processing after step S6 is not performed, and the control unit 313 of the server 110 executes the payment processing according to the payment request received in step S3. After that, the payment completion notification is transmitted to the terminal 120.

Further, if there is no operation input by the user of the terminal 120 in step S8 to the effect that it is not fraudulent, the processing after step S9 is not performed, and the payment processing according to the payment request received in step S3 is canceled. .. It should be noted that the processing after step S8 may not be performed, and the payment processing may not proceed with the display indicating that the payment is fraudulent in step S7.

In the present embodiment, step S1 of FIG. 4 includes "a step of acquiring the first code image information and the first image information which is the image information around the first code image" and "the first code image information". This is an example of "a step of associating and storing the first image information". Step S3 of FIG. 4 is an example of "a step of acquiring the second code image information and the second image information which is the image information around the second code image". Steps S5 and S6 of FIG. 4 are an example of "a step of outputting a notification warning of fraudulent settlement based on the first image information and the second image information".

In the above step S6, when the fraudulent payment is determined once in step S5, the fraudulent payment is detected more than a predetermined number of times in step S5 without immediately sending the fraud detection notification to the terminal 120. In addition, a fraud detection notification may be transmitted. As a result, it is possible to prevent the terminal 120 from transmitting an unnecessary fraud detection notification at the time of erroneous determination.

In the present embodiment, as in steps S7 to S10, when the terminal 120 receives an operation input indicating that the payment related to this notification is not fraudulent, the server 110 cancels the payment. Proceed with payment processing without doing so. As a result, when the server 110 erroneously determines that the payment is fraudulent, the payment can be continued without being interrupted according to the intention of the terminal 120, and the convenience at the time of the erroneous determination can be improved.

In this embodiment, the settlement using the two-dimensional code is illustrated, but the information used for the settlement may be a code other than the two-dimensional code such as a bar code.

Further, in step S3 of FIG. 4, the terminal 120 extracts the identification information of the two-dimensional code included in the two-dimensional code image and the information of the feature amount of the neighboring image without the terminal 120 transmitting the two-dimensional code image. Therefore, it may be configured to transmit only these information. As a result, the size of the information transmitted from the terminal 120 to the server 110 can be reduced.

The image analysis process in step S4 of FIG. 4 and the fraud determination process in step S5 may be performed after the settlement process. In this case, when fraudulent payment is detected, the server 110 stores the information of the customer who made the fraudulent payment, and the customer sends a warning to the store the next time he / she makes a purchase. be able to. This prevents delays in payment processing and makes it possible to detect fraudulent payments.

An example of the processing in the embodiment will be described below. The processing of each of the following examples can be executed in combination with the processing of other examples.

<< First Example >>
The first embodiment is a two-dimensional code payment in which the type of two-dimensional code payment is a type in which a two-dimensional code attached to a product is read by a terminal and payment is made according to the read two-dimensional code. This is an example of detecting fraudulent settlement due to code replacement. According to the first embodiment, fraudulent settlement of two-dimensional code replacement can be easily detected.

<< Processing of the first embodiment >>
FIG. 5 is a schematic diagram illustrating the fraudulent settlement of the first embodiment. FIG. 6 is a diagram illustrating a method for determining fraudulent settlement in the first embodiment. FIG. 7 is a diagram showing an example of the feature amount table 3141A used in the first embodiment.

As shown in FIG. 5, in the normal settlement, the two-dimensional code ID1 attached to the product M1 is photographed by the POS cash register 120-1, transmitted to the server 110, and the settlement process is performed by the server 110.

On the other hand, in fraudulent payment, when the product M1 is expensive, if the two-dimensional code ID2 of the product M2, which is lower than the product M1, is replaced with the product M1 and the payment is fraudulently performed, the expensive product M1 is replaced with the price of the low product M2. You can buy it at.

In order to detect fraudulent settlement due to the replacement of the two-dimensional code of such a product, in the first embodiment, the server 110 refers to the feature amount table 3141A shown in FIG. 7 and refers to the neighborhood image around the two-dimensional code. The presence or absence of fraud is determined based on the feature amount.

In the first embodiment, the feature amount table 3141A shown in FIG. 7 is stored in the storage unit 314 of the server 110. The feature amount table 3141A is registered by associating the information of each item of the product ID, the QR_ID which is the identification information of the two-dimensional code, and the feature amount of the neighboring image. In the example of FIG. 7, a plurality of QR_IDs such as ID1, ID1-1, and ID1-2 are assigned to the high-priced product M1, and a common B1 is assigned to the feature amount of each ID.

For example, in the case of the high-priced product M1, since the neighborhood image B1 appears around the correct two-dimensional code ID1, the feature amount table 3141A is associated with the feature amount (for example, color, texture, etc.) of the neighborhood image B1 and the two-dimensional code ID1. By storing in, the server 110 can determine the combination of the correct two-dimensional code ID 1 and the neighborhood image B1. Similarly, in the case of the low-priced product M2, since the neighborhood image B2 appears around the correct two-dimensional code ID2, the feature amount of the neighborhood image B2 and the two-dimensional code ID2 are linked and stored in the feature amount table 3141A. When these two-dimensional codes are combined with the neighborhood image, the server 110 can determine that the payment is not fraudulent as shown in FIG. 6A.

On the other hand, if the two-dimensional code of the high-priced product is replaced with the two-dimensional code of the low-priced product as shown in FIG. 5, the photographed two-dimensional code ID 2 is used as shown in FIG. 6 (B). On the other hand, the unrelated neighborhood image B1 is captured. In this case, the server 110 can determine that the two-dimensional code ID 2 in the two-dimensional code image and the neighborhood image feature amount B1 are not a combination associated with each other, but that the settlement is fraudulent or there is a possibility of fraudulent settlement.

As described above, in the first embodiment, the server 110 extracts the feature amount of the neighborhood image associated with the two-dimensional code in the two-dimensional code image from the feature amount table 3141A based on the captured two-dimensional code image. However, when the feature amounts of the two are different from those of the neighboring image of the actual image, it is detected that the fraud is caused by the replacement of the two-dimensional code. When the server 110 detects fraudulent payment, the server 110 transmits a fraud detection notification warning of fraudulent payment to the POS cash register 120-1 (store terminal). As a result, the occurrence of fraudulent payment can be promptly notified to the store.

In the comparison of the feature amounts, for example, the similarity of the feature amounts at a specific position in the image is calculated, and when the similarity is equal to or less than a predetermined threshold value, it can be determined that the neighboring images are different. As a result, for example, when the same neighborhood image contains noise such as dust on one side, the similarity can be kept within the allowable range even if the similarity is slightly reduced, and false detection that the neighborhood images are different can be prevented. it can.

As shown in FIG. 5, the terminal for photographing the two-dimensional code may be a terminal other than the POS cash register 120-1 of the store, or a mobile terminal 120-2 used by a store clerk or a purchaser. In this case, when the server 110 detects fraudulent payment, it transmits a fraud detection notification warning of fraudulent payment to the mobile terminal 120-2 that requested the payment. As a result, the occurrence of fraudulent settlement can be promptly notified to the settlement requester.

The POS cash register 120-1 or the mobile terminal 120-2 may perform the fraudulent settlement determination process performed by the server 110. In this case, the fraud detection notification is generated and displayed in the terminal 120 instead of being transmitted by the server 110 to the terminal 120.

<< Second Example >>
In the second embodiment, the type of two-dimensional code payment is a type in which the two-dimensional code assigned to the store is read by a terminal and payment is made according to the read two-dimensional code, so-called MPM (Merchant Presented Mode). In the two-dimensional code payment, it is an example of detecting fraudulent payment using another two-dimensional code. According to the second embodiment, fraudulent payment using another two-dimensional code can be easily detected even in the two-dimensional code payment of MPM.

<< Processing of the second embodiment >>
FIG. 8 is a schematic diagram illustrating the fraudulent settlement of the second embodiment. FIG. 9 is a diagram illustrating a method for determining fraudulent settlement in the second embodiment. FIG. 10 is a diagram showing an example of the feature amount table 3141B used in the second embodiment.

As shown in FIG. 8, in a normal payment, the two-dimensional code ID 1 assigned to the store is photographed by the purchaser's terminal 120-2, transmitted to the server 110, and the payment process is performed by the server 110.

On the other hand, in fraudulent settlement, if the store's two-dimensional code ID1 is replaced with another two-dimensional code ID2 linked to its own account, for example, the purchaser reads the two-dimensional code ID2. When the settlement is made, the settlement amount is credited to the account of a third party instead of the store account, and the settlement amount is illegally exploited.

In order to detect fraudulent payment by replacing the two-dimensional code of such a store, in the second embodiment, the server 110 refers to the feature amount table 3141B shown in FIG. 10 and refers to the two-dimensional code and the feature amount of the neighborhood image. The presence or absence of fraud is determined based on the combination with.

In the second embodiment, the feature amount table 3141B shown in FIG. 10 is stored in the storage unit 314 of the server 110. The feature amount table 3141B is registered in association with information on each item of store information, QR_ID which is identification information of a two-dimensional code, and feature amount of a nearby image. In the example of FIG. 10, a QR_ID called ID1 is assigned to the store A, and the feature amount B1 of the neighborhood image of the place where the two-dimensional code is installed is associated with the store A.

For example, since the neighborhood image B1 appears around the correct two-dimensional code ID1, the feature amount (for example, color, texture, etc.) of the neighborhood image B1 and the two-dimensional code ID1 are linked with the store information and stored in the feature amount table 3141B. If this is done, the server 110 can determine that the payment is not fraudulent as shown in FIG. 9A when the correct two-dimensional code ID1 for the store A and the neighborhood image B1 are combined.

On the other hand, if the correct two-dimensional code ID1 installed in the store A as shown in FIG. 8 is replaced with another two-dimensional code ID2, the store is as shown in FIG. 9B. The two-dimensional code ID 2 that is not associated with the feature amount table 3141B is captured for the neighborhood image B1 associated with A. In this case, the server 110 can determine that the settlement is fraudulent, not the combination in which the two-dimensional code ID 2 in the two-dimensional code image and the neighborhood image feature amount B1 are associated with each other.

As described above, in the second embodiment, the server 110 is associated with the store information of the store in which the two-dimensional code is photographed and the neighborhood image feature amount B1 in the photographed two-dimensional code image. The ID of the two-dimensional code that is out of order is extracted from the feature amount table 3141B, compared with the two-dimensional code of the actual image, and when the two are different, it is detected that fraud is caused by the replacement of the two-dimensional code. .. When the server 110 detects fraudulent payment, the server 110 transmits a fraud detection notification warning of fraudulent payment to the POS cash register 120-1 (store terminal). As a result, even in the MPM two-dimensional code payment for which payment is requested from the purchaser's terminal 120-2, the occurrence of fraudulent payment can be promptly notified to the store.

In the second embodiment, when the terminal 120-2 receives an operation input indicating that the payment related to the notification is not fraudulent in response to the fraud detection notification, the two-dimensional code determined to be fraudulent payment and the data of the neighborhood image feature amount. May be additionally registered in the feature amount table 3141B. That is, the information about the store A registered in the feature amount table 3141B may be updated. Further, in this case, the old two-dimensional code and the data of the neighborhood image feature amount related to the store A registered in the feature amount table 3141B may be deleted.

In the case of MPM payment, it is not fraudulent, for example, the installation location of the 2D code ID1 in the store is changed, the lighting in the store is changed, etc., but the feature amount of the neighborhood image is changed due to the circumstances of the store, so it is fraudulent. It is conceivable that a settlement that is not a fraudulent settlement may be mistakenly determined. Even in such a case, as described above, by updating the information of the store A registered in the feature amount table 3141B to the erroneously determined one, the determination is made by reflecting the change in the feature amount of the neighboring image at the time of subsequent settlement. This can be done, and erroneous judgment can be suppressed.

The mobile terminal 120-2 may perform the fraudulent settlement determination process performed by the server 110. In this case, the fraud detection notification is generated and displayed in the mobile terminal 120-2 instead of being transmitted by the server 110 to the mobile terminal 120-2.

1 Communication system 110 server (information processing device)
311 Reception unit 312 Transmission / reception unit 313 Control unit 314 Storage unit 120 Terminal (information processing device)
120-1 POS cash register terminal (information processing device)
120-2 Mobile terminal 321 Reception unit 322 Transmission / reception unit 323 Control unit 324 Storage unit ID1, ID2 Two-dimensional code B1, B2 Neighborhood image

Claims (12)

Information processing device
A step of acquiring the first code image information and the first image information which is the image information around the first code image, and
A step of associating and storing the first code image information and the first image information, and
A step of acquiring the second code image information and the second image information which is the image information around the second code image, and
An information processing method for executing a step of outputting a notification warning of fraudulent settlement using the second code image based on the first image information and the second image information. The output step is
The information processing method according to claim 1, wherein a notification warning of the fraudulent settlement is output based on the result of image analysis of the first image information and the second image information. The output step is
The information processing method according to claim 2, wherein when the degree of similarity between the first image information and the second image information is equal to or less than a threshold value, a notification warning of the fraudulent settlement is output. The output step is
The information processing method according to any one of claims 1 to 3, wherein a notification warning of fraudulent payment is transmitted to a payment request terminal. The output step is
The information processing method according to any one of claims 1 to 4, wherein a notification warning of the fraudulent settlement is transmitted to the store terminal. The output step is
The information processing method according to any one of claims 1 to 5, wherein a notification warning of the fraudulent settlement is transmitted when fraudulent settlement is detected more than a predetermined number of times. The information processing method according to any one of claims 1 to 6, wherein the payment process is not proceeded when fraud is detected. The information processing method according to any one of claims 1 to 7, wherein the payment process is advanced when there is an operation input indicating that the payment related to the notification is not fraudulent in response to the notification warning the fraudulent payment. .. The information processing method according to claim 8, wherein the second image information is stored in association with the first code image information in response to the operation input. The information processing method according to claim 9, wherein the first image information stored in association with the first code image information is deleted in response to the operation input. The first code image information and the first image information which is the image information around the first code image are acquired, and
The first code image information and the first image information are stored in association with each other.
Acquire the second code image information and the second image information which is the image information around the second code image.
An information processing device having a control unit that outputs a notification warning of fraudulent settlement using the second code image based on the first image information and the second image information. For information processing equipment
A step of acquiring the first code image information and the first image information which is the image information around the first code image, and
A step of associating and storing the first code image information and the first image information, and
A step of acquiring the second code image information and the second image information which is the image information around the second code image, and
An information processing program that executes a step of outputting a notification warning of fraudulent settlement using the second code image based on the first image information and the second image information.

Images