CN111311243A - Code buckling, scanning and scanning method and device suitable for multiple video communication modes - Google Patents

Code buckling, scanning and scanning method and device suitable for multiple video communication modes Download PDF

Info

Publication number
CN111311243A
CN111311243A CN201811513283.4A CN201811513283A CN111311243A CN 111311243 A CN111311243 A CN 111311243A CN 201811513283 A CN201811513283 A CN 201811513283A CN 111311243 A CN111311243 A CN 111311243A
Authority
CN
China
Prior art keywords
payment
image
video communication
mobile payment
scanning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201811513283.4A
Other languages
Chinese (zh)
Inventor
王越
晏成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Inspiry Technology Co Ltd
Original Assignee
Beijing Inspiry Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Inspiry Technology Co Ltd filed Critical Beijing Inspiry Technology Co Ltd
Priority to CN201811513283.4A priority Critical patent/CN111311243A/en
Publication of CN111311243A publication Critical patent/CN111311243A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/325—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices using wireless networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/327—Short range or proximity payments by means of M-devices
    • G06Q20/3276—Short range or proximity payments by means of M-devices using a pictured code, e.g. barcode or QR-code, being read by the M-device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/34—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using cards, e.g. integrated circuit [IC] cards or magnetic cards
    • G06Q20/341—Active cards, i.e. cards including their own processing means, e.g. including an IC or chip
    • G06Q20/3415—Cards acting autonomously as pay-media
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/34—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using cards, e.g. integrated circuit [IC] cards or magnetic cards
    • G06Q20/351—Virtual cards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30—Services specially adapted for particular environments, situations or purposes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/14—Direct-mode setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W84/00—Network topologies
    • H04W84/18—Self-organising networks, e.g. ad-hoc networks or sensor networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Accounting & Taxation (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Cash Registers Or Receiving Machines (AREA)

Abstract

The invention provides a code buckling, scanning and scanning method suitable for multiple video communication modes, which comprises the steps of networking mobile payment equipment which is arranged on a multi-scene configuration sensor and supports the cooperative application of input and printing equipment of a video communication verification circuit, and connecting the mobile payment equipment, an electronic terminal and a server cluster; acquiring parameter data to generate a two-dimensional code image and combining the two-dimensional code image with a video communication waveform image; when the monitoring payment event is triggered and the code scanning and non-contact card swiping payment is supported and the first distance measurement sampling point is monitored, the recognition and the reading are completed through the buckling scanning. The method is used for decoding a two-dimensional code image by combining with an acquired video communication waveform image through a preset algorithm, and extracting the characteristics of the combined image through a depth self-learning algorithm, so that efficient and accurate reading and payment of the combined image are effectively completed in a network distribution environment in which a scene with large environmental parameter change supports code scanning and non-contact card swiping payment. The present disclosure also provides a code scanning device suitable for multiple video communication modes.

Description

Code buckling, scanning and scanning method and device suitable for multiple video communication modes
Technical Field
The disclosure relates to the technical field of mobile payment and the technical field of image recognition, in particular to a code scanning method and a code scanning device suitable for multiple video communication modes.
Background
In the prior art, the cash register modes applied to a plurality of scenes are pos machine card swiping modes, cash modes and the like. The electronic terminal is opened for the payer in a few scenes, static two-dimensional codes provided by a plurality of scenes are scanned (in the process of manufacturing and image acquisition of static payment images, impurities, interference and the like are inevitably mixed in the images, so that the problems of noise, blurring and uneven gray scale exist in the images), information of the two-dimensional codes is read, and payment operation is completed. The cash register mode makes the cash register form single, and because a plurality of scenes are different due to different real environments, for example, under the communication environment of optical fiber video transmission, network video transmission or microwave video transmission, higher requirements are provided for the recognition of the two-dimensional code and the video communication waveform images of different scenes, and even the accuracy and the rapidity of payment. The existing scheme does not have the accuracy, the rapidness, the flexibility and the usability for simultaneously reading two-dimensional codes and video communication waveform image information.
Disclosure of Invention
In order to solve the technical problem in the prior art, the embodiment of the disclosure provides a code sweeping and scanning method and device suitable for multiple video communication modes, wherein mobile payment devices which are arranged in multiple scenes and are provided with at least one sensor and a video communication verification circuit are networked, and the mobile payment devices which are arranged in the multiple scenes and support the cooperative application of input devices and printing devices, an electronic terminal for controlling the mobile payment devices and a server cluster are connected; the method comprises the steps of acquiring data of a plurality of parameters which are sent by a server cluster and are suitable for being recognized and read by the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters; grouping continuous ranging data extracted by combining the generated two-dimensional code image and the acquired video communication waveform image through at least one ranging sensor into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points; when a payment event is monitored to be triggered, whether an initial system of the mobile payment device supports a multi-form payment system or not is judged, wherein the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is used for presetting a single scene and a single payment position and combining a payment system formed by a virtual value storage card or a real value storage card, and the open payment system is used for presetting at least two scenes and at least two payment positions and combining a payment system formed by the virtual value storage card or the real value storage card; if the multi-form payment system is supported and the first distance measurement sampling point is monitored, the reading operation finished by a user in a code buckling and scanning mode is started and received.
In a first aspect, an embodiment of the present disclosure provides a code scanning and deducting method applicable to multiple video communication modes, including the following steps: the method comprises the steps that mobile payment equipment which is arranged in a plurality of scenes and is provided with at least one sensor and a video communication verification circuit is networked, the mobile payment equipment which is arranged in the plurality of scenes and supports the cooperative application of the input equipment and the printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster are connected, wherein the mobile payment equipment which supports the cooperative application of the input equipment and the printing device comprises at least one sensor, and the at least one sensor is used for collecting and detecting a plurality of environment parameters of the mobile payment equipment which is arranged in the plurality of scenes and supports the cooperative application of the input equipment and the printing device; acquiring data of a plurality of parameters which are sent by the server cluster and are suitable for being recognized and read by the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters; grouping continuous ranging data extracted by combining the generated two-dimensional code image and the acquired video communication waveform image through at least one ranging sensor into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points; when a payment event is monitored to be triggered, judging whether an initial system of the mobile payment device supports a multi-form payment system or not, wherein the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is combined with a payment system formed by a virtual value storage card or a real value storage card in a preset single scene and a preset single payment position, and the open payment system is combined with the payment system formed by the virtual value storage card or the real value storage card in a preset at least two scenes and at least two payment positions; and receiving the reading operation finished by the user in a code buckling and scanning mode if the multi-form payment system is supported and the first distance measurement sampling point is monitored.
In a second aspect, the disclosed embodiments provide a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps of the method described above.
In a third aspect, the disclosed embodiments provide a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method described above when executing the program.
In a fourth aspect, an embodiment of the present disclosure provides a code scanning device for multiple video communication modes, where the device includes: the system comprises a networking and connecting module, a video communication verification circuit and a mobile payment device, wherein the networking and connecting module is used for networking the mobile payment device which is arranged in a plurality of scenes and is provided with at least one sensor and the video communication verification circuit, and connecting the mobile payment device which is arranged in the plurality of scenes and supports the cooperative application of the input device and the printing device, an electronic terminal for controlling the mobile payment device and a server cluster, wherein the mobile payment device which supports the cooperative application of the input device and the printing device comprises at least one sensor which is used for collecting and detecting a plurality of environmental parameters of the mobile payment device which is arranged in the plurality of scenes and supports the cooperative application of the input device and the printing device; the acquisition and image generation module is used for acquiring data of a plurality of parameters which are sent by the server cluster and are suitable for being recognized and read by the mobile payment equipment in real time and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters; the classification module is used for grouping continuous ranging data extracted by combining the generated two-dimensional code image with the acquired video communication waveform image through at least one ranging sensor into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points; the system comprises a judging module, a payment processing module and a payment processing module, wherein the judging module is used for judging whether an initial system of the mobile payment device supports a multi-form payment system when a payment event is triggered, the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is combined with a payment system formed by a virtual value card or a real value card in a mode of presetting a single scene and a single payment position, and the open payment system is combined with a payment system formed by a virtual value card or a real value card in a mode of presetting at least two scenes and at least two payment positions; and the deducting and scanning reading module is used for receiving the reading operation finished by the user in a deducting and scanning code mode if supporting the multi-form payment system and monitoring the first distance measurement sampling point.
The invention provides a code deducting and scanning method and a code deducting and scanning device suitable for multiple video communication modes, wherein mobile payment equipment which is arranged in multiple scenes and is provided with at least one sensor and a video communication verification circuit is networked, and the mobile payment equipment which is arranged in the multiple scenes and supports the cooperative application of input equipment and a printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster are connected; the method comprises the steps of acquiring data of a plurality of parameters which are sent by a server cluster and are suitable for being recognized and read by the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters; grouping continuous ranging data extracted by combining the generated two-dimensional code image and the acquired video communication waveform image through at least one ranging sensor into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points; when a payment event is monitored to be triggered, whether an initial system of the mobile payment device supports a multi-form payment system or not is judged, wherein the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is used for presetting a single scene and a single payment position and combining a payment system formed by a virtual value storage card or a real value storage card, and the open payment system is used for presetting at least two scenes and at least two payment positions and combining a payment system formed by the virtual value storage card or the real value storage card; and if the multi-form payment system is supported and the first distance measurement sampling point is monitored, starting and receiving the reading operation finished by the user in a buckling and scanning mode. The method comprises the steps of firstly, networking is carried out, aiming at the combination of a two-dimensional code image and a video communication waveform image, rough segmentation and secondary segmentation are carried out on the two-dimensional code image and the video communication waveform image by adopting an Otsu algorithm, the segmentation operation suitable for the two-dimensional code image and the video communication waveform image combination image is completed through shape testing on the result obtained after the secondary segmentation operation, rapid feature extraction can be carried out on the two-dimensional code image and the video communication waveform image combination image through deep learning, after payment information sent by a server is received, the combination image is intercepted and taken as a payment image, when a payment event is monitored to be triggered, whether an initial system of the mobile payment device supports a multi-form payment system or not is judged, and if the multi-form payment system is supported and a first distance measurement sampling point is monitored, the recognizing and reading operation completed by. In addition, still accomplish the payment demonstration through the sharing window of liquid crystal window and light guide plate window, can also gather and detect even through the sensor and lay a plurality of environmental parameter at the mobile payment equipment of many scenes, have played the beneficial effect that the technique supported to accurate and swift completion two-dimensional code image recognition and even subsequent payment. In addition, the operation of image recognition and reading can be efficiently, accurately and quickly realized aiming at the combined image of the two-dimensional code image and the video communication waveform image under the networking environment supporting the multi-form payment system based on a plurality of scene conditions, so that the subsequent payment operation can be quickly, efficiently and flexibly completed, and the system has safety and applicability.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings needed to be used in the description of the embodiments are briefly introduced as follows:
FIG. 1 is a flowchart illustrating steps of a method for code scanning and deduction applicable to multiple video communication modes according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for code scanning and deduction in accordance with another embodiment of the present invention; and
fig. 3 is a schematic structural diagram of a code scanning and deducting apparatus suitable for multiple video communication modes according to an embodiment of the present invention.
Detailed Description
The present application will now be described in further detail with reference to the accompanying drawings and examples.
In the following description, the terms "first" and "second" are used for descriptive purposes only and are not intended to indicate or imply relative importance. The following description provides embodiments of the disclosure, which may be combined or substituted for various embodiments, and this application is therefore intended to cover all possible combinations of the same and/or different embodiments described. Thus, if one embodiment includes feature A, B, C and another embodiment includes feature B, D, then this application should also be considered to include an embodiment that includes one or more of all other possible combinations of A, B, C, D, even though this embodiment may not be explicitly recited in text below.
In order to make the objects, technical solutions and advantages of the present invention more clearly understood, the following describes in detail a specific implementation of a method and an apparatus for code scanning and deducting applicable to multiple video communication modes, by way of example, with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, a schematic flowchart of a code scanning and deducting method suitable for multiple video communication modes in an embodiment includes the following steps:
102, networking the mobile payment equipment which is arranged in a plurality of scenes and is provided with at least one sensor and a video communication verification circuit, and connecting the mobile payment equipment which is arranged in the plurality of scenes and supports the cooperative application of the input equipment and the printing device, the electronic terminal for controlling the mobile payment equipment and the server cluster. The mobile payment equipment supporting the cooperative application of the input equipment and the printing device comprises at least one sensor, and the at least one sensor is used for collecting and detecting a plurality of environment parameters of the mobile payment equipment supporting the cooperative application of the input equipment and the printing device and arranged in a plurality of scenes. When the collected and monitored plurality of environmental parameters of the mobile payment device are larger than the preset plurality of environmental parameters, the mobile payment device can complete reminding operation through the internal master controller. The reminding operation includes but is not limited to an acousto-optic reminding or an acoustic buzzer reminding.
Further, it should be noted that the sensors in the snap-and-sweep code scanning method applicable to various video communication modes proposed by the present disclosure include, but are not limited to, an optical sensor, a linear displacement sensor, an angular displacement sensor, and a temperature and humidity sensor. Therefore, the usability of the electronic terminal under the real-time operating system under the condition of recognizing, reading and paying of the mobile payment device with the multiple sensors is improved.
In addition, it should be noted that the mobile payment device may be a spine type mobile payment device configured with a common window of the liquid crystal window and the light guide plate window, and includes a code scanning lamp bowl. Specifically, the common window of the liquid crystal window and the light guide plate window specifically comprises a common window main body; a fixed window is arranged on the main body; the fixed window comprises a first characteristic window and a second characteristic window which are arranged in a crossed manner; at least one fixing device is arranged on each of the first characteristic window and the second characteristic window. The fixing device comprises a clamping hook and a clamping groove; the clamping hooks and the clamping grooves are respectively arranged on two opposite sides of the first characteristic window or the second characteristic window, and the liquid crystal window or the light guide plate window can be fixed through the clamping hooks after being clamped through the clamping grooves. In addition, the fixing device comprises hooks arranged in pairs, and each pair of hooks is respectively arranged on two opposite sides of the first characteristic window or the second characteristic window. The clamping hook comprises a fixed connecting part and a clamping part; the fixed connecting part is fixedly connected with the common window main body; the clamping portion is fixedly arranged on one side of the fixed connecting portion. One side that main part was kept away from to joint portion is provided with the slip-in inclined plane, can make things convenient for the entering of light guide plate window or liquid crystal window. The side face of the clamping part close to the common window, namely one side of the light panel window or the liquid crystal window main body is vertical to the fixed connecting part. The fixed connecting part is made of elastic material. On different hooks, the distances between the clamping parts and the common window main body are different. The first characteristic window and the second characteristic window are coaxially arranged. A third characteristic window is also included; the third characteristic window is respectively communicated with the first characteristic window and the second characteristic window in a cross way; at least one fixing device is arranged on the third characteristic window.
In addition, the input device is an input keyboard which is cooperated with a desktop computer, or an input keyboard of a PC all-in-one machine, or a digital function keyboard with a calculation function and an auxiliary payment operation function. Printing device is the printer, specifically includes: the paper feeding machine comprises a machine body, wherein a paper feeding inlet and a printing outlet are arranged, a thermal printing module is arranged in the machine body, at least one low-temperature cooling cavity is arranged between the paper feeding inlet and the thermal printing module, and a laminating module, a cold pressing module and a cutting module are sequentially connected between the thermal printing module and the printing outlet through a transmission mechanism. Specifically, the at least one low-temperature cooling cavity is used for reducing the surface temperature of the paper by using cold air; the thermal printing module is used for printing paper and transmitting the printed paper to the film covering module; the film laminating module is used for receiving the paper transmitted by the thermal printing module, laminating the paper and transmitting the paper subjected to film laminating to the cold pressing module; the cold pressing module is used for receiving the paper transmitted by the film covering module, carrying out cold pressing on the paper on the surface of the film covering module and transmitting the cold-pressed paper to the cutting module; the cutting module is used for receiving the paper conveyed by the cold pressing module, cutting the paper according to the specification, and conveying the cut paper to the printing outlet. In addition, a low-temperature cooling cavity is arranged between the thermal printing module and the film covering module. In addition, still be provided with interconnect's display module, controller on the organism, thermal-sensitive printing module, tectorial membrane module, the module of colding pressing, tailor the module and all be connected with the controller and give the controller with operating condition, and the controller gives display module with operating condition transmission.
In one embodiment, the connecting the mobile payment device supporting the cooperative application with the input device and the printing device, the electronic terminal controlling the mobile payment device, and the server cluster, which are arranged in a plurality of scenes, comprises: connecting at least one mobile payment device arranged in a plurality of scenes with a cloud server cluster through WIFI; and connecting at least one mobile payment device arranged in a plurality of scenes with an electronic terminal for controlling the mobile payment device through Bluetooth connection. In addition, at least one mobile payment device arranged in a plurality of scenes can be connected with the electronic terminal for controlling the mobile payment device through wired connection. Therefore, the diversity and the multi-selectivity of the networking layout are improved.
And 104, acquiring data of a plurality of parameters which are sent by the server cluster and are suitable for payment of the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters.
In addition, it should be noted that the two-dimensional code image may be generated by combining the data of a plurality of parameters with the product code. Further, acquiring setting information required in the two-dimensional code; converting the acquired setting information into a binary file; carrying out information segmentation processing required by a structural link mode on the converted binary file to generate a plurality of different binary information with structural link characteristic characters, wherein the number of segments in the information segmentation processing required by the structural link mode on the converted binary file can be set by two-dimensional code numerical values in a range of 2-32 according to the size and application of set information; the binary file is disassembled into a plurality of corresponding parts within the range of 2-32, and corresponding start characters and end characters are respectively added before and after the binary file of each part which is disassembled; providing original binary coding information which is coded one by one for a coding part corresponding to each split part; a plurality of binary information which are different and have structural link characteristic characters are coded by two-dimensional codes which are encrypted or not one by one and are correspondingly sequenced, then information in commodity codes is obtained by combination, information conversion, encryption and sequencing are carried out according to the principle, and finally a plurality of two-dimensional code images which are sequenced according to a certain sequence are formed.
In one embodiment, the method for scanning and deducting codes applicable to multiple video communication modes provided by the present disclosure further includes: selecting a plurality of two-dimensional code images as training sample sets, and judging the number of the training sample sets; if the number of the training sample sets is insufficient, amplifying the sample sets to a preset number range; creating a CNN network, and initializing each parameter value of the CNN and each parameter value of the SVM; creating a Gabor filter and applying to the sample image IiExtracting the dimensions of theta-0, pi/8, pi/4, 3 pi/8, pi/2, 5 pi/8, 3 pi/4 and 7 pi/8, f-0, f-1, f-2, f-3 and f-4 to generate 40 characteristic maps; using 9-9 grid to reduce the dimension of feature map with 70-70 size to 8-8, connecting the first positions of feature map to form a feature vector Xi1＝[x11,x12,…x1,m](ii) a For the same sample image I according to the size of batch valueiSequencing and inputting the created CNN network, and calculating the output of each convolution layer and each pooling layer in the hidden layer; wherein, the output of the pooling layer is used as a CNN network extraction characteristic part Xi2＝[x21,x22,…x2,n]。
Suppose that the strong features of all samples are X1＝[x11,x12,…x1,M]The characteristic automatically extracted by the CNN network is X2＝[x21,x22,…x2,N]And for the feature vector X1、X2Carrying out standardization processing and serial fusion to obtain a fusion characteristic W ═ W1,w2,…,wM+N)＝(αX1,βX2). Using PCA method to reduce dimension of W and obtaining final fusion characteristic vector W*And will fuse the feature vectors W*Inputting the training data into the SVM to train to reach the preset range error or train to reach the preset maximum iterative training generation times. Therefore, good algorithm technical support is provided for automatically extracting the characteristics of the two-dimension code image to quickly recognize and read the two-dimension code subsequently.
Further, the code scanning and deducting method applicable to multiple video communication modes according to the present disclosure further includes: intercepting a generated combined image of the two-dimensional code image suitable for the mobile payment equipment and the video communication waveform image, and dividing the payment image after the combined image is intercepted as the payment image; according to the Otsu algorithm, performing rough segmentation operation on the region of interest in the divided payment image, wherein the Otsu algorithm is to divide the original image into two images, namely a foreground image and a background image, by using a threshold value. Specifically, the prospect is: points, mass moments and average gray levels of the foreground under the current threshold are represented by n1, csum and m 1; background: the number of points, the mass moment and the average gray level of the background under the current threshold are represented by n2, sum-csum and m 2. When the optimal threshold is taken, the difference between the background and the foreground is the largest, and the key is how to select a standard for measuring the difference, namely an Otsu algorithm, namely the maximum between-class variance, which is represented by sb, and the maximum between-class variance which is represented by fmax. Further, regarding the sensitivity of Otsu's algorithm to noise and target size, it only produces better segmentation effect on images with a single peak between classes variance. When the size ratio of the target to the background is very different, the inter-class variance criterion function may present double peaks or multiple peaks, which is not good, but the greater amount of algorithm is the least time-consuming. Further, the formula for the Otsu algorithm is derived as: recording t as a segmentation threshold of the foreground and the background, wherein the number of foreground points accounts for w0 of the image proportion, and the average gray level is u 0; the number of background points is w1 in the image scale, and the average gray scale is u 1. The total average gray scale of the image is: u-w 0 u0+ w1 u 1. The variance of the foreground and background images can be expressed by the following formula:
g (w 0 (u0-u) (u0-u) + w1 (u1-u) (u1-u) (w 0) w1 (u0-u1) (u0-u 1). It should be noted that the above formula is a variance formula. The formula for g can be referred to in probability theory, i.e. the expression for sb as described below. When the variance g is maximum, the difference between the foreground and the background at this time can be considered as maximum, and the gray level t at this time is the optimal threshold sb — w0 — w1 (u1-u0) (u0-u 1).
Further, performing secondary segmentation on the roughly segmented payment image by using an active contour model of the gradient vector flow; and completing the segmentation operation suitable for the payment image by shape testing on the result obtained after the secondary segmentation operation.
Further, it should be noted that dividing the payment image includes: selecting a segmentation channel based on a statistical rule of payment image data of a training sample; selecting a segmentation threshold value in a segmentation channel, and performing foreground and background segmentation on the payment image; and analyzing a communication region according to the segmented foreground pixels and background pixels to obtain a coding region meeting the conditions, wherein the coding region meeting the conditions is divided into payment image subblocks in a preset row and preset column dividing mode, and the preset row and the preset column are equivalent numerical values. Thereby providing the necessary data basis for subsequent rapid recognition of the payment image.
Further, selecting the split channel based on statistical rules of the payment image data of the training samples comprises: based on the statistical rules of the payment image data of the training samples, the distribution conditions of the image values in different color channels are obtained, and the color channel with the largest image value variance is obtained from the distribution conditions to form a segmentation channel. In addition, it should be further noted that selecting a segmentation threshold in a segmentation channel, and performing foreground and background segmentation on the payment image includes: obtaining a segmentation threshold value through a minimization algorithm in the Dajin algorithm; acquiring an image pixel value of a payment image; and performing dichotomy segmentation according to the image pixel value and the segmentation threshold value to obtain the foreground and the background. Further, it should be noted that, performing bisection segmentation according to the image pixel value and the segmentation threshold, and acquiring the foreground and the background includes: acquiring a region of which the image pixel value is higher than a segmentation threshold value as a foreground; and acquiring a region of which the image pixel value is lower than or equal to the segmentation threshold as a background.
Further, performing connected region analysis according to the segmented foreground pixels and background pixels, and acquiring a coding region meeting the conditions includes: clustering the segmented foreground pixels and background pixels to form a communication area; and selecting the area with the largest size and meeting the prior position information in the communication area to form a coding area meeting the conditions, and outputting the coding area meeting the conditions. Further, it should be noted that the performing of the segmentation operation suitable for the payment image by the shape test on the result obtained after the secondary segmentation operation includes: and completing the graph segmentation operation suitable for the payment image according to the result obtained after the secondary segmentation operation through an area test, wherein the area test is to judge whether the number of the pixel points in the region of interest meets the pixel point threshold interval of a preset normal coding area. Furthermore, it should be noted that the performing of the segmentation operation applicable to the payment image by the shape test on the result obtained after the secondary segmentation operation includes: completing the graph segmentation operation suitable for the payment image by a simple malformation degree calculation formula gamma l/N on the result obtained after the rough segmentation operation through a malformation degree testpCalculating the degree of deformity of the region of interest, wherein l is the perimeter of the region of interest, and N ispThe number of pixel points in the region of interest is counted; presetting a high threshold gamma of degree of deformityT(ii) a When gamma is less than or equal to gammaTJudging that the result obtained after the rough segmentation operation passes the deformity degree test; when gamma > gammaTAnd then, carrying out secondary rough segmentation operation on the region of interest by the segmentation method of the active contour model based on the gradient vector flow, and completing the segmentation operation suitable for the payment image by shape testing on the result obtained after the secondary rough segmentation operation.
And 106, grouping continuous ranging data extracted by combining the generated two-dimensional code image with the video communication waveform image acquired by the at least one ranging sensor into a plurality of data groups according to the adjacent relation of the corresponding sequences, and classifying the ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points. In addition, the video communication waveform image includes, but is not limited to, a video communication waveform image in an optical fiber transmission video communication environment, a video communication waveform image in a network transmission video communication environment, a video communication waveform image in a microwave transmission video communication environment, and a video communication waveform image in a broadband co-cable transmission video communication environment.
It should be noted that, the specific steps of combining the two-dimensional code image and the acquired video communication waveform image are as follows: acquiring a two-dimensional code image to be fused and a video communication waveform image; determining an alpha image of the two-dimensional code image; adjusting the transparency of the two-dimensional code image through the alpha image to obtain a foreground image; adjusting the transparency of the video communication waveform image through the alpha image to obtain a background image; and fusing the foreground image and the background image. Further, before acquiring the two-dimensional code image to be fused and the video communication waveform image, the method further comprises: and adjusting the size of the two-dimensional code image or the video communication waveform image so that the two-dimensional code image is superposed at the preset position of the video communication waveform image.
Further, determining an alpha image of the two-dimensional code image includes: determining an alpha image of the two-dimensional code image by an image coding processing method; determining an alpha image of the two-dimensional code image by the image coding processing method comprises the following steps: reading the two-dimensional code image through a first OpenCV function to convert the two-dimensional code image into a first matrix; separating the first matrix through a second OpenCV function to obtain an alpha image channel matrix; and determining an alpha image according to the alpha image channel matrix. Further, adjusting the transparency of the two-dimensional code image through the alpha image to obtain a foreground image, comprising: separating the first matrix through a second OpenCV function to obtain a first RGB image channel matrix; point-multiplying the first RGB image channel matrix and the alpha image channel matrix through a third OpenCV function to obtain a foreground matrix; and determining a foreground image according to the foreground matrix. In addition, it should be further noted that, adjusting the transparency of the video communication waveform image through the alpha image to obtain the background image includes: calculating an alpha pixel inverse matrix; reading a video communication waveform image through a first OpenCV function to convert the video communication waveform image into a second matrix; separating the second matrix through a second OpenCV function to obtain a second RGB image channel matrix; point-multiplying the second RGB image channel matrix and the alpha pixel inverse matrix through a third OpenCV function to obtain a background matrix; and determining a background image according to the background matrix. Further, fusing the foreground image and the background image, comprising: adding the foreground matrix and the background matrix to obtain a fusion image matrix; and merging the fused image matrix through a fourth OpenCV function to obtain a fused image.
In addition, it should be further noted that classifying the ranging data points in each data group to be divided into a first ranging sample point and a second ranging sample point includes: one or more distance measurement data points are selected from each data group according to a selection rule to serve as first distance measurement sampling points, the rest distance measurement data points serve as second distance measurement sampling points, and meanwhile, the same number of key distance measurement sampling points are contained in each data group. It should be noted that the selection rule includes at least any one of the following: selecting a range data point of an effective range measurement from each data set as a first range sampling point, wherein the effective range measurement satisfies the following condition: reading data exceeding a preset distance, measuring a target distance or measuring a signal within a preset range; and determining the distance between each data group and other ranging data points as ranging data points exceeding a preset distance threshold value to serve as first ranging sampling points.
And 108, when the payment event is monitored to be triggered, judging whether the initial system of the mobile payment device supports a multi-form payment system. The multi-form payment system supports code scanning payment and non-contact card swiping payment, and comprises a closed payment system and an open payment system. The closed payment system is a payment system which is formed by presetting a single scene, a single payment position and combining a virtual value storage card or a real value storage card; the open payment system is a payment system which is formed by presetting at least two scenes and at least two payment positions and combining a virtual stored value card or a real stored value card.
Further, it is understood that a closed payment system, such as a savings system in a retail store, may be used by a consumer to save money for later use, based on a stored value card (virtual or physical) that can only be held back at one store, and a mobile application may be deployed to allow the consumer to hold back the stored value. When the system is used, the QR code or the bar code is displayed at a point of sale, a user can store the value of the card infinitely, only money which is wanted to be spent in a specific merchant is stored, the financial information and the bank account exposure of the user are avoided, and the system is also an effective mode for arranging budget for specific types of consumption for the user. Such as groceries or restaurants, merchants typically combine customer loyalty with a closed payment system, such as a closed payment card, to keep customers back streaming. In addition, open payment systems, such as a savings system in a retail store, a savings system in a restaurant or grocery store, where the consumer may have a deposit for later use, may be based on a stored value card (virtual or real) that can be held back at multiple stores, and a mobile application may be deployed to allow the consumer to hold back the stored value. When the method is used, the QR code or the bar code is displayed at a point of sale, a user can store the value of the card infinitely and only stores money which the user wants to spend in a specific merchant, so that the compatibility and the data sharing of the financial information and the bank account of the user in a plurality of payment scenes and payment positions are facilitated, and the method is an effective way for the user to arrange budget for specific types of consumption. Such as groceries or restaurants, merchants typically combine customer consumption replacement with an open payment system, such as an open payment card, to allow customers to consume back-streams.
And step 110, receiving the recognition operation finished by the user in a code buckling, scanning and scanning mode if the multi-form payment system is supported and the first distance measurement sampling point is monitored. In addition, it should be noted that the code scanning and deducting method applicable to multiple video communication modes provided by the present disclosure further includes: and payment display is completed through a common window of the liquid crystal window and the light guide plate window. From this, the convenience and the ease of use of payment after through accurate and swift recognition two-dimensional code have been improved. Note that, the common window of the liquid crystal window and the light guide plate window is used to display a specific payment amount and a payment status (the payment status includes payment in progress, payment success or payment failure). In addition, it should be noted that, when the common window of the liquid crystal window and the light guide plate window is not used for payment display, the common window is used for playing the advertisement information pushed by the cloud server and the propaganda content of the scene where the common window is located. Therefore, the beneficial effects that the shared window of the liquid crystal window and the light guide plate window is multifunctional, flexible and efficient to operate and display payment are achieved.
Specifically, if support the multi-form payment system and when monitoring first range finding sampling point, the recognition operation that the receiving user accomplished through deducting and scanning the sign indicating number mode includes: establishing a mapping relation between the characteristics of the cash register commodity and the price of the cash register commodity; according to the mapping relation, the commodity price in each commodity and the price of the commodity corresponding to the current payment image are obtained; and finishing the cash register operation according to the price of the commodity corresponding to the current payment image. And obtaining the commodity price of each commodity according to the mapping relation, accumulating the commodity prices, and obtaining the price of the commodity corresponding to the current payment image. It can be understood that the prices of the accumulated commodities are pre-stored, and the prices of the commodities can be quickly analyzed and obtained through deep learning according to historical data of user shopping. It should be noted that, in order to increase the user experience, the data of the cash register operation and the completion status are displayed. In addition, it should be noted that the code scanning mode is that the electronic terminal is held by a user, and the display screen of the electronic terminal and the two-dimensional code scanning window of the mobile payment device are positively oriented, so that the code scanning mode is a novel payment interaction mode for the user to hold the electronic terminal and the mobile payment device, and the flexibility and the usability of the user in payment are improved. The technical field personnel can understand that the built-in binocular camera or at least one sensor of mobile payment equipment can be effectively induced by the way of sweeping the code by deducting and sweeping, and technical support is provided for efficient payment.
In one embodiment, it should be noted that the method for scanning and scanning codes for multiple video communication modes according to the present disclosure further includes: after the payment event is monitored to be triggered, when the electronic terminal is charged, deleting the payment image from the picture library, and setting a default picture in a built-in system of the electronic terminal as a prompt image; and when the current electric quantity of the electronic terminal is lower than a preset electric quantity threshold value, setting a default picture in a built-in system of the electronic terminal as a prompt image. The prompt image is a power-off low-power prompt image of the mobile payment device. In addition, the method further comprises the following steps: the method comprises the steps of obtaining the illumination intensity of a screen of the electronic terminal and the illumination intensity reflected by the screen of the electronic terminal in a preset time period, and constructing a screen illumination intensity database aiming at the electronic terminal and a screen reflection illumination intensity database aiming at the electronic terminal. Therefore, payment operation can be completed quickly and accurately by adapting corresponding illumination intensity of different mobile payment equipment models according to different scenes.
In order to more clearly and accurately understand and apply the method of the present disclosure for a swipe code scan, the following example is performed with reference to fig. 2, and it should be noted that the scope of the present disclosure is not limited to the following example.
Specifically, the steps 201 to 208 are sequentially: receiving a plurality of images; dividing the image into N × N sub-blocks, performing rough segmentation operation through an Otsu algorithm, judging whether the region of interest conforms to the basic coding form, and if the region of interest conforms to the basic coding form, sending the image of the region of interest to a preset feature model to complete feature extraction of the payment image; if the region of interest does not accord with the basic coding form, performing secondary segmentation operation on the active contour model based on the gradient vector flow, and then judging whether the region of interest accords with the basic coding form, if so, sending the image of the region of interest to a preset feature model to finish feature extraction of the payment image; and if the interested region does not conform to the basic form of the code, removing impurities in the payment image.
It is understood that the received payment image is divided; according to the Dajin algorithm, performing rough segmentation operation and secondary segmentation operation on the region of interest in the divided payment image; and completing the segmentation operation suitable for the payment image according to the result obtained after the secondary segmentation operation through shape testing. Specifically, for a payment image, the payment image is roughly segmented by adopting an Otsu algorithm and secondarily segmented by an active contour model of a gradient vector flow to obtain the payment image which is free of noise and convenient to read; the results of the above segmentation were then subjected to shape testing.
It should be noted that the test conditions are: and (6) area testing. Number N Of pixels in ROI (Region Of Interest)pI.e. whether the ROI area corresponds to the range of the normal coding area [ N ]min,Nmax]Within; and (5) testing the degree of deformity. Calculating the formula gamma as l/N by simple malformation degreepCalculating the malformation degree of the ROI region, wherein l is the perimeter of the ROI and is provided with a high malformation degree threshold value gammaTWhen gamma is less than or equal to gammaTThe test passed. Further, if the test condition passes, the ROI is a payment image and enters a feature extraction module; if the ROI region that does not pass the test condition, i.e., the pay image with noise or foreign matter, is possible, the segmentation method based on the active contour model of the gradient vector flow performs a secondary segmentation on the ROI region, and then performs a shape test on the secondary segmentation result, with the test condition being as described above. Wherein, as can be understood by those skilled in the art, the ROI is an impurity when the test is not passed, and is directly discarded; and the ROI passing the test is a payment image, and a preset feature extraction module is used for carrying out feature extraction on the payment image.
As will be understood by those skilled in the art, the classical active contour model often has certain disadvantages when selecting an initial contour curve, such as being far away from a target curve and unable to converge on the target curve, and also has a poor convergence effect on a concave edge. Aiming at the problems, the traditional active contour model is improved, and an active contour model based on gradient vector flow is provided. The active contour model based on gradient vector flow replaces a Gaussian potential energy field in a traditional model, and the mathematical theoretical basis of the active contour model is Helmholtz theorem in an electromagnetic field. Compared with a Gaussian potential energy field, the gradient vector diagram of the whole image is obtained based on the field of the gradient vector flow, so that the action range of the external force field is larger. This also means that even if the selected initial contour is far from the target contour, it will eventually converge to the target contour through successive approximation. Meanwhile, after the external force action range is enlarged, the external force action of the concave part at the target contour is enlarged, so that the boundary can be converged to the concave part.
The invention provides a code sweeping and scanning method suitable for multiple video communication modes, which comprises the steps of networking mobile payment equipment which is arranged in multiple scenes and is provided with at least one sensor and a video communication verification circuit, and connecting the mobile payment equipment which is arranged in the multiple scenes and supports the cooperative application of input equipment and a printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster; the method comprises the steps of acquiring data of a plurality of parameters which are sent by a server cluster and are suitable for being recognized and read by the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters; grouping continuous ranging data extracted by combining the generated two-dimensional code image and the acquired video communication waveform image through at least one ranging sensor into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points; when a payment event is monitored to be triggered, whether an initial system of the mobile payment device supports a multi-form payment system or not is judged, wherein the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is used for presetting a single scene and a single payment position and combining a payment system formed by a virtual value storage card or a real value storage card, and the open payment system is used for presetting at least two scenes and at least two payment positions and combining a payment system formed by the virtual value storage card or the real value storage card; if the multi-form payment system is supported and the first distance measurement sampling point is monitored, the reading operation finished by a user in a code buckling and scanning mode is started and received. The method comprises the steps of firstly, networking is carried out, aiming at the combination of a two-dimensional code image and a video communication waveform image, rough segmentation and secondary segmentation are carried out on the two-dimensional code image and the video communication waveform image by adopting an Otsu algorithm, the segmentation operation suitable for the two-dimensional code image and the video communication waveform image combination image is completed through shape testing on the result obtained after the secondary segmentation operation, rapid feature extraction can be carried out on the two-dimensional code image and the video communication waveform image combination image through deep learning, after payment information sent by a server is received, the combination image is intercepted and taken as a payment image, when a payment event is monitored to be triggered, whether an initial system of the mobile payment device supports a multi-form payment system or not is judged, and if the multi-form payment system is supported and a first distance measurement sampling point is monitored, the recognizing and reading operation completed by. In addition, still accomplish the payment display through the sharing window of liquid crystal window and light guide plate window, can also gather and detect even through the sensor and lay a plurality of environmental parameter at the mobile payment equipment of many scenes, have played the beneficial effect that the technique supported to accurate and swift completion the recognition of the combination image of two-dimensional code image and video communication waveform image and even subsequent payment. In addition, the operation of image recognition and reading can be efficiently, accurately and quickly realized aiming at the combined image of the two-dimensional code image and the video communication waveform image under the networking environment supporting the multi-form payment system based on a plurality of scene conditions, so that the subsequent payment operation can be quickly, efficiently and flexibly completed, and the system has safety and applicability.
Based on the same invention concept, the invention also provides a code buckling, scanning and scanning device suitable for various video communication modes. Because the principle of the device for solving the problems is similar to the above method for scanning and scanning the codes in a plurality of video communication modes, the implementation of the device can be realized according to the specific steps of the method, and repeated parts are not repeated.
Fig. 3 is a schematic structural diagram of a code scanning and deducting apparatus suitable for multiple video communication modes in an embodiment. This a yard device 10 is swept in deduction and scanning suitable for multiple video communication mode includes: networking and connecting module 100, acquiring and image generating module 200, classifying module 300, judging module 400 and deduction scanning and reading module 500.
The networking and connecting module 100 is configured to network mobile payment devices, which are arranged in a plurality of scenes and are provided with at least one sensor and a video communication verification circuit, and connect the mobile payment devices, which are arranged in the plurality of scenes and support cooperative application of an input device and a printing device, an electronic terminal for controlling the mobile payment devices, and a server cluster, wherein the mobile payment devices, which support cooperative application of the input device and the printing device, comprise the at least one sensor, and the at least one sensor is used for collecting and detecting a plurality of environment parameters of the mobile payment devices, which support cooperative application of the input device and the printing device, arranged in the plurality of scenes; the acquisition and image generation module 200 is configured to acquire data of multiple parameters, which are sent by the server cluster and are suitable for being recognized and read by the mobile payment device, in real time, and generate a two-dimensional code image suitable for the mobile payment device according to the data of the multiple parameters; the classification module 300 is configured to group continuous ranging data extracted from the generated two-dimensional code image and the acquired video communication waveform image by at least one ranging sensor into a plurality of data groups according to an adjacent relationship of corresponding sequences, and classify ranging data points in each data group to be a first ranging sampling point and a second ranging sampling point, where each data group includes the same number of ranging data points; the judging module 400 is configured to judge whether an initial system of the mobile payment device supports a multi-form payment system when it is monitored that a payment event is triggered, where the multi-form payment system supports code scanning payment and contactless card swiping payment, the multi-form payment system includes a closed payment system and an open payment system, the closed payment system presets a single scene and a single payment position and combines a payment system composed of a virtual value storage card or a real value storage card, and the open payment system presets at least two scenes and at least two payment positions and combines a payment system composed of a virtual value storage card or a real value storage card; the deduction and scanning recognition module 500 is used for receiving the recognition operation finished by the user in the deduction and scanning code mode if the multi-form payment system is supported and the first distance measurement sampling point is monitored.
The invention provides a code scanning device for deducting and scanning applicable to various video communication modes, which comprises the following steps of firstly networking mobile payment equipment which is arranged in a plurality of scenes and is provided with at least one sensor and a video communication verification circuit through a networking and connecting module, and connecting the mobile payment equipment which is arranged in the plurality of scenes and supports the cooperative application of input equipment and a printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster; the acquisition and image generation module acquires data of a plurality of parameters which are sent by the server cluster and are suitable for being recognized and read by the mobile payment equipment in real time, and generates a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters; grouping continuous ranging data extracted by at least one ranging sensor aiming at the generated two-dimensional code image and the acquired video communication waveform image into a plurality of data groups according to the adjacent relation of corresponding sequences through a classification module, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points; when the payment event is monitored to be triggered, whether an initial system of the mobile payment device supports a multi-form payment system or not is judged through the judging module, wherein the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is used for presetting a single scene and a single payment position and combining a payment system formed by a virtual value storage card or a real value storage card, and the open payment system is used for presetting at least two scenes and at least two payment positions and combining a payment system formed by the virtual value storage card or the real value storage card; and finally, if the multi-form payment system is supported and the first distance measurement sampling point is monitored through the buckling scanning reading module, starting and receiving the reading operation finished by the user in a buckling scanning code scanning mode. The device firstly carries out networking, aiming at the combination of a two-dimensional code image and a video communication waveform image, rough segmentation and secondary segmentation are carried out on the two-dimensional code image and the video communication waveform image by adopting an Otsu algorithm, the segmentation operation suitable for the two-dimensional code image and the video communication waveform image combination image is completed through shape testing on the result obtained after the secondary segmentation operation, rapid feature extraction can be carried out on the two-dimensional code image and the video communication waveform image combination image through deep learning, after payment information sent by a server is received, the combination image is intercepted as a payment image, when a payment event is monitored to be triggered, whether an initial system of the mobile payment device supports a multi-form payment system or not is judged, and if the multi-form payment system is supported and a first distance measurement sampling point is monitored, the recognizing and reading operation completed by a code scanning buckling mode of a user. In addition, still accomplish the payment display through the sharing window of liquid crystal window and light guide plate window, can also gather and detect even through the sensor and lay a plurality of environmental parameter at the mobile payment equipment of many scenes, have played the beneficial effect that the technique supported to accurate and swift completion the recognition of the combination image of two-dimensional code image and video communication waveform image and even subsequent payment. In addition, the operation of image recognition and reading can be efficiently, accurately and quickly realized aiming at the combined image of the two-dimensional code image and the video communication waveform image under the networking environment supporting the multi-form payment system based on a plurality of scene conditions, so that the subsequent payment operation can be quickly, efficiently and flexibly completed, and the system has safety and applicability.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program is executed by the processor in fig. 1 or fig. 2. The embodiment of the invention also provides a computer program product containing the instruction. When the computer program product is run on a computer, it causes the computer to perform the method of fig. 1 or fig. 2 described above.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
The foregoing description has been presented for purposes of illustration and description. This description is not intended to limit embodiments of the disclosure to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims (10)

1. A code deduction and scanning method suitable for multiple video communication modes is characterized by comprising the following steps:
the method comprises the steps that mobile payment equipment which is arranged in a plurality of scenes and is provided with at least one sensor and a video communication verification circuit is networked, the mobile payment equipment which is arranged in the plurality of scenes and supports the cooperative application of the input equipment and the printing device, an electronic terminal for controlling the mobile payment equipment and a server cluster are connected, wherein the mobile payment equipment which supports the cooperative application of the input equipment and the printing device comprises at least one sensor, and the at least one sensor is used for collecting and detecting a plurality of environment parameters of the mobile payment equipment which is arranged in the plurality of scenes and supports the cooperative application of the input equipment and the printing device;
acquiring data of a plurality of parameters which are sent by the server cluster and are suitable for being recognized and read by the mobile payment equipment in real time, and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters;
grouping continuous ranging data extracted by combining the generated two-dimensional code image and the acquired video communication waveform image through at least one ranging sensor into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points;
when a payment event is monitored to be triggered, judging whether an initial system of the mobile payment device supports a multi-form payment system or not, wherein the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is combined with a payment system formed by a virtual value storage card or a real value storage card in a preset single scene and a preset single payment position, and the open payment system is combined with the payment system formed by the virtual value storage card or the real value storage card in a preset at least two scenes and at least two payment positions;
and receiving the reading operation finished by the user in a code buckling and scanning mode if the multi-form payment system is supported and the first distance measurement sampling point is monitored.
2. The method for code scanning and deducting applicable to multiple video communication modes according to claim 1, wherein the connecting the mobile payment device supporting cooperative application with the input device and the printing apparatus, the electronic terminal controlling the mobile payment device, and the server cluster, which are disposed in multiple scenes, comprises: connecting at least one mobile payment device arranged in a plurality of scenes with a cloud server cluster through WIFI;
and connecting the at least one mobile payment device arranged in a plurality of scenes with the electronic terminal for controlling the mobile payment device through Bluetooth connection.
3. The method of claim 1, further comprising: acquiring capability values corresponding to a plurality of protocol stacks in the mobile payment equipment and a channel identifier currently bound with the protocol stack with the maximum value of the capability values;
selecting a corresponding channel according to the acquired channel identifier;
and completing the payment operation applicable to the mobile payment device through the selected channel.
4. The method of claim 1, further comprising: selecting a plurality of two-dimensional code images as a training sample set, and judging the number of the training sample set;
if the number of the training sample sets is insufficient, amplifying the sample sets to a preset number range;
creating a CNN network, and initializing each parameter value of the CNN and each parameter value of the SVM;
creating a Gabor filter and applying to the sample image IiExtracting the dimensions of theta-0, pi/8, pi/4, 3 pi/8, pi/2, 5 pi/8, 3 pi/4 and 7 pi/8, f-0, f-1, f-2, f-3 and f-4 to generate 40 characteristic maps;
using 9-9 grid to reduce the dimension of feature map with 70-70 size to 8-8, connecting the first positions of feature map to form a feature vector Xi1＝[x11,x12,…x1,m]；
For the same sample image I according to the size of batch valueiSequencing and inputting the created CNN network, and calculating the output of each convolution layer and each pooling layer in the hidden layer; wherein the output of the pooling layer is used as the CNN network extraction feature part Xi2＝[x21,x22,…x2,n]；
Suppose that the strong features of all samples are X1＝[x11,x12,…x1,M]The characteristic automatically extracted by the CNN network is X2＝[x21,x22,…x2,N]And for the feature vector X1、X2Carrying out standardization processing and serial fusion to obtain a fusion characteristic W ═ W1,w2,…,wM+N)＝(αX1,βX2)；
Using PCA method to reduce dimension of W and obtaining final fusion characteristic vector W*And fusing the feature vectors W*Inputting the training data into the SVM to train to reach the preset range error or train to reach the preset maximum iterative training generation times.
5. The method of claim 1, further comprising: the method comprises the steps of obtaining the illumination intensity of a screen of the electronic terminal and the illumination intensity reflected by the screen of the electronic terminal in a preset time period, and constructing a screen illumination intensity database aiming at the electronic terminal and a screen reflection illumination intensity database aiming at the electronic terminal.
6. The method of claim 1, further comprising: intercepting a generated combined image of the two-dimensional code image suitable for the mobile payment equipment and the video communication waveform image, and dividing the payment image after intercepting the combined image as a payment image;
according to the Dajin algorithm, performing rough segmentation operation on the region of interest in the divided payment image;
performing secondary segmentation on the roughly segmented payment image by using an active contour model of a gradient vector flow;
and completing the segmentation operation suitable for the payment image by shape testing on the result obtained after the secondary segmentation operation.
7. The method of claim 6, wherein the dividing the payment image comprises: selecting a segmentation channel based on statistical rules of the payment image data of training samples;
selecting a segmentation threshold value in the segmentation channel, and performing foreground and background segmentation on the payment image;
and analyzing a communication region according to the segmented foreground pixels and background pixels to obtain a coding region meeting the conditions, wherein the coding region meeting the conditions is divided into the payment image subblocks in a preset row and preset column dividing mode, and the preset row and the preset column are equal numerical values.
8. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 7.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1-7 are implemented when the program is executed by the processor.
10. A detain and sweep a yard device suitable for multiple video communication mode, its characterized in that, the device includes:
the system comprises a networking and connecting module, a video communication verification circuit, a mobile payment device, an electronic terminal and a server cluster, wherein the networking and connecting module is used for networking the mobile payment device which is arranged in a plurality of scenes and is provided with at least one sensor and the video communication verification circuit, and connecting the mobile payment device which is arranged in the plurality of scenes and supports the cooperative application of the input device and the printing device, the electronic terminal for controlling the mobile payment device and the server cluster, wherein the mobile payment device which supports the cooperative application of the input device and the printing device comprises at least one sensor which is used for collecting and detecting a plurality of environment parameters of the mobile payment device which is arranged in the plurality of scenes and supports the cooperative application of the input device and the printing device;
the acquisition and image generation module is used for acquiring data of a plurality of parameters which are sent by the server cluster and are suitable for being recognized and read by the mobile payment equipment in real time and generating a two-dimensional code image suitable for the mobile payment equipment according to the data of the plurality of parameters;
the classification module is used for grouping continuous ranging data extracted by at least one ranging sensor aiming at the generated two-dimensional code image and the acquired video communication waveform image into a plurality of data groups according to the adjacent relation of corresponding sequences, and classifying ranging data points in each data group to be divided into a first ranging sampling point and a second ranging sampling point, wherein each data group comprises the same number of ranging data points;
the system comprises a judging module, a payment processing module and a payment processing module, wherein the judging module is used for judging whether an initial system of the mobile payment device supports a multi-form payment system when a payment event is triggered, the multi-form payment system supports code scanning payment and non-contact card swiping payment, the multi-form payment system comprises a closed payment system and an open payment system, the closed payment system is combined with a payment system formed by a virtual value card or a real value card in a mode of presetting a single scene and a single payment position, and the open payment system is combined with a payment system formed by a virtual value card or a real value card in a mode of presetting at least two scenes and at least two payment positions;
and the deducting and scanning reading module is used for receiving the reading operation finished by the user in a deducting and scanning code mode if supporting the multi-form payment system and monitoring the first distance measurement sampling point.
CN201811513283.4A 2018-12-11 2018-12-11 Code buckling, scanning and scanning method and device suitable for multiple video communication modes Withdrawn CN111311243A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811513283.4A CN111311243A (en) 2018-12-11 2018-12-11 Code buckling, scanning and scanning method and device suitable for multiple video communication modes

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811513283.4A CN111311243A (en) 2018-12-11 2018-12-11 Code buckling, scanning and scanning method and device suitable for multiple video communication modes

Publications (1)

Publication Number Publication Date
CN111311243A true CN111311243A (en) 2020-06-19

Family

ID=71161285

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811513283.4A Withdrawn CN111311243A (en) 2018-12-11 2018-12-11 Code buckling, scanning and scanning method and device suitable for multiple video communication modes

Country Status (1)

Country Link
CN (1) CN111311243A (en)

Similar Documents

Publication Publication Date Title
CN111311244A (en) Passive code scanning method and device based on QR (quick response) code
CN111311233A (en) Passive code scanning method and device based on multi-trigger mode
CN111311241A (en) Two-dimensional code reading method and device based on scene perception
CN111311227A (en) Method and device suitable for in-screen type biological feature and two-dimensional code recognition
CN111310492A (en) In-screen two-dimensional code reading method and device suitable for adjustable light source
CN111311225A (en) Optical module encryption-based in-screen payment method and device
CN111311248A (en) Method and device for recognizing and reading two-dimensional code under low-power-consumption screen
CN109816393B (en) Method and device for identifying and verifying biological characteristics under screen
CN111311229A (en) Chinese-sensible code based passive code scanning method and device
CN111311226A (en) Machine vision-based two-dimensional code reading method and device under complex background
CN111311243A (en) Code buckling, scanning and scanning method and device suitable for multiple video communication modes
CN111311238A (en) Code buckling, scanning and scanning method and device suitable for multiple audio communication modes
CN111311245A (en) Code buckling, scanning and scanning method and device suitable for multiple communication modes
CN111311237A (en) Face and bar code double-recognition method and device
CN111311222A (en) Waving code scanning method and device suitable for multiple communication modes
CN111310763A (en) Method and device for dual recognition of identity card and bar code
CN111311235A (en) Buckling scanning code scanning method and device for identifying multi-trigger mode of bill
CN111310490A (en) Two-dimensional code reading method and device suitable for ARM processor architecture
CN111311231A (en) Two-dimensional code reading method and device used under real-time operating system
CN111310498A (en) Two-dimensional code reading method and device based on Linux system
CN111310497A (en) Two-dimensional code reading method and device based on Android system
CN111311224A (en) Waving code scanning method and device for identifying multi-trigger mode of bill
CN111310500A (en) Two-dimensional code reading method and device based on Windows system
CN111310491A (en) Infrared induction code scanning method and device based on two-dimensional code recognition device
CN111311234A (en) Two-dimensional code reading method and device suitable for MIPS processor architecture

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20200619

WW01 Invention patent application withdrawn after publication