WO2020172767A1 - Electronic purchase order recognition method and apparatus, and terminal device. - Google Patents

Electronic purchase order recognition method and apparatus, and terminal device. Download PDF

Info

Publication number
WO2020172767A1
WO2020172767A1 PCT/CN2019/076042 CN2019076042W WO2020172767A1 WO 2020172767 A1 WO2020172767 A1 WO 2020172767A1 CN 2019076042 W CN2019076042 W CN 2019076042W WO 2020172767 A1 WO2020172767 A1 WO 2020172767A1
Authority
WO
WIPO (PCT)
Prior art keywords
purchase order
electronic purchase
electronic
picture
neural network
Prior art date
Application number
PCT/CN2019/076042
Other languages
French (fr)
Chinese (zh)
Inventor
武泽
张俊
黄利庆
吴松
Original Assignee
深圳盒子信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳盒子信息科技有限公司 filed Critical 深圳盒子信息科技有限公司
Priority to CN201980092322.4A priority Critical patent/CN113474786A/en
Priority to PCT/CN2019/076042 priority patent/WO2020172767A1/en
Publication of WO2020172767A1 publication Critical patent/WO2020172767A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition

Definitions

  • POS Point of sales
  • the paper purchase form printed out by the terminal is signed as the cardholder's proof of confirmation of this purchase. Due to the waste of paper and cumbersome storage and management of paper purchase orders, more and more merchants use electronic purchase orders to replace traditional paper purchase orders. After the transaction is completed, consumers use the touch screen to electronically sign the electronic purchase order. After the signature is completed, the POS terminal will automatically upload the electronic purchase order to the system for storage, which is environmentally friendly and easy to manage.
  • the first aspect of this application provides an electronic purchase order identification method, including:
  • the pre-trained Alexnet convolutional neural network model is used to identify the electronic purchase order picture, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
  • the first obtaining unit is configured to obtain a picture of an electronic purchase order, wherein the picture of the electronic purchase order includes an electronic signature;
  • the recognition unit is configured to recognize the electronic purchase order picture through the pre-trained Alexnet convolutional neural network model, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
  • a fourth aspect of the present application provides a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and the computer program implements the first aspect or any possible implementation manner of the first aspect when executed by a processor
  • Figures 2a-2c are example diagrams of positive sample pictures provided by this application.
  • Figure 4 is a schematic diagram of the implementation process of the second method for identifying electronic purchase orders provided by this application.
  • Fig. 5 is a schematic diagram of the electronic purchase order recognition device provided by this application.
  • Figure 6 is a schematic structural diagram of an embodiment of a terminal device provided by this application.
  • the electronic purchase order identification method in the embodiment of the present application includes:
  • an electronic purchase order picture is obtained, where the electronic purchase order picture includes an electronic signature.
  • the electronic purchase order is a consumption certificate generated by the consumer after swiping the card.
  • the complete electronic purchase order also contains the consumer's approval Handwritten electronic signature of electronic equipment on electronic purchase order.
  • the electronic purchase order can be converted into a picture format such as jpg through the format conversion program, or the picture of the electronic purchase order can be obtained through automatic screenshot when the electronic purchase order is displayed.
  • the picture of the electronic purchase order includes at least an area where the electronic signature is displayed, that is, the electronic purchase order needs to include electronic signature information.
  • the electronic purchase order picture only includes an area where the electronic signature is displayed, excluding the area where other redundant basic information is displayed.
  • the pre-trained Alexnet convolutional neural network model is used to identify the electronic purchase order picture, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain a determination result.
  • the pre-trained Alexnet convolutional neural network model into the running memory, identify the image of the electronic purchase order, and determine whether the electronic signature on the electronic purchase order image is legal, that is, determine whether the signature on the electronic purchase order is clear Recognizable and get the judgment result.
  • the judgment result can be fed back to the user in the form of text or patterns displayed on the screen, for example, by displaying texts such as "legal” or "illegal", or by displaying a green icon to feed back the electronic purchase order
  • the electronic signature on the e-signature is legal, and the red icon is displayed to feedback that the electronic signature on the e-signature is illegal.
  • the method further includes:
  • Alexnet convolutional neural network model specifically performs a series of convolution and transformation operations on the input matrix data, the vector conversion of the electronic purchase order picture is carried out, and the vector corresponding to the converted electronic purchase order picture is input to Alexnet Convolutional neural network model.
  • the pre-trained Alexnet convolutional neural network model includes Batch Normalization layer and softmax classifier.
  • the pre-trained Alexnet convolutional neural network model is an 8-layer deep neural network, including 5 layers of convolutional layers and 3 layers of fully connected layers, and finally includes a softmax classifier, which is described as follows:
  • the LRN layer creates a competition mechanism for the activity of local neurons, making the response larger. It is relatively larger and inhibits other neurons with smaller feedback, which enhances the generalization ability of the model.
  • the training pictures contain positive sample pictures (legitimate pictures with a judgment label of 0 carried, as shown in Figure 2a, Figure 2b, and Figure 2c) ) And negative sample pictures (carrying illegal pictures with a judgment label of 1, as shown in Figure 3a, Figure 3b, and Figure 3c), and the ratio of positive sample pictures and negative sample pictures is balanced.
  • positive sample pictures legitimate pictures with a judgment label of 0 carried, as shown in Figure 2a, Figure 2b, and Figure 2c)
  • negative sample pictures carrying illegal pictures with a judgment label of 1, as shown in Figure 3a, Figure 3b, and Figure 3c
  • the ratio of positive sample pictures and negative sample pictures is balanced.
  • the number of positive samples is 56,600
  • the number of negative samples is 40,550.
  • Fig. 4 shows a schematic flow chart of a second method for identifying electronic purchase orders provided by an embodiment of the present application.
  • the execution subject of the example of the present invention is a terminal device, such as a POS machine. The details are as follows:
  • an electronic purchase order is generated and displayed on the terminal device.
  • the terminal device obtains the consumer's sliding operation, and the consumer can use a touch pen or finger to display the electronic display on the terminal device's touch screen.
  • the terminal device After the consumer's sliding operation ends, the terminal device generates an electronic signature on the electronic purchase order according to the sliding track.
  • S402 in this embodiment is the same as S102 in the previous embodiment.
  • S102 in the previous embodiment please refer to the related description of S102 in the previous embodiment, which will not be repeated here.
  • the serial number of the electronic purchase order corresponding to the picture of the electronic purchase order can be extracted, and the serial number, the picture of the electronic purchase order and the corresponding determination result can be stored in the database, and then the user only needs to enter the serial number. Check the legal information of the electronic purchase order.
  • the pre-trained Alexnet convolutional neural network model is used to identify and judge the electronic purchase order containing the electronic signature, it is possible to accurately and efficiently check the legality of the electronic signature on the electronic purchase order in time. Automatically identify and judge, so as to make up for manual inspection omissions; at the same time, when the judgment result is illegal, a re-signature prompt is issued to automatically guide consumers to re-sign, which further reduces the workload of staff and improves work efficiency.
  • the embodiment of the present application also provides an electronic purchase order recognition device. As shown in FIG. 5, for ease of description, only the parts related to the embodiment of the present application are shown:
  • the device for identifying electronic purchase orders includes: a first acquiring unit 51 and an identifying unit 52. among them:
  • the first acquiring unit 51 is configured to acquire a picture of an electronic purchase order, wherein the picture of the electronic purchase order includes an electronic signature.
  • the electronic purchase order is a consumption certificate generated by the consumer after swiping the card.
  • the complete electronic purchase order also contains the consumer's approval Handwritten electronic signature of electronic equipment on electronic purchase order.
  • the electronic purchase order can be converted into a picture format such as jpg through the format conversion program, or the picture of the electronic purchase order can be obtained through automatic screenshot when the electronic purchase order is displayed.
  • the picture of the electronic purchase order includes at least an area where the electronic signature is displayed, that is, the electronic purchase order needs to include electronic signature information.
  • the electronic purchase order picture only includes an area where the electronic signature is displayed, excluding the area where other redundant basic information is displayed.
  • the recognition unit 52 is configured to recognize the electronic purchase order picture through the pre-trained Alexnet convolutional neural network model, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
  • the pre-trained Alexnet convolutional neural network model into the running memory, identify the image of the electronic purchase order, and determine whether the electronic signature on the electronic purchase order image is legal, that is, determine whether the signature on the electronic purchase order is clear Recognizable and get the judgment result.
  • the judgment result can be fed back to the user in the form of text or patterns displayed on the screen, for example, by displaying texts such as "legal” or "illegal", or by displaying a green icon to feed back the electronic purchase order
  • the electronic signature on the e-signature is legal, and the red icon is displayed to feedback that the electronic signature on the e-signature is illegal.
  • the pre-trained Alexnet convolutional neural network model includes Batch Normalization layer and softmax classifier.
  • the pre-trained Alexnet convolutional neural network model is an 8-layer deep neural network, including 5 layers of convolutional layers and 3 layers of fully connected layers, and finally includes a softmax classifier, which is described as follows:
  • ReLU Rectified Linear Unit
  • the LRN layer creates a competition mechanism for the activity of local neurons, making the response larger. It is relatively larger and inhibits other neurons with smaller feedback, which enhances the generalization ability of the model.
  • Fully connected layer 1 The input data is 6*6*256, and RELU is used as the activation function. This layer uses Batch Normalization is the dropout layer, and the data becomes 4096*1 after the change.
  • Fully connected layer 2 Fully connected layer 2 is similar to fully connected layer 1, the input is 4096*1, and the output is also 4096*1.
  • Softmax classifier here specifically includes two classifications, the classification label 0 means legal, and the classification label 1 means illegal.
  • the electronic purchase order recognition device further includes:
  • the training unit is used to obtain a preset number of training pictures, the training pictures carry judgment label information; set the batch size parameter batch_size of the Alexnet convolutional neural network, the training round parameter epochs, and the validation set ratio parameter validation_split, and Input the training picture to obtain the pre-trained Alexnet convolutional neural network model.
  • the electronic purchase order recognition device further includes:
  • the electronic signature generating unit is used to obtain the sliding track, and generate an electronic signature on the electronic purchase order according to the sliding track.
  • the electronic purchase order recognition device further includes:
  • the preprocessing unit is used to preprocess the picture of the electronic purchase order.
  • the electronic purchase order recognition device further includes:
  • the prompt unit is used to send out a prompt to re-sign if the result of the determination is illegal.
  • the electronic purchase order recognition device further includes:
  • the storage unit is used to store the picture of the electronic purchase order and the corresponding determination result.
  • the pre-trained Alexnet convolutional neural network model is used to identify and judge the electronic purchase order containing the electronic signature, the legality of the electronic signature on the electronic purchase order can be accurately and efficiently checked in time. Automatically identify and judge to make up for manual inspection omissions.
  • Fig. 6 is a schematic diagram of a terminal device provided by an embodiment of the present invention.
  • the terminal device 6 of this embodiment includes: a processor 60, a memory 61, and a computer program 62 stored in the memory 61 and running on the processor 60, such as electronic purchase order recognition program.
  • the processor 60 executes the computer program 62, the steps in the above embodiments of the electronic purchase order recognition method are implemented, for example, steps S101 to S102 shown in FIG. 1.
  • the processor 60 executes the computer program 62
  • the functions of the modules/units in the foregoing device embodiments, such as the functions of the modules 51 to 52 shown in FIG. 5, are realized.
  • the computer program 62 may be divided into one or more modules/units, and the one or more modules/units are stored in the memory 61 and executed by the processor 60 to complete this invention.
  • the one or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 62 in the terminal device 6.
  • the computer program 62 may be divided into a first acquisition unit and an identification unit, and the specific functions of each unit are as follows:
  • the recognition unit is configured to recognize the electronic purchase order picture through the pre-trained Alexnet convolutional neural network model, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
  • the terminal device 6 may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server.
  • the terminal device may include, but is not limited to, a processor 60 and a memory 61.
  • FIG. 6 is only an example of the terminal device 6 and does not constitute a limitation on the terminal device 6. It may include more or less components than shown in the figure, or a combination of certain components, or different components.
  • the terminal device may also include input and output devices, network access devices, buses, etc.
  • the so-called processor 60 may be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the memory 61 may be an internal storage unit of the terminal device 6, such as a hard disk or memory of the terminal device 6.
  • the memory 61 may also be an external storage device of the terminal device 6, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), or a secure digital (Secure Digital, SD) equipped on the terminal device 6. Flash memory card Card) etc.
  • the memory 61 may also include both an internal storage unit of the terminal device 6 and an external storage device.
  • the memory 61 is used to store the computer program and other programs and data required by the terminal device.
  • the memory 61 can also be used to temporarily store data that has been output or will be output.
  • the disclosed device/terminal device and method may be implemented in other ways.
  • the device/terminal device embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units.
  • components can be combined or integrated into another system, or some features can be omitted or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
  • the integrated module/unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the present invention implements all or part of the processes in the above-mentioned embodiments and methods, and can also be completed by instructing relevant hardware through a computer program.
  • the computer program can be stored in a computer-readable storage medium. When the program is executed by the processor, the steps of the foregoing method embodiments can be implemented.
  • the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms.
  • the computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunications signal, and software distribution medium.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • electric carrier signal telecommunications signal
  • software distribution medium any entity or device capable of carrying the computer program code
  • recording medium U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunications signal, and software distribution medium.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Image Analysis (AREA)

Abstract

Disclosed in the present application are an electronic purchase order recognition method and an apparatus, and a terminal device, the electronic purchase order recognition method comprising: acquiring an electronic purchase order image, the electronic purchase order image containing an electronic signature; and by means of a pre-trained Alexnet convolutional neural network model, performing recognition on the electronic purchase order image and determining whether the electronic signature on the electronic purchase order image is legitimate to obtain a determination result. The technical solution provided in the present application is able to automatically recognize and determine the legitimacy of an electronic signature on an electronic purchase order, thus compensating for gaps in manual checking.

Description

电子签购单识别方法、装置及终端设备Method, device and terminal equipment for identifying electronic purchase order 技术领域Technical field
本申请涉及电子商务技术领域,具体涉及一种电子签购单识别方法、装置、终端设备及计算机可读存储介质。This application relates to the technical field of e-commerce, and in particular to an electronic purchase order recognition method, device, terminal equipment and computer-readable storage medium.
背景技术Background technique
在传统的刷卡消费中,需要消费者在POS(Point of sales)终端打印出的纸质签购单进行签名,以作为持卡人确认此笔消费的凭证。由于纸质签购单存在着浪费纸张,存储及管理繁琐等问题,越来越多的商户采用电子签购单来代替传统的纸质签购单。消费者在交易完成后通过触摸显示屏在电子签购单上进行电子签名,签名完成后POS终端会自动将电子签购单上送到系统当中进行存储,环保且便于管理。In traditional credit card consumption, consumers need to pay at POS (Point of sales) The paper purchase form printed out by the terminal is signed as the cardholder's proof of confirmation of this purchase. Due to the waste of paper and cumbersome storage and management of paper purchase orders, more and more merchants use electronic purchase orders to replace traditional paper purchase orders. After the transaction is completed, consumers use the touch screen to electronically sign the electronic purchase order. After the signature is completed, the POS terminal will automatically upload the electronic purchase order to the system for storage, which is environmentally friendly and easy to manage.
然而,在忙碌的工作中,收银员通常不会仔细辨认电子签购单上的电子签名是否清晰合法,若消费者只是在触摸显示屏上随意点击或者胡乱划动,收银员也不一定会发现,导致后期查看时无法判断作为凭证的电子签购单上签的具体是什么,从而导致潜在的风险。However, in busy work, the cashier usually does not carefully identify whether the electronic signature on the electronic purchase order is clear and legal. If the consumer just clicks or swipes randomly on the touch screen, the cashier will not necessarily find out , Resulting in the failure to determine what is signed on the electronic purchase order as a voucher during later review, resulting in potential risks.
技术问题technical problem
有鉴于此,本申请提供一种电子签购单识别方法、装置、终端设备及计算机可读存储介质,以解决如何对电子签购单中的电子签名进行自动识别判断的问题。In view of this, this application provides an electronic purchase order identification method, device, terminal device, and computer readable storage medium to solve the problem of how to automatically identify and judge the electronic signature in the electronic purchase order.
技术解决方案Technical solutions
本申请第一方面提供一种电子签购单识别方法,包括:The first aspect of this application provides an electronic purchase order identification method, including:
获取电子签购单图片,其中所述电子签购单图片包含电子签名;Obtaining a picture of an electronic purchase order, where the picture of the electronic purchase order includes an electronic signature;
通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果。The pre-trained Alexnet convolutional neural network model is used to identify the electronic purchase order picture, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
本申请第二方面提供一种电子签购单识别装置,包括:The second aspect of the present application provides an electronic purchase order recognition device, including:
第一获取单元,用于获取电子签购单图片,其中所述电子签购单图片包含电子签名;The first obtaining unit is configured to obtain a picture of an electronic purchase order, wherein the picture of the electronic purchase order includes an electronic signature;
识别单元,用于通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果。The recognition unit is configured to recognize the electronic purchase order picture through the pre-trained Alexnet convolutional neural network model, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
本申请第三方面提供一种终端设备,包括存储器,处理器及存储在存储器上并可在处理器上运行的计算机程序,上述处理器执行上述计算机程序时实现上述第一方面或者上述第一方面的任一可能实现方式中提及的电子签购单识别方法。A third aspect of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and running on the processor. The processor implements the first aspect or the first aspect when the computer program is executed by the processor. The electronic purchase order identification method mentioned in any of the possible implementations.
本申请第四方面提供一种计算机可读存储介质,该计算机可读存储介质上存储有计算机程序,上述计算机程序被处理器执行时实现上述第一方面或者上述第一方面的任一可能实现方式中提及的电子签购单识别方法。A fourth aspect of the present application provides a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and the computer program implements the first aspect or any possible implementation manner of the first aspect when executed by a processor The electronic purchase order identification method mentioned in.
有益效果Beneficial effect
本发明实施例中,由于通过预训练的Alexnet卷积神经网络模型对包含电子签名的电子签购单进行识别判断,因此可以准确、高效地对电子签购单上的电子签名的合法性进行及时自动地识别判断,从而弥补人工的检查疏漏。In the embodiment of the present invention, since the pre-trained Alexnet convolutional neural network model is used to identify and judge the electronic purchase order containing the electronic signature, the legality of the electronic signature on the electronic purchase order can be accurately and efficiently checked in time. Automatically identify and judge to make up for manual inspection omissions.
附图说明Description of the drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.
图1为本申请提供的第一种电子签购单识别方法的实现流程示意图;Figure 1 is a schematic diagram of the implementation process of the first method for identifying electronic purchase orders provided by this application;
图2a-图2c为本申请提供的正样本图片的示例图;Figures 2a-2c are example diagrams of positive sample pictures provided by this application;
图3a-图3c为本申请提供的负样本图片的示例图;Figures 3a-3c are example diagrams of negative sample pictures provided by this application;
图4为本申请提供的第二种电子签购单识别方法的实现流程示意图;Figure 4 is a schematic diagram of the implementation process of the second method for identifying electronic purchase orders provided by this application;
图5为本申请提供的电子签购单识别装置的示意图;Fig. 5 is a schematic diagram of the electronic purchase order recognition device provided by this application;
图6为本申请提供的终端设备一个实施例结构示意图。Figure 6 is a schematic structural diagram of an embodiment of a terminal device provided by this application.
本发明的实施方式Embodiments of the invention
以下描述中,为了说明而不是为了限定,提出了诸如特定系统结构、技术之类的具体细节,以便透彻理解本发明实施例。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施例中也可以实现本发明。在其它情况中,省略对众所周知的系统、装置、电路以及方法的详细说明,以免不必要的细节妨碍本发明的描述。In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are proposed for a thorough understanding of the embodiments of the present invention. However, it should be clear to those skilled in the art that the present invention can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from obstructing the description of the present invention.
为了说明本发明所述的技术方案,下面通过具体实施例来进行说明。In order to illustrate the technical solution of the present invention, specific embodiments are used for description below.
应当理解,当在本说明书和所附权利要求书中使用时,术语“包括”指示所描述特征、整体、步骤、操作、元素和/或组件的存在,但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。It should be understood that when used in this specification and appended claims, the term "comprising" indicates the existence of the described features, wholes, steps, operations, elements and/or components, but does not exclude one or more other features Existence or addition of, whole, step, operation, element, component and/or its collection.
还应当理解,在此本申请说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本申请。如在本申请说明书和所附权利要求书中所使用的那样,除非上下文清楚地指明其它情况,否则单数形式的“一”、“一个”及“该”意在包括复数形式。It should also be understood that the terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in the specification of this application and the appended claims, unless the context clearly indicates other circumstances, the singular forms "a", "an" and "the" are intended to include plural forms.
还应当进一步理解,在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。It should be further understood that the term "and/or" used in the specification and appended claims of this application refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations .
如在本说明书和所附权利要求书中所使用的那样,术语“如果”可以依据上下文被解释为“当...时”或“一旦”或“响应于确定”或“响应于检测到”。类似地,短语“如果确定”或“如果检测到[所描述条件或事件]”可以依据上下文被解释为意指“一旦确定”或“响应于确定”或“一旦检测到[所描述条件或事件]”或“响应于检测到[所描述条件或事件]”。As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "once" or "in response to determination" or "in response to detection" depending on the context . Similarly, the phrase "if determined" or "if detected [described condition or event]" can be interpreted as meaning "once determined" or "response to determination" or "once detected [described condition or event]" depending on the context ]" or "in response to detection of [condition or event described]".
另外,在本申请的描述中,术语“第一”、“第二”等仅用于区分描述,而不能理解为指示或暗示相对重要性。In addition, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance.
实施例一Example one
下面对本申请实施例提供的第一种电子签购单识别方法进行描述,请参阅图1,本申请实施例中的电子签购单识别方法包括:The following describes the first electronic purchase order identification method provided by the embodiment of the present application. Please refer to FIG. 1. The electronic purchase order identification method in the embodiment of the present application includes:
在S101中,获取电子签购单图片,其中所述电子签购单图片包含电子签名。In S101, an electronic purchase order picture is obtained, where the electronic purchase order picture includes an electronic signature.
电子签购单是消费者刷卡消费后生成的消费凭据,完整的电子签购单上除了包含例如商铺名称、商品名称、消费金额、消费时间、流水号等基本信息外,还包含了消费者通过电子设备在电子签购单上手写的电子签名。The electronic purchase order is a consumption certificate generated by the consumer after swiping the card. In addition to basic information such as the store name, product name, consumption amount, consumption time, and serial number, the complete electronic purchase order also contains the consumer's approval Handwritten electronic signature of electronic equipment on electronic purchase order.
获取电子签购单图片,可以通过格式转化程序将电子签购单转为例如jpg等图片格式,或者在电子签购单展示时通过自动截屏获得该电子签购单图片。所述电子签购单图片中至少包含展示有电子签名的区域,即电子签购单需要包含电子签名信息。优选地,所述电子签购单图片只包含展示有电子签名的区域,剔除了展示了其它多余的基本信息的区域。To obtain the picture of the electronic purchase order, the electronic purchase order can be converted into a picture format such as jpg through the format conversion program, or the picture of the electronic purchase order can be obtained through automatic screenshot when the electronic purchase order is displayed. The picture of the electronic purchase order includes at least an area where the electronic signature is displayed, that is, the electronic purchase order needs to include electronic signature information. Preferably, the electronic purchase order picture only includes an area where the electronic signature is displayed, excluding the area where other redundant basic information is displayed.
在S102中,通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果。In S102, the pre-trained Alexnet convolutional neural network model is used to identify the electronic purchase order picture, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain a determination result.
加载预先训练好的Alexnet卷积神经网络模型到运行内存中,对电子签购单图片进行识别,判断该电子签购单图片上的电子签名是否合法,即判断电子签购单上的签名是否清晰可辨认,得到判定结果。可选地,该判定结果可以通过屏幕显示文字或者图案的形式来反馈给用户,例如通过显示“合法”或者“不合法”等文字来反馈,或者,通过显示绿色图标来反馈该电子签购单上的电子签名合法、通过显示红色图标来反馈该电子签购单上的电子签名不合法。Load the pre-trained Alexnet convolutional neural network model into the running memory, identify the image of the electronic purchase order, and determine whether the electronic signature on the electronic purchase order image is legal, that is, determine whether the signature on the electronic purchase order is clear Recognizable and get the judgment result. Optionally, the judgment result can be fed back to the user in the form of text or patterns displayed on the screen, for example, by displaying texts such as "legal" or "illegal", or by displaying a green icon to feed back the electronic purchase order The electronic signature on the e-signature is legal, and the red icon is displayed to feedback that the electronic signature on the e-signature is illegal.
可选地,在所述步骤S102之前,还包括:Optionally, before the step S102, the method further includes:
对所述电子签购单图片进行预处理。Preprocessing the picture of the electronic purchase order.
该预处理可以包括灰度处理及向量转化处理。The preprocessing can include grayscale processing and vector conversion processing.
在对电子签购单图片上的电子签名的合法性进行判断时,无需获取电子签购单图片的具体色彩信息,因此若电子签购单图片为RGB图片时,可以将电子签购单图片进行灰度处理,得到只具有一个色彩通道信息的电子签购单图片,从而减少后续Alexnet卷积神经网络模型进行识别判断的运算量。When judging the legality of the electronic signature on the electronic purchase order picture, there is no need to obtain the specific color information of the electronic purchase order picture. Therefore, if the electronic purchase order picture is an RGB picture, the electronic purchase order picture can be Gray-scale processing obtains an electronic purchase order picture with only one color channel information, thereby reducing the amount of calculation for the subsequent recognition and judgment of the Alexnet convolutional neural network model.
由于Alexnet卷积神经网络模型具体是对输入的矩阵数据进行一系列的卷积及变换运算操作,因此将电子签购单图片进行向量转换,将转换后电子签购单图片对应的向量输入到Alexnet卷积神经网络模型中。Because the Alexnet convolutional neural network model specifically performs a series of convolution and transformation operations on the input matrix data, the vector conversion of the electronic purchase order picture is carried out, and the vector corresponding to the converted electronic purchase order picture is input to Alexnet Convolutional neural network model.
具体地,所述预训练的Alexnet卷积神经网络模型包括Batch Normalization层及softmax分类器。Specifically, the pre-trained Alexnet convolutional neural network model includes Batch Normalization layer and softmax classifier.
所述预训练的Alexnet卷积神经网络模型为8层深度神经网络,包括5层卷积层和3层全连接层,最后还包括一个softmax分类器,具体描述如下:The pre-trained Alexnet convolutional neural network model is an 8-layer deep neural network, including 5 layers of convolutional layers and 3 layers of fully connected layers, and finally includes a softmax classifier, which is described as follows:
卷积层1:由于电子签购单图片通常为黑白图片或者已经经过灰度处理,因此此时输入数据矩阵不同于通常的227*227*3,而是227*227*1;使用线性整流函数(Rectified Linear Unit, ReLU)作为激活函数,卷积核大小为11*11,数量96个,步长为4*4,填充像素为0,数据通过这层卷积之后得到(227-11)/4+1=55,所以输出为55*55*96。第一层卷积层后还有一层局部响应归一化层(Local Response Normalization,LRN)和max_pooling池化层,LRN层作用对局部神经元的活动创建竞争机制,使得响应较大的值变得相对更大,并抑制其他反馈较小的神经元,增强了模型的泛化能力。max_pooling池化层核大小为3*3,步长为2*2,数据经过变换之后(55-3)/2+1=27,所以经过第一层所有的处理之后,数据变为27*27*96。Convolutional layer 1: Since the electronic purchase order pictures are usually black and white pictures or have been grayscale processed, the input data matrix is different from the usual 227*227*3, but 227*227*1; linear rectification function is used (Rectified Linear Unit, ReLU) as the activation function, the size of the convolution kernel is 11*11, the number is 96, the step size is 4*4, the filling pixel is 0, and the data is obtained after this layer of convolution (227-11)/4+1 =55, so the output is 55*55*96. After the first layer of convolutional layer, there is a local response normalization layer (Local Response Normalization, LRN) and max_pooling pooling layer. The LRN layer creates a competition mechanism for the activity of local neurons, making the response larger. It is relatively larger and inhibits other neurons with smaller feedback, which enhances the generalization ability of the model. The core size of max_pooling pooling layer is 3*3, the step size is 2*2, and the data is transformed (55-3)/2+1=27, so after all the processing of the first layer, the data becomes 27*27 *96.
卷积层2:输入数据矩阵为27*27*96,使用RELU作为激活函数,卷积核大小为5*5,数量256个,步长为1*1,填充像素为2,数据通过这层卷积之后得到(27-5+2*2)/1+1=27,所以输出为27*27*256。卷积层2同层1一样,也有相同的LRN层和max_pooling池化层,经过池化层之后(27-3)/2+1=13,最后输出为13*13*256。Convolutional layer 2: The input data matrix is 27*27*96, using RELU as the activation function, the size of the convolution kernel is 5*5, the number is 256, the step size is 1*1, the filling pixel is 2, and the data passes through this layer After convolution, we get (27-5+2*2)/1+1=27, so the output is 27*27*256. Convolutional layer 2 is the same as layer 1, with the same LRN layer and max_pooling pooling layer. After the pooling layer (27-3)/2+1=13, the final output is 13*13*256.
卷积层3:输入数据矩阵为13*13*256,使用RELU作为激活函数,卷积核大小为3*3,数量384个,步长为1*1,填充像素为1,数据通过这层卷积之后得到(13-3+2*1)/1+1=13,所以输出为13*13*384。卷积层3没有LRN层和池化层。Convolutional layer 3: The input data matrix is 13*13*256, using RELU as the activation function, the size of the convolution kernel is 3*3, the number is 384, the step size is 1*1, the filling pixel is 1, and the data passes through this layer After convolution, we get (13-3+2*1)/1+1=13, so the output is 13*13*384. Convolutional layer 3 has no LRN layer and pooling layer.
卷积层4:输入数据矩阵为13*13*384,使用RELU作为激活函数,卷积核大小为3*3,数量384个,步长为1*1,填充像素为1,数据通过这层卷积之后得到(13-3+2*1)/1+1=13,所以输出为13*13*384。卷积层4同样没有LRN层和池化层。Convolutional layer 4: The input data matrix is 13*13*384, using RELU as the activation function, the size of the convolution kernel is 3*3, the number is 384, the step size is 1*1, the filling pixel is 1, and the data passes through this layer After convolution, we get (13-3+2*1)/1+1=13, so the output is 13*13*384. Convolutional layer 4 also has no LRN layer and pooling layer.
卷积层5:输入数据矩阵为13*13*384,使用RELU作为激活函数,卷积核大小为3*3,数量256个,步长为1*1,填充像素为1,数据通过这层卷积之后得到(13-3+2*1)/1+1=13,所以输出为13*13*256。该层还有一个max_pooling池化层,池化层核大小为3*3,步长为2*2,经过变换后得到(13-3)/2+1=6,输出为6*6*256。Convolutional layer 5: The input data matrix is 13*13*384, using RELU as the activation function, the size of the convolution kernel is 3*3, the number is 256, the step size is 1*1, the filling pixel is 1, and the data passes through this layer After convolution, we get (13-3+2*1)/1+1=13, so the output is 13*13*256. This layer also has a max_pooling pooling layer, the core size of the pooling layer is 3*3, the step size is 2*2, after transformation, it is (13-3)/2+1=6, and the output is 6*6*256 .
全连接层1:输入数据为6*6*256,使用RELU作为激活函数,该层以Batch Normalization做dropout层,经过改成后数据变为4096*1。Fully connected layer 1: The input data is 6*6*256, and RELU is used as the activation function. This layer uses Batch Normalization is the dropout layer, and the data becomes 4096*1 after the change.
以Batch Normalization做dropout层可以在防止过拟合的同时也加快模型训练时的速度。Using Batch Normalization as the dropout layer can prevent overfitting and speed up model training.
全连接层2:全连接层2和全连接层1类似,输入4096*1,输出同样为4096*1。Fully connected layer 2: Fully connected layer 2 is similar to fully connected layer 1, the input is 4096*1, and the output is also 4096*1.
全连接层3:输入数据为4096*1,输出为1000*1。Fully connected layer 3: Input data is 4096*1, output is 1000*1.
softmax分类器:这里的softmax分类器具体包括两个分类,分类标示0即代表合法,分类标示1则代表不合法。Softmax classifier: The softmax classifier here specifically includes two classifications, the classification label 0 means legal, and the classification label 1 means illegal.
可选地,在所述步骤S102之前,还包括:Optionally, before the step S102, the method further includes:
获取预设数量的训练图片,所述训练图片携带判定标签信息;Acquiring a preset number of training pictures, the training pictures carrying judgment label information;
将Alexnet卷积神经网络的批尺寸参数batch_size、训练轮次参数epochs、及验证集比例参数validation_split进行设置,并输入所述训练图片,得到所述预训练的Alexnet卷积神经网络模型。Set the batch size parameter batch_size of the Alexnet convolutional neural network, the training round parameter epochs, and the validation set ratio parameter validation_split, and input the training picture to obtain the pre-trained Alexnet convolutional neural network model.
训练图片为包含电子签名、并且携带判定标签信息的图片,判定标签为0表明该训练图片包含的电子签名合法,判定标签为1表明该训练图片包含的电子签名不合法。训练图片中携带的判定标签信息可以为工作人员预先通过人工判断而标示上的标签。获取预设数量的训练图片,例如获取97150张包含电子签名的图片作为训练图片,训练图片包含了正样本图片(携带的判定标签为0的合法图片,如图2a、图2b、图2c所示)及负样本图片(携带的判定标签为1的不合法图片,如图3a、图3b、图3c所示),且正样本图片与负样本图片的比例均衡,例如在97150张训练图片中,正样本数量为56600张,负样本数量为40550张。在获取预设数量的训练图片后,对训练图片进行向量转换处理。The training picture is a picture that contains an electronic signature and carries determination tag information. A determination tag of 0 indicates that the electronic signature contained in the training picture is legal, and a determination tag of 1 indicates that the electronic signature contained in the training picture is illegal. The judgment label information carried in the training picture may be a label marked by the staff through manual judgment in advance. Obtain a preset number of training pictures, for example, 97150 pictures containing electronic signatures are obtained as training pictures. The training pictures contain positive sample pictures (legitimate pictures with a judgment label of 0 carried, as shown in Figure 2a, Figure 2b, and Figure 2c) ) And negative sample pictures (carrying illegal pictures with a judgment label of 1, as shown in Figure 3a, Figure 3b, and Figure 3c), and the ratio of positive sample pictures and negative sample pictures is balanced. For example, in 97150 training pictures, The number of positive samples is 56,600, and the number of negative samples is 40,550. After obtaining a preset number of training pictures, vector conversion processing is performed on the training pictures.
设置Alexnet卷积神经网络的超参数,所述超参数包括批尺寸参数batch_size、训练轮次参数epochs、及验证集比例参数validation_split,例如将batch_size设置为128,epochs设置为100,将validation_split设置为0.2(代表训练图片中有0.2比例的图片作为验证集)。将上述已经过向量转化的训练图片输入设置好超参数的Alexnet卷积神经网络进行训练,训练过程中Alexnet卷积神经网络自主调整其它参数,最终得到训练好的Alexnet卷积神经网络模型,该训练好的Alexnet卷积神经网络模型作为预训练的Alexnet卷积神经网络模型。Set the hyperparameters of the Alexnet convolutional neural network. The hyperparameters include the batch size parameter batch_size, the training round parameter epochs, and the validation set scale parameter validation_split. For example, set batch_size to 128, epochs to 100, and validation_split to 0.2 (It means that there are 0.2 ratio pictures in the training pictures as the validation set). Input the above vector-transformed training images into the Alexnet convolutional neural network with hyperparameters set for training. During the training process, the Alexnet convolutional neural network automatically adjusts other parameters, and finally a trained Alexnet convolutional neural network model is obtained. This training A good Alexnet convolutional neural network model is used as a pre-trained Alexnet convolutional neural network model.
本申请实施例中,由于通过预训练的Alexnet卷积神经网络模型对包含电子签名的电子签购单进行识别判断,因此可以准确、高效地对电子签购单上的电子签名的合法性进行及时自动地识别判断,从而弥补人工的检查疏漏。In the embodiments of this application, since the pre-trained Alexnet convolutional neural network model is used to identify and judge the electronic purchase order containing the electronic signature, it is possible to accurately and efficiently check the legality of the electronic signature on the electronic purchase order in time. Automatically identify and judge to make up for manual inspection omissions.
实施例二Example two
图4示出了本申请实施例提供的第二种电子签购单识别方法的流程示意图,本发明实例的执行主体为终端设备,例如POS机,详述如下:Fig. 4 shows a schematic flow chart of a second method for identifying electronic purchase orders provided by an embodiment of the present application. The execution subject of the example of the present invention is a terminal device, such as a POS machine. The details are as follows:
在S401中,获取电子签购单图片,其中所述电子签购单图片包含电子签名。In S401, a picture of an electronic purchase order is obtained, where the picture of the electronic purchase order includes an electronic signature.
本实施例中S401与上一实施例中的S101相同,具体请参阅上一实施例中S101的相关描述,此处不赘述。S401 in this embodiment is the same as S101 in the previous embodiment. For details, please refer to the related description of S101 in the previous embodiment, which will not be repeated here.
可选地,在所述S401之前,还包括:Optionally, before the S401, it further includes:
获取滑动轨迹,根据滑动轨迹在电子签购单上生成电子签名。Obtain the sliding track, and generate an electronic signature on the electronic purchase order according to the sliding track.
当消费者刷卡完成一笔消费之后,生成电子签购单并显示在终端设备上,此时终端设备获取消费者的滑动操作,消费者可以通过触摸笔或者手指在终端设备的触摸屏上显示的电子签购单的签名栏上执行滑动操作,得到滑动轨迹。终端设备在消费者的滑动操作结束后,根据滑动轨迹,在电子签购单上生成电子签名。After the consumer completes a consumption by swiping the card, an electronic purchase order is generated and displayed on the terminal device. At this time, the terminal device obtains the consumer's sliding operation, and the consumer can use a touch pen or finger to display the electronic display on the terminal device's touch screen. Perform a sliding operation on the signature bar of the purchase order to obtain the sliding track. After the consumer's sliding operation ends, the terminal device generates an electronic signature on the electronic purchase order according to the sliding track.
在S402中,通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果。In S402, the pre-trained Alexnet convolutional neural network model is used to identify the electronic purchase order picture, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
本实施例中S402与上一实施例中的S102相同,具体请参阅上一实施例中S102的相关描述,此处不赘述。S402 in this embodiment is the same as S102 in the previous embodiment. For details, please refer to the related description of S102 in the previous embodiment, which will not be repeated here.
可选地,在所述S402之后,还包括:Optionally, after the S402, it further includes:
存储所述电子签购单图片及对应的判定结果。Store the picture of the electronic purchase order and the corresponding determination result.
将电子签购单图片及对应的判定结果进行存储,以便于之后的查询及历史信息追溯。可选地,可以提取所述电子签购单图片对应的电子签购单流水号,将流水号、电子签购单图片及对应的判定结果存储于数据库中,之后用户只需输入流水号便可查阅该电子签购单的合法信息。Store the picture of the electronic purchase order and the corresponding judgment result to facilitate subsequent query and historical information traceability. Optionally, the serial number of the electronic purchase order corresponding to the picture of the electronic purchase order can be extracted, and the serial number, the picture of the electronic purchase order and the corresponding determination result can be stored in the database, and then the user only needs to enter the serial number. Check the legal information of the electronic purchase order.
在S403中,若所述判定结果为不合法,则发出重新签名的提示。In S403, if the determination result is illegal, a prompt to re-signature is issued.
若当前的电子签购单图片上的电子签名被判定为不合法,则表明当前消费者在电子签购单上签署的电子签名不清晰,此时发出重新签名的提示。可以通过播放语音和/或在显示屏上显示文字的方式,提示消费者重新在电子签购单上签署电子签名。If the electronic signature on the current electronic purchase order picture is judged to be illegal, it means that the current consumer's electronic signature on the electronic purchase order is not clear, and a re-signature prompt is issued at this time. The consumer can be prompted to re-sign the electronic signature on the electronic purchase order by playing voice and/or displaying text on the display screen.
本申请实施例中,由于通过预训练的Alexnet卷积神经网络模型对包含电子签名的电子签购单进行识别判断,因此可以准确、高效地对电子签购单上的电子签名的合法性进行及时自动地识别判断,从而弥补人工的检查疏漏;同时在判定结果为不合法时,发出重新签名的提示,自动引导消费者重新签名,进一步减轻工作人员的工作量,提高工作效率。In the embodiments of this application, since the pre-trained Alexnet convolutional neural network model is used to identify and judge the electronic purchase order containing the electronic signature, it is possible to accurately and efficiently check the legality of the electronic signature on the electronic purchase order in time. Automatically identify and judge, so as to make up for manual inspection omissions; at the same time, when the judgment result is illegal, a re-signature prompt is issued to automatically guide consumers to re-sign, which further reduces the workload of staff and improves work efficiency.
应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本发明实施例的实施过程构成任何限定。It should be understood that the size of the sequence number of each step in the foregoing embodiment does not mean the order of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.
实施例三Example three
本申请实施例还提供一种电子签购单识别装置,如图5所示,为了便于说明,仅示出了与本申请实施例相关的部分:The embodiment of the present application also provides an electronic purchase order recognition device. As shown in FIG. 5, for ease of description, only the parts related to the embodiment of the present application are shown:
该电子签购单识别装置包括:第一获取单元51、识别单元52。其中:The device for identifying electronic purchase orders includes: a first acquiring unit 51 and an identifying unit 52. among them:
第一获取单元51,用于获取电子签购单图片,其中所述电子签购单图片包含电子签名。The first acquiring unit 51 is configured to acquire a picture of an electronic purchase order, wherein the picture of the electronic purchase order includes an electronic signature.
电子签购单是消费者刷卡消费后生成的消费凭据,完整的电子签购单上除了包含例如商铺名称、商品名称、消费金额、消费时间、流水号等基本信息外,还包含了消费者通过电子设备在电子签购单上手写的电子签名。The electronic purchase order is a consumption certificate generated by the consumer after swiping the card. In addition to basic information such as the store name, product name, consumption amount, consumption time, and serial number, the complete electronic purchase order also contains the consumer's approval Handwritten electronic signature of electronic equipment on electronic purchase order.
获取电子签购单图片,可以通过格式转化程序将电子签购单转为jpg等图片格式,或者在电子签购单展示时通过自动截屏获得该电子签购单图片。所述电子签购单图片中至少包含展示有电子签名的区域,即电子签购单需要包含电子签名信息。优选地,所述电子签购单图片只包含展示有电子签名的区域,剔除了展示了其它多余的基本信息的区域。To obtain the picture of the electronic purchase order, the electronic purchase order can be converted into a picture format such as jpg through the format conversion program, or the picture of the electronic purchase order can be obtained through automatic screenshot when the electronic purchase order is displayed. The picture of the electronic purchase order includes at least an area where the electronic signature is displayed, that is, the electronic purchase order needs to include electronic signature information. Preferably, the electronic purchase order picture only includes an area where the electronic signature is displayed, excluding the area where other redundant basic information is displayed.
识别单元52,用于通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果。The recognition unit 52 is configured to recognize the electronic purchase order picture through the pre-trained Alexnet convolutional neural network model, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
加载预先训练好的Alexnet卷积神经网络模型到运行内存中,对电子签购单图片进行识别,判断该电子签购单图片上的电子签名是否合法,即判断电子签购单上的签名是否清晰可辨认,得到判定结果。可选地,该判定结果可以通过屏幕显示文字或者图案的形式来反馈给用户,例如通过显示“合法”或者“不合法”等文字来反馈,或者,通过显示绿色图标来反馈该电子签购单上的电子签名合法、通过显示红色图标来反馈该电子签购单上的电子签名不合法。Load the pre-trained Alexnet convolutional neural network model into the running memory, identify the image of the electronic purchase order, and determine whether the electronic signature on the electronic purchase order image is legal, that is, determine whether the signature on the electronic purchase order is clear Recognizable and get the judgment result. Optionally, the judgment result can be fed back to the user in the form of text or patterns displayed on the screen, for example, by displaying texts such as "legal" or "illegal", or by displaying a green icon to feed back the electronic purchase order The electronic signature on the e-signature is legal, and the red icon is displayed to feedback that the electronic signature on the e-signature is illegal.
具体地,所述预训练的Alexnet卷积神经网络模型包括Batch Normalization层及softmax分类器。Specifically, the pre-trained Alexnet convolutional neural network model includes Batch Normalization layer and softmax classifier.
所述预训练的Alexnet卷积神经网络模型为8层深度神经网络,包括5层卷积层和3层全连接层,最后还包括一个softmax分类器,具体描述如下:The pre-trained Alexnet convolutional neural network model is an 8-layer deep neural network, including 5 layers of convolutional layers and 3 layers of fully connected layers, and finally includes a softmax classifier, which is described as follows:
卷积层1:由于电子签购单图片通常为黑白图片或者是经过灰度处理,因此此时输入数据矩阵不同于通常的227*227*3,而是227*227*1;使用线性整流函数(Rectified Linear Unit, ReLU)作为激活函数,卷积核大小为11*11,数量96个,步长为4*4,填充像素为0,数据通过这层卷积之后得到(227-11)/4+1=55,所以输出为55*55*96。第一层卷积层后还有一层局部响应归一化层(Local Response Normalization,LRN)和max_pooling池化层,LRN层作用对局部神经元的活动创建竞争机制,使得响应较大的值变得相对更大,并抑制其他反馈较小的神经元,增强了模型的泛化能力。max_pooling池化层核大小为3*3,步长为2*2,数据经过变换之后(55-3)/2+1=27,所以经过第一层所有的处理之后,数据变为27*27*96。Convolutional layer 1: Since the electronic purchase order picture is usually black and white or gray-scale processed, the input data matrix is different from the usual 227*227*3, but 227*227*1; linear rectification function is used (Rectified Linear Unit, ReLU) as the activation function, the size of the convolution kernel is 11*11, the number is 96, the step size is 4*4, the filling pixel is 0, and the data is obtained after this layer of convolution (227-11)/4+1 =55, so the output is 55*55*96. After the first layer of convolutional layer, there is a local response normalization layer (Local Response Normalization, LRN) and max_pooling pooling layer. The LRN layer creates a competition mechanism for the activity of local neurons, making the response larger. It is relatively larger and inhibits other neurons with smaller feedback, which enhances the generalization ability of the model. The core size of max_pooling pooling layer is 3*3, the step size is 2*2, and the data is transformed (55-3)/2+1=27, so after all the processing of the first layer, the data becomes 27*27 *96.
卷积层2:输入数据矩阵为27*27*96,使用RELU作为激活函数,卷积核大小为5*5,数量256个,步长为1*1,填充像素为2,数据通过这层卷积之后得到(27-5+2*2)/1+1=27,所以输出为27*27*256。卷积层2同层1一样,也有相同的LRN层和max_pooling池化层,经过池化层之后(27-3)/2+1=13,最后输出为13*13*256。Convolutional layer 2: The input data matrix is 27*27*96, using RELU as the activation function, the size of the convolution kernel is 5*5, the number is 256, the step size is 1*1, the filling pixel is 2, and the data passes through this layer After convolution, we get (27-5+2*2)/1+1=27, so the output is 27*27*256. Convolutional layer 2 is the same as layer 1, with the same LRN layer and max_pooling pooling layer. After the pooling layer (27-3)/2+1=13, the final output is 13*13*256.
卷积层3:输入数据矩阵为13*13*256,使用RELU作为激活函数,卷积核大小为3*3,数量384个,步长为1*1,填充像素为1,数据通过这层卷积之后得到(13-3+2*1)/1+1=13,所以输出为13*13*384。卷积层3没有LRN层和池化层。Convolutional layer 3: The input data matrix is 13*13*256, using RELU as the activation function, the size of the convolution kernel is 3*3, the number is 384, the step size is 1*1, the filling pixel is 1, and the data passes through this layer After convolution, we get (13-3+2*1)/1+1=13, so the output is 13*13*384. Convolutional layer 3 has no LRN layer and pooling layer.
卷积层4:输入数据矩阵为13*13*384,使用RELU作为激活函数,卷积核大小为3*3,数量384个,步长为1*1,填充像素为1,数据通过这层卷积之后得到(13-3+2*1)/1+1=13,所以输出为13*13*384。卷积层4同样没有LRN层和池化层。Convolutional layer 4: The input data matrix is 13*13*384, using RELU as the activation function, the size of the convolution kernel is 3*3, the number is 384, the step size is 1*1, the filling pixel is 1, and the data passes through this layer After convolution, we get (13-3+2*1)/1+1=13, so the output is 13*13*384. Convolutional layer 4 also has no LRN layer and pooling layer.
卷积层5:输入数据矩阵为13*13*384,使用RELU作为激活函数,卷积核大小为3*3,数量256个,步长为1*1,填充像素为1,数据通过这层卷积之后得到(13-3+2*1)/1+1=13,所以输出为13*13*256。该层还有一个max_pooling池化层,池化层核大小为3*3,步长为2*2,经过变换后得到(13-3)/2+1=6,输出为6*6*256。Convolutional layer 5: The input data matrix is 13*13*384, using RELU as the activation function, the size of the convolution kernel is 3*3, the number is 256, the step size is 1*1, the filling pixel is 1, and the data passes through this layer After convolution, we get (13-3+2*1)/1+1=13, so the output is 13*13*256. This layer also has a max_pooling pooling layer, the core size of the pooling layer is 3*3, the step size is 2*2, after transformation, it is (13-3)/2+1=6 and the output is 6*6*256 .
全连接层1:输入数据为6*6*256,使用RELU作为激活函数,该层以Batch Normalization做dropout层,经过改成后数据变为4096*1。Fully connected layer 1: The input data is 6*6*256, and RELU is used as the activation function. This layer uses Batch Normalization is the dropout layer, and the data becomes 4096*1 after the change.
以Batch Normalization做dropout层可以在防止过拟合的同时也加快模型训练时的速度。Using Batch Normalization as the dropout layer can prevent overfitting and speed up model training.
全连接层2:全连接层2和全连接层1类似,输入4096*1,输出同样为4096*1。Fully connected layer 2: Fully connected layer 2 is similar to fully connected layer 1, the input is 4096*1, and the output is also 4096*1.
全连接层3:输入数据为4096*1,输出为1000*1。Fully connected layer 3: Input data is 4096*1, output is 1000*1.
softmax分类器:这里的softmax分类器具体包括两个分类,分类标示0即代表合法,分类标示1则代表不合法。Softmax classifier: The softmax classifier here specifically includes two classifications, the classification label 0 means legal, and the classification label 1 means illegal.
可选地,所述电子签购单识别装置还包括:Optionally, the electronic purchase order recognition device further includes:
训练单元,用于获取预设数量的训练图片,所述训练图片携带判定标签信息;将Alexnet卷积神经网络的批尺寸参数batch_size、训练轮次参数epochs、及验证集比例参数validation_split进行设置,并输入所述训练图片,得到所述预训练的Alexnet卷积神经网络模型。The training unit is used to obtain a preset number of training pictures, the training pictures carry judgment label information; set the batch size parameter batch_size of the Alexnet convolutional neural network, the training round parameter epochs, and the validation set ratio parameter validation_split, and Input the training picture to obtain the pre-trained Alexnet convolutional neural network model.
可选地,所述电子签购单识别装置还包括:Optionally, the electronic purchase order recognition device further includes:
电子签名生成单元,用于获取滑动轨迹,根据滑动轨迹在电子签购单上生成电子签名。The electronic signature generating unit is used to obtain the sliding track, and generate an electronic signature on the electronic purchase order according to the sliding track.
可选地,所述电子签购单识别装置还包括:Optionally, the electronic purchase order recognition device further includes:
预处理单元,用于对所述电子签购单图片进行预处理。The preprocessing unit is used to preprocess the picture of the electronic purchase order.
可选地,所述电子签购单识别装置还包括:Optionally, the electronic purchase order recognition device further includes:
提示单元,用于若所述判定结果为不合法,则发出重新签名的提示。The prompt unit is used to send out a prompt to re-sign if the result of the determination is illegal.
可选地,所述电子签购单识别装置还包括:Optionally, the electronic purchase order recognition device further includes:
存储单元,用于存储所述电子签购单图片及对应的判定结果。The storage unit is used to store the picture of the electronic purchase order and the corresponding determination result.
本发明实施例中,由于通过预训练的Alexnet卷积神经网络模型对包含电子签名的电子签购单进行识别判断,因此可以准确、高效地对电子签购单上的电子签名的合法性进行及时自动地识别判断,从而弥补人工的检查疏漏。In the embodiment of the present invention, since the pre-trained Alexnet convolutional neural network model is used to identify and judge the electronic purchase order containing the electronic signature, the legality of the electronic signature on the electronic purchase order can be accurately and efficiently checked in time. Automatically identify and judge to make up for manual inspection omissions.
实施例四Example four
图6是本发明一实施例提供的终端设备的示意图。如图6所示,该实施例的终端设备6包括:处理器60、存储器61以及存储在所述存储器61中并可在所述处理器60上运行的计算机程序62,例如电子签购单识别程序。所述处理器60执行所述计算机程序62时实现上述各个电子签购单识别方法实施例中的步骤,例如图1所示的步骤S101至S102。或者,所述处理器60执行所述计算机程序62时实现上述各装置实施例中各模块/单元的功能,例如图5所示模块51至52的功能。Fig. 6 is a schematic diagram of a terminal device provided by an embodiment of the present invention. As shown in FIG. 6, the terminal device 6 of this embodiment includes: a processor 60, a memory 61, and a computer program 62 stored in the memory 61 and running on the processor 60, such as electronic purchase order recognition program. When the processor 60 executes the computer program 62, the steps in the above embodiments of the electronic purchase order recognition method are implemented, for example, steps S101 to S102 shown in FIG. 1. Alternatively, when the processor 60 executes the computer program 62, the functions of the modules/units in the foregoing device embodiments, such as the functions of the modules 51 to 52 shown in FIG. 5, are realized.
示例性的,所述计算机程序62可以被分割成一个或多个模块/单元,所述一个或者多个模块/单元被存储在所述存储器61中,并由所述处理器60执行,以完成本发明。所述一个或多个模块/单元可以是能够完成特定功能的一系列计算机程序指令段,该指令段用于描述所述计算机程序62在所述终端设备6中的执行过程。例如,所述计算机程序62可以被分割成第一获取单元、识别单元,各单元具体功能如下:Exemplarily, the computer program 62 may be divided into one or more modules/units, and the one or more modules/units are stored in the memory 61 and executed by the processor 60 to complete this invention. The one or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 62 in the terminal device 6. For example, the computer program 62 may be divided into a first acquisition unit and an identification unit, and the specific functions of each unit are as follows:
第一获取单元,用于获取电子签购单图片,其中所述电子签购单图片包含电子签名。The first obtaining unit is configured to obtain a picture of an electronic purchase order, wherein the picture of the electronic purchase order includes an electronic signature.
识别单元,用于通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果。The recognition unit is configured to recognize the electronic purchase order picture through the pre-trained Alexnet convolutional neural network model, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
所述终端设备6可以是桌上型计算机、笔记本、掌上电脑及云端服务器等计算设备。所述终端设备可包括,但不仅限于,处理器60、存储器61。本领域技术人员可以理解,图6仅仅是终端设备6的示例,并不构成对终端设备6的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件,例如所述终端设备还可以包括输入输出设备、网络接入设备、总线等。The terminal device 6 may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server. The terminal device may include, but is not limited to, a processor 60 and a memory 61. Those skilled in the art can understand that FIG. 6 is only an example of the terminal device 6 and does not constitute a limitation on the terminal device 6. It may include more or less components than shown in the figure, or a combination of certain components, or different components. For example, the terminal device may also include input and output devices, network access devices, buses, etc.
所称处理器60可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器 (Digital Signal Processor,DSP)、专用集成电路 (Application Specific Integrated Circuit,ASIC)、现场可编程门阵列 (Field-Programmable Gate Array,FPGA) 或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The so-called processor 60 may be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
所述存储器61可以是所述终端设备6的内部存储单元,例如终端设备6的硬盘或内存。所述存储器61也可以是所述终端设备6的外部存储设备,例如所述终端设备6上配备的插接式硬盘,智能存储卡(Smart Media Card, SMC),安全数字(Secure Digital, SD)卡,闪存卡(Flash Card)等。进一步地,所述存储器61还可以既包括所述终端设备6的内部存储单元也包括外部存储设备。所述存储器61用于存储所述计算机程序以及所述终端设备所需的其他程序和数据。所述存储器61还可以用于暂时地存储已经输出或者将要输出的数据。The memory 61 may be an internal storage unit of the terminal device 6, such as a hard disk or memory of the terminal device 6. The memory 61 may also be an external storage device of the terminal device 6, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), or a secure digital (Secure Digital, SD) equipped on the terminal device 6. Flash memory card Card) etc. Further, the memory 61 may also include both an internal storage unit of the terminal device 6 and an external storage device. The memory 61 is used to store the computer program and other programs and data required by the terminal device. The memory 61 can also be used to temporarily store data that has been output or will be output.
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将所述装置的内部结构划分成不同的功能单元或模块,以完成以上描述的全部或者部分功能。实施例中的各功能单元、模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中,上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。另外,各功能单元、模块的具体名称也只是为了便于相互区分,并不用于限制本申请的保护范围。上述系统中单元、模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that for the convenience and conciseness of the description, only the division of the above functional units and modules is used as an example. In actual applications, the above functions can be allocated to different functional units, Module completion means dividing the internal structure of the device into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist alone physically, or two or more units can be integrated into one unit. The above-mentioned integrated units can be hardware-based Formal realization can also be realized in the form of software functional units. In addition, the specific names of the functional units and modules are only used to facilitate distinguishing each other, and are not used to limit the protection scope of the present application. For the specific working process of the units and modules in the foregoing system, reference may be made to the corresponding process in the foregoing method embodiment, which is not repeated here.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述或记载的部分,可以参见其它实施例的相关描述。In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail or recorded in an embodiment, reference may be made to related descriptions of other embodiments.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。A person of ordinary skill in the art may be aware that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered as going beyond the scope of the present invention.
在本发明所提供的实施例中,应该理解到,所揭露的装置/终端设备和方法,可以通过其它的方式实现。例如,以上所描述的装置/终端设备实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通讯连接可以是通过一些接口,装置或单元的间接耦合或通讯连接,可以是电性,机械或其它的形式。In the embodiments provided by the present invention, it should be understood that the disclosed device/terminal device and method may be implemented in other ways. For example, the device/terminal device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units. Or components can be combined or integrated into another system, or some features can be omitted or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
所述集成的模块/单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明实现上述实施例方法中的全部或部分流程,也可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一计算机可读存储介质中,该计算机程序在被处理器执行时,可实现上述各个方法实施例的步骤。其中,所述计算机程序包括计算机程序代码,所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读介质可以包括:能够携带所述计算机程序代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、电载波信号、电信信号以及软件分发介质等。需要说明的是,所述计算机可读介质包含的内容可以根据司法管辖区内立法和专利实践的要求进行适当的增减,例如在某些司法管辖区,根据立法和专利实践,计算机可读介质不包括电载波信号和电信信号。If the integrated module/unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the present invention implements all or part of the processes in the above-mentioned embodiments and methods, and can also be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the program is executed by the processor, the steps of the foregoing method embodiments can be implemented. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunications signal, and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately added or deleted according to the requirements of the legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to the legislation and patent practice, the computer-readable medium Does not include electrical carrier signals and telecommunication signals.
以上所述实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围,均应包含在本发明的保护范围之内。The above-mentioned embodiments are only used to illustrate the technical solutions of the present invention, not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that it can still implement the foregoing The technical solutions recorded in the examples are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in Within the protection scope of the present invention.

Claims (10)

  1. 一种电子签购单识别方法,其特征在于,包括:An electronic purchase order recognition method, characterized in that it comprises:
    获取电子签购单图片,其中所述电子签购单图片包含电子签名;Obtaining a picture of an electronic purchase order, where the picture of the electronic purchase order includes an electronic signature;
    通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果。The pre-trained Alexnet convolutional neural network model is used to identify the electronic purchase order picture, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
  2. 根据权利要求1所述的电子签购单识别方法,其特征在于,在所述获取电子签购单图片之前,还包括:The method for identifying an electronic purchase order according to claim 1, wherein before said obtaining the picture of the electronic purchase order, the method further comprises:
    获取滑动轨迹,根据滑动轨迹在电子签购单上生成电子签名。Obtain the sliding track, and generate an electronic signature on the electronic purchase order according to the sliding track.
  3. 根据权利要求1所述的电子签购单识别方法,其特征在于,在所述获取电子签购单图片之后,还包括:The method for identifying an electronic purchase order according to claim 1, wherein after said obtaining the picture of the electronic purchase order, the method further comprises:
    对所述电子签购单图片进行预处理。Preprocessing the picture of the electronic purchase order.
  4. 根据权利要求1所述的电子签购单识别方法,其特征在于,所述预训练的Alexnet卷积神经网络模型包括Batch Normalization层及softmax分类器。The electronic purchase order recognition method according to claim 1, wherein the pre-trained Alexnet convolutional neural network model includes a Batch Normalization layer and a softmax classifier.
  5. 根据权利要求1所述的电子签购单识别方法,其特征在于,其特征在于,在所述通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果之前,还包括:The electronic purchase order recognition method according to claim 1, characterized in that, in the pre-trained Alexnet convolutional neural network model, the electronic purchase order picture is recognized, and the electronic purchase order is determined Whether the electronic signature on the picture of the purchase order is legal, before the judgment result is obtained, it also includes:
    获取预设数量的训练图片,所述训练图片携带判定标签信息;Acquiring a preset number of training pictures, the training pictures carrying judgment label information;
    将Alexnet卷积神经网络的批尺寸参数batch_size、训练轮次参数epochs、及验证集比例参数validation_split进行设置,并输入所述训练图片,得到所述预训练的Alexnet卷积神经网络模型。Set the batch size parameter batch_size of the Alexnet convolutional neural network, the training round parameter epochs, and the validation set ratio parameter validation_split, and input the training picture to obtain the pre-trained Alexnet convolutional neural network model.
  6. 根据权利要求1至5任意一项所述的电子签购单识别方法,其特征在于,在所述通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果之后,还包括:The electronic purchase order identification method according to any one of claims 1 to 5, wherein the pre-trained Alexnet convolutional neural network model is used to identify the electronic purchase order picture, and determine the Whether the electronic signature on the picture of the electronic purchase order is legal, after the judgment result is obtained, it also includes:
    若所述判定结果为不合法,则发出重新签名的提示。If the result of the determination is illegal, a prompt to re-signature is issued.
  7. 根据权利要求1至5任意一项所述的电子签购单识别方法,其特征在于,在所述通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果之后,还包括:The electronic purchase order identification method according to any one of claims 1 to 5, wherein the pre-trained Alexnet convolutional neural network model is used to identify the electronic purchase order picture, and determine the Whether the electronic signature on the picture of the electronic purchase order is legal, after the judgment result is obtained, it also includes:
    存储所述电子签购单图片及对应的判定结果。Store the picture of the electronic purchase order and the corresponding determination result.
  8. 一种电子签购单识别装置,其特征在于,包括:An electronic purchase order recognition device, characterized in that it comprises:
    第一获取单元,用于获取电子签购单图片,其中所述电子签购单图片包含电子签名;The first obtaining unit is configured to obtain a picture of an electronic purchase order, wherein the picture of the electronic purchase order includes an electronic signature;
    识别单元,用于通过预训练的Alexnet卷积神经网络模型对所述电子签购单图片进行识别,判断所述电子签购单图片上的电子签名是否合法,得到判定结果。The recognition unit is configured to recognize the electronic purchase order picture through the pre-trained Alexnet convolutional neural network model, determine whether the electronic signature on the electronic purchase order picture is legal, and obtain the determination result.
  9. 一种终端设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现如权利要求1至7任一项所述方法的步骤。A terminal device, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the computer program as claimed in claims 1 to 7 Steps of any of the methods.
  10. 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1至7任一项所述方法的步骤。A computer-readable storage medium storing a computer program, wherein the computer program implements the steps of the method according to any one of claims 1 to 7 when the computer program is executed by a processor.
PCT/CN2019/076042 2019-02-25 2019-02-25 Electronic purchase order recognition method and apparatus, and terminal device. WO2020172767A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980092322.4A CN113474786A (en) 2019-02-25 2019-02-25 Electronic purchase order identification method and device and terminal equipment
PCT/CN2019/076042 WO2020172767A1 (en) 2019-02-25 2019-02-25 Electronic purchase order recognition method and apparatus, and terminal device.

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/076042 WO2020172767A1 (en) 2019-02-25 2019-02-25 Electronic purchase order recognition method and apparatus, and terminal device.

Publications (1)

Publication Number Publication Date
WO2020172767A1 true WO2020172767A1 (en) 2020-09-03

Family

ID=72238791

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/076042 WO2020172767A1 (en) 2019-02-25 2019-02-25 Electronic purchase order recognition method and apparatus, and terminal device.

Country Status (2)

Country Link
CN (1) CN113474786A (en)
WO (1) WO2020172767A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113920589A (en) * 2021-10-28 2022-01-11 平安银行股份有限公司 Signature identification method, device, equipment and medium based on artificial intelligence

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108154136A (en) * 2018-01-15 2018-06-12 众安信息技术服务有限公司 For identifying the method, apparatus of writing and computer-readable medium

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108154136A (en) * 2018-01-15 2018-06-12 众安信息技术服务有限公司 For identifying the method, apparatus of writing and computer-readable medium

Also Published As

Publication number Publication date
CN113474786A (en) 2021-10-01

Similar Documents

Publication Publication Date Title
CN109658478B (en) Method and system for providing enterprise portrait
US10515407B2 (en) Systems and methods for identification document processing and business workflow integration
US11321772B2 (en) Systems and methods for identification document processing and business workflow integration
US9058580B1 (en) Systems and methods for identification document processing and business workflow integration
US9058515B1 (en) Systems and methods for identification document processing and business workflow integration
CN110705952A (en) Contract auditing method and device
US20150220778A1 (en) Smart optical input/output (i/o) extension for context-dependent workflows
CN112580684B (en) Target detection method, device and storage medium based on semi-supervised learning
WO2015143237A1 (en) Systems and methods for identification document processing and business workflow integration
CN110634223A (en) Bill verification method and device
WO2022194062A1 (en) Disease label detection method and apparatus, electronic device, and storage medium
CN115758451A (en) Data labeling method, device, equipment and storage medium based on artificial intelligence
CN113704474B (en) Bank outlet equipment operation guide generation method, device, equipment and storage medium
WO2020172767A1 (en) Electronic purchase order recognition method and apparatus, and terminal device.
CN109508845A (en) Processing method, device and the computer readable storage medium of cost data
CN111428725A (en) Data structuring processing method and device and electronic equipment
CN113221888B (en) License plate number management system test method and device, electronic equipment and storage medium
CN115050042A (en) Claims data entry method and device, computer equipment and storage medium
CN113822215A (en) Equipment operation guide file generation method and device, electronic equipment and storage medium
CN112183520A (en) Intelligent data information processing method and device, electronic equipment and storage medium
CN110751110A (en) Identity image information verification method, device, equipment and storage medium
EP3132381A1 (en) Smart optical input/output (i/o) extension for context-dependent workflows
CN113077048B (en) Seal matching method, system, equipment and storage medium based on neural network
CN110618923B (en) Data monitoring method and system
CN114299520A (en) Supplier qualification auditing method and auditing device based on dual-model fusion

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19917353

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19917353

Country of ref document: EP

Kind code of ref document: A1