WO2019242644A1

WO2019242644A1 - Ticket checking method and apparatus based on manual ticket checking interface image, medium and electronic device

Info

Publication number: WO2019242644A1
Application number: PCT/CN2019/091898
Authority: WO
Inventors: 郁昌存; 安耀祖
Original assignee: 京东数字科技控股有限公司
Priority date: 2018-06-20
Filing date: 2019-06-19
Publication date: 2019-12-26
Also published as: CN108932754A; CN108932754B

Abstract

A ticket checking method and apparatus based on a manual ticket checking interface image, a medium and an electronic device, said method comprising: acquiring a manual ticket checking interface image (S101); parsing a first region image (201) to obtain a blur value, and determining, on the basis of the blur value, whether the first region image (201) is a ticket picture (S102); parsing a second region image (202) to determine a ticket status (S103); if it is determined that the first region image (201) is the ticket picture and the ticket status is consistent, parsing a third region image (203) to obtain a credential image (S104); and comparing the identity certificate image with a face image captured by a camera to obtain a comparison result, and performing ticket checking on the basis of the comparison result (S105). The present invention allows a user to perform self-service face scanning to check in on the basis of a conventional manual ticket checking system in a non-intrusive manner, and achieves the following advantages: the coupling degree between various modules is low, gate machines can be reused, and the applications can be migrated, reducing the waste of resources.

Description

Ticket checking method, device, medium and electronic device based on manual ticket checking interface image

Technical field

The present invention relates to the technical field of ticket gates and face recognition technology, and in particular, to a ticket checking method based on a manual ticket checking interface image and a ticket checking device based on a manual ticket checking interface image.

Background technique

With the continuous development and improvement of Internet technology, the impact of technology on railways is unstoppable. "Brushing face into the station" brushes out people's new travel experience. With the power of technology, by brushing their faces and checking tickets to enter the station, people's travel is more convenient. However, while providing convenience to passengers, railways need to purchase a large number of all-in-one machines for ticketing, ticketing, and identification (brushing into the station equipment), and face huge transformation costs. It is reported that the electronic ticket will also be launched in recent years, which means that the current personal ticket machine equipment will face another transformation, and will continue to invest in new transformation costs.

Existing technical solution: All the ticket and ticket all-in-one machines are independent of the existing manual ticket checking system, redeveloping the ticket data interface, opening the interface to third-party ticket and ticket machine manufacturers, and integrating face recognition technology and gate equipment control To form the current ticket machine.

Disadvantages of the existing technical solution: First, reopening independently of the existing ticket checking system will undoubtedly increase more development and commissioning costs; second, the railway will open the ticket interface to the third-party bidding vendor of the all-in-one ticket machine. Strict, it may also cause data security issues; finally, with the introduction of electronic tickets, the existing ticket machine equipment will face the transformation again, as a transitional autonomous face-to-face solution, the cost of transformation of the existing technology solution is extremely high. high.

It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of the present invention, and therefore may include information that does not constitute the prior art known to those skilled in the art.

Summary of the Invention

The purpose of the embodiments of the present invention is to provide a ticket checking method based on an image of a manual ticket checking interface and a ticket checking device based on an image of a manual ticket checking interface, so as to overcome at least a certain degree of difficulty in reconstruction due to limitations and defects of related technologies , High cost, and easy leakage of passenger personal information.

Other features and advantages of the embodiments of the present invention will become apparent from the following detailed description, or may be learned in part through the practice of the present invention.

According to a first aspect of the embodiments of the present invention, a ticket checking method based on an image of a manual ticket checking interface is provided, including:

Obtaining an image of a manual ticket checking interface, wherein the image of the manual ticket checking interface includes at least a first area image, a second area image, and a third area image;

Analyze the first area image to obtain a blur value, and determine whether the first area image is a ticket picture based on the blur value;

Analyze the second area image to determine a dominant color of the second area image, and determine a ticket status based on the dominant color;

When it is determined that the first area image is a ticket picture and the ticket status is consistent, analyzing the third area image to obtain a certificate image;

Match the credential image with the face image collected by the camera to obtain a matching result, and check the ticket based on the matching result.

According to some embodiments of the present invention, based on the foregoing solution, the parsing the first area image to obtain a blur value, and determining whether the first area image is a ticket picture based on the blur value, including:

Extracting R channel data of the first region image, and obtaining a blur value of the first region image based on the R channel data;

Comparing the blur value of the first region image with a preset threshold;

Determining that the blur value of the first area image is greater than or equal to a preset threshold, and determining that the first area image is a parity image;

If the blur value of the first area image is less than a preset threshold, it is determined that the first area image is empty.

According to some embodiments of the present invention, based on the foregoing solution, the parsing the second area image to determine a dominant color of the second area image, and determining a ticket status based on the dominant color, including:

Transforming the RGB color space of the second region image into an HSV color space; wherein the RGB color space includes at least superimposed data of red, green, and blue colors in the second region image, and the HSV color space includes at least all The hue data, saturation data, and brightness data of the second area image are described;

Analyze the hue data in the HSV color space to determine the dominant color of the second region image;

Based on the dominant color of the second region image, a ticket verification result is determined.

According to some embodiments of the present invention, based on the foregoing solution, determining the ticket verification result based on the dominant color of the second region image includes:

Determine whether the dominant color of the image in the second region is green;

If the dominant color of the second area image is green, determining that the ticket verification result is consistent;

If the dominant color of the second region image is not green, determining whether the dominant color of the second region image is red;

If the dominant color of the second area image is red, determining that the ticket verification result is invalid;

If the dominant color of the second area image is not red, it is determined that the ticket verification result is pending.

According to some embodiments of the present invention, based on the foregoing scheme, after the determining that the ticket verification result is pending, the method further includes:

Binarize the second region image whose ticket verification result is pending to obtain a black and white image of the text;

Performing horizontal projection and vertical projection of the black and white image to determine a text area of the second area image;

Recognizing text in a text area of the second area image to obtain text data;

Match the text data with a preset regular expression, and if they match, convert the ticket verification result of the second area image from pending to match; if they do not match, verify the ticket of the second area image The result is converted from pending to invalid.

According to some embodiments of the present invention, based on the foregoing solution, the parsing the third region image to obtain a credential image includes:

Detecting the third region image through a preset face detection algorithm to determine whether a portrait image exists in the third region image;

When it is determined that a portrait image exists in the third region image, the portrait image is extracted to obtain a credential image.

According to some embodiments of the present invention, based on the foregoing solution, matching the credential image with a face image collected by a camera to obtain a matching result and outputting the matching result includes:

Determining that the ticket checking is successful when the document image matches the face image, generating a successful matching result of the ticket checking, and sending the matching result to the ticket checking gate to control the ticket checking gate to open;

When the credential image does not match the face image, it is determined that the ticket checking is successful, a matching result of the ticket checking failure is generated, and a prompt message indicating that the ticket checking fails is issued.

According to a second aspect of the embodiments of the present invention, a ticket checking device based on an image of a manual ticket checking interface is provided, including: an acquisition module, a first analysis module, a second analysis module, a third analysis module, and a matching module;

An obtaining module, configured to obtain an image of a manual ticket checking interface, wherein the image of the manual ticket checking interface includes at least a first area image, a second area image, and a third area image;

A first analysis module, configured to analyze the first area image to obtain a blur value, and determine whether the first area image is a ticket picture based on the blur value;

A second analysis module, configured to analyze the second area image, determine a dominant color of the second area image, and determine a ticket status based on the dominant color;

A third analysis module, configured to: when it is determined that the first area image is a ticket picture and the ticket status is consistent, analyze the third area image to obtain a certificate image;

A matching module is configured to match the document image with a face image collected by a camera to obtain a matching result, and perform a ticket check based on the matching result.

According to some embodiments of the present invention, based on the foregoing solution, the first parsing module is specifically configured to:

Comparing the blur value of the first region image with a preset threshold;

According to some embodiments of the present invention, based on the foregoing solution, the second parsing module is specifically configured to:

Transforming the RGB color space of the second region image into an HSV color space; wherein the RGB color space includes at least superimposed data of red, green, and blue colors in the second region image, and the HSV color space includes at least The hue data, saturation data, and brightness data of the second area image are described;

Recognizing text in a text area of the second area image to obtain text data;

According to some embodiments of the present invention, based on the foregoing solution, the third parsing module is specifically configured to:

According to some embodiments of the present invention, based on the foregoing solution, the matching module is specifically configured to:

According to a third aspect of the embodiments of the present invention, there is provided a computer-readable medium having stored thereon a computer program that, when executed by a processor, implements a manual ticket-based interface as described in the first aspect of the above embodiment. Image checking method.

According to a fourth aspect of the embodiments of the present invention, there is provided an electronic device including: one or more processors; a storage device for storing one or more programs, and when the one or more programs are used by the one When being executed by one or more processors, the one or more processors are caused to implement the ticket checking method based on the manual ticket checking interface image as described in the first aspect of the foregoing embodiment.

The technical solution provided by the embodiment of the present invention may include the following beneficial effects:

In the technical solution provided by some embodiments of the present invention, an image of a manual ticket checking interface is obtained, wherein the image of the manual ticket checking interface includes at least a first area image, a second area image, and a third area image; The area image is analyzed to obtain a blur value, and whether the first area image is a ticket picture is determined based on the blur value; the second area image is analyzed to determine the dominant color of the second area image. The dominant color determines the ticket status; when it is determined that the first area image is a ticket picture and the ticket status is consistent, the third area image is analyzed to obtain a credential image; the credential image and a camera The collected face images are matched to obtain a matching result, and the ticket is checked based on the matching result. In this way, the traditional manual ticket checking system can be transformed into a device where passengers can brush their faces and enter the station in a low-cost and non-invasive manner. The coupling degree of each module in the device provided by the embodiment of the present invention is low, the gate can be reused, and the application can be migrated. , Provides a transitional solution for the implementation of later electronic tickets, greatly reducing the waste of resources.

It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and should not limit the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings herein are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present invention, and together with the description serve to explain the principles of the present invention. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts. In the drawings:

FIG. 1 schematically illustrates a flowchart of a ticket checking method based on a manual ticket checking interface image according to an embodiment of the present invention;

FIG. 2 schematically illustrates an image of a manual ticket checking interface according to an embodiment of the present invention; FIG.

FIG. 3A schematically illustrates that the first area image is ticket information according to an embodiment of the present invention; FIG.

3B schematically illustrates a first region image without ticket information according to an embodiment of the present invention;

4 is a schematic flowchart of determining whether a first area is a ticket image according to an embodiment of the present invention;

FIG. 5 schematically illustrates a display content of a second region image in a traffic permission state according to an embodiment of the present invention; FIG.

FIG. 6 schematically illustrates a display content of a second region image in a non-traffic state according to an embodiment of the present invention; FIG.

FIG. 7 schematically illustrates a flowchart of determining a color of a second image region according to an embodiment of the present invention; FIG.

8 schematically illustrates a block diagram of a ticket checking device based on an image of a manual ticket checking interface according to an embodiment of the present invention;

FIG. 9 is a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present invention.

detailed description

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, providing these embodiments makes the present invention more comprehensive and complete, and conveys the concepts of the exemplary embodiments comprehensively. To those skilled in the art.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a full understanding of the embodiments of the present invention. However, those skilled in the art will realize that the technical solutions of the present invention may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other instances, well-known methods, devices, implementations or operations have not been shown or described in detail to avoid obscuring aspects of the present invention.

The block diagrams shown in the drawings are merely functional entities and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in the form of software, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices. entity.

The flowchart shown in the accompanying drawings is only an exemplary description, and it is not necessary to include all content and operations / steps, nor does it have to be performed in the order described. For example, some operations / steps can also be decomposed, and some operations / steps can be merged or partially merged. Therefore, the actual execution order may be changed according to the actual situation.

FIG. 1 schematically illustrates a flowchart of a ticket checking method based on an image of a manual ticket checking interface according to an embodiment of the present invention.

Referring to FIG. 1, a ticket checking method based on a manual ticket checking interface image according to an embodiment of the present invention includes the following steps:

Step S110, obtaining an image of the manual ticket checking interface;

Step S120: Analyze the first area image to obtain a blur value, and determine whether the first area image is a ticket picture based on the blur value;

Step S130: Analyze the second area image to determine the dominant color of the second area image, and determine the ticket status based on the dominant color;

Step S140: When it is determined that the first area image is a ticket picture and the ticket status is consistent, analyze the third area image to obtain a credential image;

Step S150: Match the document image with the face image collected by the camera to obtain a matching result, and perform a ticket check based on the matching result.

The technical solution of the embodiment shown in FIG. 1 can transform the traditional manual ticket checking system into a device that passengers can brush their faces and enter the station in a low cost and non-invasive manner by analyzing the images of the existing manual ticket checking interface. The devices provided in the embodiments have a low coupling degree, reusable gates, and application migration, which provides a transition solution for the implementation of later electronic tickets, which greatly reduces the waste of resources.

The implementation details of each step shown in FIG. 1 are described in detail below:

In step S110, an image of a manual ticket checking interface is acquired.

In an embodiment of the present invention, as shown in FIG. 2, the image of the manual ticket checking interface includes at least three regions: a first region image 201, a second region image 202, and a third region image 203, wherein the first region image 201 may be a passenger ticket image, and the ticket image may be obtained through a ticket collection device provided on a ticket gate, such as a scanner, a code scanning device, a camera, and the like; the second area image 202 may be a ticket verification result of a manual ticket checking system The text and background color are displayed in the image of the area. The text indicates the ticket verification result. The background color is green, red, yellow, or orange. Generally, there is a certain correspondence between the background color and the text. The third area image 203 may be the passenger's ID information, including: name, ID number, ID image and other information.

In one embodiment of the present invention, by performing image analysis on the first area image, the second area image, and the third area image, key information is extracted from the interface of the existing manual ticket checking system, and this information will be used to determine the passage of passengers. Basis of status.

In step S120, the first area image is analyzed to obtain a blur value, and whether the first area image is a ticket picture is determined based on the blur value.

In an embodiment of the present invention, based on the foregoing scheme, in an embodiment of the present invention, based on the foregoing scheme, the first region image mainly has two states, as shown in FIG. 3A with ticket information, and as shown in FIG. 3B No ticket information is shown. Therefore, it is necessary to determine whether the passenger has placed the ticket on the ticket collection device of the ticket gate to remind the passenger to present the ticket and obtain the ticket information during the check.

FIG. 4 is a schematic flowchart of determining whether the first area is a ticket image according to an embodiment of the present invention. As shown in FIG. 4, the method includes the following steps:

Step S410, extracting R-channel data of the first region image, and obtaining a blur value of the first-region image based on the R-channel data;

In one embodiment of the present invention, the calculation of the blur value may be performed by using a Laplacian of the image, and the formula is as follows:

Among them, x and y represent Cartesian coordinates on the two-dimensional plane X-Y.

Step S420, comparing the blur value of the first region image with a preset threshold;

Step S430: The blur value of the first area image is greater than or equal to a preset threshold, and it is determined that the first area image is a parity image;

In step S440, if the blur value of the first region image is less than a preset threshold, it is determined that the first region image is empty.

In step S130, the second area image is analyzed to determine the dominant color of the second area image, and the ticket status is determined based on the dominant color.

In an embodiment of the present invention, the second area image is a manual ticket verification result, and the verification result includes two states of allowed traffic and not allowed traffic, wherein, as shown in FIG. 5, the second area image in the allowed traffic state The display content can include: (1) the text of "the ticket is unanimously approved" and a green background color 501; (2) the text of "the ticket has been checked" and the orange background color 502; (3) "on the station in front "Car" text content and yellow background color 503; as shown in Figure 6, the display content of the second area image in the above-mentioned disallowed traffic state may include: (1) the text content of "the ticket does not match" and the red background color 601 ; (2) the text of "Ticket Expired" and the red background color 602; (3) the text of "No Ticket Time" and the yellow background color 603; (4) The text of "The car does not pass this station" Content and a yellow background color 604; (5) the text content of "Need to verify ID card" and a yellow background color 605.

In an embodiment of the present invention, based on the foregoing solution, the second region image needs to be parsed to determine the ticket verification result. Specifically, the RGB color space of the second region image is converted to the HSV color space; wherein, the RGB color The space includes at least the superimposed data of red, green, and blue colors in the second region image. The HSV color space includes at least the hue data, saturation data, and brightness data of the second region image. The hue data in the HSV color space is analyzed. The dominant color of the image of the second region is determined; based on the dominant color of the image of the second region, a ticket verification result is determined.

In an embodiment of the present invention, based on the foregoing scheme, the color judgment is to convert the picture from the RGB space to the HSV color space by counting the pixel interval distribution of the H component in the HSV color space of the second region image. The H parameter represents color information. , That is, the position of the spectral color. This parameter is expressed by an angle. Red, green, and blue are separated by 120 degrees. The interval of the H component in the HSV space of each pixel in the picture is analyzed to find the corresponding color. And the statistical dominant color of the picture is the color of the ticket verification result we want.

In an embodiment of the present invention, based on the foregoing scheme, it is determined whether the dominant color of the second region image is green; if the dominant color of the second region image is green, it is determined that the ticket verification result is consistent; if the second region image is If the dominant color of is not green, determine whether the dominant color of the second region image is red; if the dominant color of the second region image is red, determine that the ticket verification result is invalid; if the dominant color of the second region image is not red, then The ticket verification result is determined to be pending to determine the ticket verification result. As shown in FIG. 7, the judgment process includes the following steps:

Step S701, determining a color interval of the second region image;

Step S702, it is judged whether it is green; if it is, then the result of matching the tickets is determined S703; if not, step S704 is performed;

Step S704, determine whether it is red; if yes, determine the result of the ticket being invalid S705; if not, perform step S706

In step S706, it is determined that the color of the second region image is yellow or orange, and text recognition and regular matching are performed on the second region image. If there is a match, a consistent result of the ticket is determined S707; if it does not match, the ticket verification result is determined as To be determined S708, passengers are reminded to go through the manual ticket gate.

In one embodiment of the present invention, in step S706, the second area image whose ticket verification result is pending is subjected to binarization processing to obtain a black and white image of the text; the black and white image is horizontally and vertically projected to determine the second The text area of the area image; identify the text in the text area of the second area image. Here, you can use a convolutional recurrent neural network to train based on the massively generated data set (generate pictures and text labels) to get a better parameter. model. Use the trained convolutional recurrent neural network to perform text recognition on the picture to obtain text data; match the text data with a preset regular expression, and if it matches, convert the ticket verification result of the second region image from pending to match, Pass the ticket gate; if it does not match, the ticket verification result of the second area image will be converted from pending to invalid, and the ticket gate will not be allowed to pass, and a manual ticket gate will be prompted.

In step S140, when it is determined that the first area image is a ticket picture and the ticket status is consistent, the third area image is analyzed to obtain a credential image.

In one embodiment of the present invention, a face detection is performed on a picture by using a Dlib face recognition algorithm on an ID card area to see if a photo of the document exists, so as to determine whether the user places a document.

In step S150, the document image is matched with the face image collected by the camera to obtain a matching result, and a ticket is checked based on the matching result.

In one embodiment of the present invention, a face image of the passenger document image is obtained in step S150, and the passenger's face is obtained through a camera to be compared with the photo of the passenger's face, and the gate is opened when the face comparison is passed. In this way, by simply adding a gate module and our image analysis and face recognition application, the traditional manual ticket checking system can be retrofitted non-invasively, and it can be empowered as a self-service face brushing station.

It should be noted that the foregoing is only a preferred embodiment of the present invention, and is not intended to limit the protection scope of the present invention.

The following describes the device embodiments of the present invention, which can be used to perform the above-mentioned screen control implementation method and display method of the present invention.

FIG. 8 schematically illustrates a block diagram of a ticket checking device based on an image of a manual ticket checking interface according to an embodiment of the present invention.

Referring to FIG. 8, a ticket checking device 800 based on an image of a manual ticket checking interface according to an embodiment of the present invention includes: an acquisition module 801, a first analysis module 802, a second analysis module 803, a third analysis module 804, and a matching module. 805.

An obtaining module 801 is configured to obtain an image of a manual ticket checking interface, where the image of the manual ticket checking interface includes at least a first area image, a second area image, and a third area image;

A first analysis module 802, configured to analyze the first area image to obtain a blur value, and determine whether the first area image is a ticket picture based on the blur value;

A second analysis module 803, configured to analyze the second area image, determine a dominant color of the second area image, and determine a ticket status based on the dominant color;

A third analysis module 804, configured to: when it is determined that the first area image is a ticket picture and the ticket status is consistent, analyze the third area image to obtain a credential image;

The matching module 805 is configured to match the document image with the face image collected by the camera to obtain a matching result, and perform ticket checking based on the matching result.

According to some embodiments of the present invention, based on the foregoing solution, the first parsing module 802 is specifically configured to:

Extracting R-channel data of the first region image, and obtaining a blur value of the first region image based on the R-channel data;

Comparing the blur value of the first region image with a preset threshold;

The blur value of the first area image is greater than or equal to a preset threshold, and it is determined that the first area image is a parity image;

According to some embodiments of the present invention, based on the foregoing solution, the second parsing module 803 is specifically configured to:

Converting the RGB color space of the second region image into the HSV color space; wherein the RGB color space includes at least the superimposed data of the red, green, and blue colors in the second region image, and the HSV color space includes at least the hue data of the second region image , Saturation data and brightness data;

If the dominant color of the image in the second area is green, it is determined that the ticket verification result is consistent;

If the dominant color of the second region image is not green, determine whether the dominant color of the second region image is red;

If the dominant color of the second region image is red, it is determined that the ticket verification result is invalid;

If the dominant color of the second region image is not red, it is determined that the ticket verification result is pending.

Project the black and white image horizontally and vertically to determine the text area of the second area image;

Identify the text in the text area of the second area image to obtain text data;

Match the text data with a preset regular expression. If it matches, the ticket verification result of the second area image is converted from pending to match; if it does not match, the ticket verification result of the second area image is converted from pending to invalid. .

According to some embodiments of the present invention, based on the foregoing solution, the third parsing module 804 is specifically configured to:

Detecting a third region image through a preset face detection algorithm to determine whether a portrait image exists in the third region image;

According to some embodiments of the present invention, based on the foregoing scheme, the matching module 805 is specifically configured to:

When the document image matches the face image, it is determined that the ticket checking is successful, and a matching result of successful ticket checking is generated, and the matching result is sent to the ticket checking gate to control the opening of the ticket checking gate;

When the document image and the face image do not match, the ticket checking is determined to be successful, a matching result of the ticket checking failure is generated, and a prompt message indicating that the ticket checking fails is issued.

Since each functional module of the ticket checking device based on the manual ticket checking interface image of the exemplary embodiment of the present invention corresponds to the steps of the above-mentioned example embodiment of the ticket checking method based on the manual ticket checking interface image, details that are not disclosed in the device embodiments of the present invention Please refer to the foregoing embodiment of the ticket checking method based on the manual ticket checking interface image of the present invention.

Reference is now made to FIG. 9, which is a schematic structural diagram of a computer system 900 suitable for implementing an electronic device according to an embodiment of the present invention. The computer system 900 of the electronic device shown in FIG. 9 is only an example, and should not impose any limitation on the function and scope of use of the embodiment of the present invention.

As shown in FIG. 9, the computer system 900 includes a central processing unit (CPU) 901 which can be loaded into a random access memory (RAM) 903 according to a program stored in a read-only memory (ROM) 902 or from a storage portion 1208 Instead, perform various appropriate actions and processes. In the RAM 903, various programs and data required for system operation are also stored. The CPU 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

The following components are connected to the I / O interface 905: an input portion 1206 including a keyboard, a mouse, and the like; an output portion 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), and the speaker; a storage portion 908 including a hard disk and the like ; And a communication section 909 including a network interface card such as a LAN card, a modem, and the like. The communication section 909 performs communication processing via a network such as the Internet. The driver 910 is also connected to the I / O interface 905 as necessary. A removable medium 99, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed, so that a computer program read therefrom is installed into the storage section 908 as needed.

In particular, according to an embodiment of the present invention, the process described above with reference to the flowchart may be implemented as a computer software program. For example, embodiments of the present invention include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 909, and / or installed from a removable medium 911. When this computer program is executed by a central processing unit (CPU) 901, the above-mentioned functions defined in the system of the present application are executed.

It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the foregoing. The computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programming read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing. In the present invention, the computer-readable storage medium may be any tangible medium containing or storing a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In the present invention, the computer-readable signal medium may include a data signal propagated in baseband or transmitted as a part of a carrier wave, in which a computer-readable program code is carried. Such a propagated data signal may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable medium may send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. . Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or part of code, which contains one or more of the logic functions used to implement the specified logic. Executable instructions. It should also be noted that in some alternative implementations, the functions labeled in the blocks may also occur in a different order than those labeled in the drawings. For example, two blocks represented one after the other may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, and combinations of blocks in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with A combination of dedicated hardware and computer instructions.

The units described in the embodiments of the present invention may be implemented by software or hardware. The described units may also be provided in a processor. The names of these units do not, in some cases, define the unit itself.

As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiments; or may exist separately without being assembled into the electronic device in. The computer-readable medium carries one or more programs, and when the one or more programs are executed by one of the electronic devices, the electronic device implements the screen control implementation and display method as in the above embodiment.

For example, the above electronic device may implement as shown in FIG. 1: step S110, obtaining an image of a manual ticket checking interface; step S120, analyzing the first area image to obtain a blur value, and determining whether the first area image is based on the blur value Ticket picture; step S130, analyzing the second area image to determine the dominant color of the second area image, and determining the ticket status based on the dominant color; step S140, when determining that the first area image is a ticket image and the ticket status is consistent , Analyzing the third region image to obtain a credential image; step S150, matching the credential image with the face image collected by the camera to obtain a matching result, and checking the ticket based on the matching result.

As another example, the above electronic device can implement each step shown in FIG. 4.

As another example, the above electronic device can implement each step shown in FIG. 7.

It should be noted that although several modules or units of the device for action execution are mentioned in the detailed description above, this division is not mandatory. In fact, according to an embodiment of the present invention, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of a module or unit described above can be further divided into multiple modules or units to be embodied.

Through the description of the foregoing embodiments, those skilled in the art can easily understand that the example embodiments described herein can be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a U disk, a mobile hard disk, etc.) or on a network It includes several instructions to enable a computing device (which may be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiment of the present invention.

Those skilled in the art will readily contemplate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present invention. These variations, uses, or adaptive changes follow the general principles of the present invention and include the common general knowledge or conventional technical means in the technical field not disclosed by the present invention. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It should be understood that the present invention is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from the scope thereof. The scope of the invention is only limited by the appended claims.

Claims

A ticket checking method based on an image of a manual ticket checking interface, which includes:

Obtaining an image of a manual ticket checking interface, wherein the image of the manual ticket checking interface includes at least a first area image, a second area image, and a third area image;

Analyze the first area image to obtain a blur value, and determine whether the first area image is a ticket picture based on the blur value;

Analyze the second area image to determine a dominant color of the second area image, and determine a ticket status based on the dominant color;

When it is determined that the first area image is a ticket picture and the ticket status is consistent, analyzing the third area image to obtain a credential image;

Match the credential image with the face image collected by the camera to obtain a matching result, and check the ticket based on the matching result.
The ticket checking method based on an image of a manual ticket checking interface according to claim 1, wherein the parsing the first area image to obtain a blur value, and determining whether the first area image is based on the blur value Ticket pictures, including:

Extracting R channel data of the first region image, and obtaining a blur value of the first region image based on the R channel data;

Comparing the blur value of the first region image with a preset threshold;

Determining that the blur value of the first area image is greater than or equal to a preset threshold, and determining that the first area image is a parity image;

If the blur value of the first area image is less than a preset threshold, it is determined that the first area image is empty.
The ticket checking method based on a manual ticket checking interface image according to claim 1, wherein the analysis of the second area image determines a dominant color of the second area image, and determines the dominant color based on the dominant color Ticket status, including

Transforming the RGB color space of the second region image into an HSV color space; wherein the RGB color space includes at least superimposed data of red, green, and blue colors in the second region image, and the HSV color space includes at least The hue data, saturation data, and brightness data of the second area image are described;

Analyze the hue data in the HSV color space to determine the dominant color of the second region image;

Based on the dominant color of the second region image, a ticket verification result is determined.
The ticket checking method based on an image of a manual ticket checking interface according to claim 3, wherein determining a ticket verification result based on a dominant color of the second region image comprises:

Determine whether the dominant color of the image in the second region is green;

If the dominant color of the second area image is green, determining that the ticket verification result is consistent;

If the dominant color of the second region image is not green, determining whether the dominant color of the second region image is red;

If the dominant color of the second area image is red, determining that the ticket verification result is invalid;

If the dominant color of the second area image is not red, it is determined that the ticket verification result is pending.
The ticket checking method based on a manual ticket checking interface image according to claim 4, wherein after determining that the ticket verification result is pending, the method further comprises:

Binarize the second region image whose ticket verification result is pending to obtain a black and white image of the text;

Performing horizontal projection and vertical projection of the black and white image to determine a text area of the second area image;

Recognizing text in a text area of the second area image to obtain text data;

Match the text data with a preset regular expression, and if they match, convert the ticket verification result of the second area image from pending to match; if they do not match, verify the ticket of the second area image The result is converted from pending to invalid.
The ticket checking method based on an image of a manual ticket checking interface according to claim 1, wherein the parsing the third region image to obtain a credential image comprises:

Detecting the third region image through a preset face detection algorithm to determine whether a portrait image exists in the third region image;

When it is determined that a portrait image exists in the third region image, the portrait image is extracted to obtain a credential image.
The ticket checking method based on an image of a manual ticket checking interface according to claim 1, wherein the matching the document image with a face image collected by a camera to obtain a matching result and outputting the matching result comprises:

Determining that the ticket checking is successful when the document image matches the face image, generating a successful matching result of the ticket checking, and sending the matching result to the ticket checking gate to control the ticket checking gate to open;

When the credential image does not match the face image, it is determined that the ticket checking is successful, a matching result of the ticket checking failure is generated, and a prompt message indicating that the ticket checking fails is issued.
A ticket checking device based on an image of a manual ticket checking interface, comprising: an acquisition module, a first analysis module, a second analysis module, a third analysis module, and a matching module; wherein,

An obtaining module, configured to obtain an image of a manual ticket checking interface, wherein the image of the manual ticket checking interface includes at least a first area image, a second area image, and a third area image;

A first analysis module, configured to analyze the first area image to obtain a blur value, and determine whether the first area image is a ticket picture based on the blur value;

A second analysis module, configured to analyze the second area image, determine a dominant color of the second area image, and determine a ticket status based on the dominant color;

A third analysis module, configured to: when it is determined that the first area image is a ticket picture and the ticket status is consistent, analyze the third area image to obtain a certificate image;

A matching module is configured to match the document image with a face image collected by a camera to obtain a matching result, and perform a ticket check based on the matching result.
The ticket checking device based on an image of a manual ticket checking interface according to claim 8, wherein the first analysis module is specifically configured to:

Extracting R channel data of the first region image, and obtaining a blur value of the first region image based on the R channel data;

Comparing the blur value of the first region image with a preset threshold;

Determining that the blur value of the first area image is greater than or equal to a preset threshold, and determining that the first area image is a parity image;

If the blur value of the first area image is less than a preset threshold, it is determined that the first area image is empty.
The ticket checking device based on a manual ticket checking interface image according to claim 8, wherein the second analysis module is specifically configured to:

Transforming the RGB color space of the second region image into an HSV color space; wherein the RGB color space includes at least superimposed data of red, green, and blue colors in the second region image, and the HSV color space includes at least The hue data, saturation data, and brightness data of the second area image are described;

Analyze the hue data in the HSV color space to determine the dominant color of the second region image;

Based on the dominant color of the second region image, a ticket verification result is determined.
The ticket checking device based on a manual ticket checking interface image according to claim 10, wherein the second analysis module is specifically configured to:

Determine whether the dominant color of the image in the second region is green;

If the dominant color of the second area image is green, determining that the ticket verification result is consistent;

If the dominant color of the second region image is not green, determining whether the dominant color of the second region image is red;

If the dominant color of the second area image is red, determining that the ticket verification result is invalid;

If the dominant color of the second area image is not red, it is determined that the ticket verification result is pending.
The ticket checking device based on a manual ticket checking interface image according to claim 11, wherein the second analysis module is specifically configured to:

Binarize the second region image whose ticket verification result is pending to obtain a black and white image of the text;

Performing horizontal projection and vertical projection of the black and white image to determine a text area of the second area image;

Recognizing text in a text area of the second area image to obtain text data;

Match the text data with a preset regular expression, and if they match, convert the ticket verification result of the second area image from pending to match; if they do not match, verify the ticket of the second area image The result is converted from pending to invalid.
The ticket checking device based on a manual ticket checking interface image according to claim 8, wherein the third analysis module is specifically configured to:

Detecting the third region image through a preset face detection algorithm to determine whether a portrait image exists in the third region image;

When it is determined that a portrait image exists in the third region image, the portrait image is extracted to obtain a credential image.
The ticket checking device based on an image of a manual ticket checking interface according to claim 8, wherein the matching module is specifically configured to:

Determining that the ticket checking is successful when the document image matches the face image, generating a successful matching result of the ticket checking, and sending the matching result to the ticket checking gate to control the ticket checking gate to open;

When the credential image does not match the face image, it is determined that the ticket checking is successful, a matching result of the ticket checking failure is generated, and a prompt message indicating that the ticket checking fails is issued.
A computer-readable medium having stored thereon a computer program, characterized in that, when the program is executed by a processor, the ticket checking method based on a manual ticket checking interface image according to any one of claims 1 to 7 is implemented.
An electronic device, comprising:

One or more processors;

A storage device, configured to store one or more programs, and when the one or more programs are executed by the one or more processors, cause the one or more processors to implement any one of claims 1 to 7 The ticket checking method based on the image of the manual ticket checking interface.