CN109492212A

CN109492212A - Assist fill in a form equipment, system, method, apparatus and storage medium

Info

Publication number: CN109492212A
Application number: CN201811627053.0A
Authority: CN
Inventors: 周永吉; 王浩
Original assignee: Guizhou Little Love Robot Technology Co Ltd
Current assignee: Guizhou Little Love Robot Technology Co Ltd
Priority date: 2018-12-28
Filing date: 2018-12-28
Publication date: 2019-03-19

Abstract

Fill in a form equipment, system, method, apparatus and storage medium are assisted the embodiment of the invention discloses a kind of.The equipment include: fill in a form platform, fill in suggestion device, and with the controller filling in suggestion device and being connected；Platform of filling in a form includes the area of filling in a form for placing hand-written list；Controller, for if it is determined that be currently placed with hand-written list in area of filling in a form, then the pen tip occurred in area of filling in a form by array of pressure sensors real-time detection, and determine user for the position of currently filling in a form of hand-written list according to the appearance position of pen tip；Obtain it is corresponding with current position of filling in a form fill in prompt information and be sent to fill in suggestion device and be shown.The technical solution of the embodiment of the present invention can be different according to user position of filling in a form, the fill substance of user is effectively prompted, to shorten the hand-written list fill in the time of user, the list for correspondingling increase user fills in efficiency.

Description

Assist fill in a form equipment, system, method, apparatus and storage medium

Technical field

The present embodiments relate to data processing techniques more particularly to a kind of auxiliary to fill in a form equipment, system, method, apparatus And storage medium.

Background technique

With the continuous development of computer technology, paperless work may be implemented under many scenes in people.But it is silver-colored Row, group financial mechanism or government services mechanism etc. when carrying out business handling, generally there is still a need for people fill in manually it is various Related service document.In the list that these need to fill in manually, be typically preprinted with project name (for example, " name " or Person's " age " etc.), and white space corresponding with project name, so that user fills in the corresponding contents of a project.

During user fills in list manually, sometimes because not understood to certain project names, and need special The attendant of door guide and fills in；In addition, user sometimes can also be because of to certain misunderstanding for project name and to certain A little contents of a project are accidentally filled in, so that the list for having filled in completion cancels.

The generation of above situation, had not only extended the list fill in the time of user, but also increased the cost of manual service, so that Under the business scenario comprising filling in list manually, business handles inefficiency.

Summary of the invention

Fill in a form equipment, system, method, apparatus and storage medium are assisted the embodiment of the invention provides a kind of, is existed with realizing User carries out prompt of effectively filling in a form to user during filling in a form.

In a first aspect, assisting equipment of filling in a form the embodiment of the invention provides a kind of, comprising: platform of filling in a form fills in suggestion device, And with the controller filling in suggestion device and being connected；

The platform of filling in a form includes the horizontal plane for carrying out hand-written operation, and area of filling in a form, institute are provided on the horizontal plane Area of filling in a form is stated for placing hand-written list；

The area lower part of filling in a form is provided with array of pressure sensors, each pressure sensor in the array of pressure sensors It is connected respectively with the controller；

The controller, for if it is determined that be currently placed with hand-written list in the area of filling in a form, then passing through the pressure The pen tip that sensor array real-time detection occurs in area of filling in a form, and determine user for institute according to the appearance position of the pen tip State the position of currently filling in a form of hand-written list；It obtains prompt information of filling in corresponding with the position of currently filling in a form and is sent to described fill out Writeprompt device is shown；

It is described to fill in suggestion device, for show receive described in fill in prompt information.

Second aspect, the embodiment of the invention provides a kind of auxiliary filling systems, including such as any embodiment of that present invention institute The auxiliary stated is filled in a form equipment and server；

The auxiliary filling system further include: microphone and communication module, the microphone and the communication module It is connected respectively with the controller；The server is filled in a form logical in equipment in a manner of wiredly and/or wirelessly with the auxiliary Believe that module is connected；

The microphone is used to pick up the phonetic order of user, and the phonetic order is sent to the controller；

The controller, is also used to: the interaction problems of filling in a form being sent to server by the communication module, and are led to Cross the interactive answer of filling in a form that the communication module receives the server feedback；The interactive answer of filling in a form is sent to institute It states and fills in suggestion device and be shown；

It is described to fill in suggestion device, it is also used to: showing the interactive answer of filling in a form received；

The server is filled out for receiving the auxiliary controller in equipment of filling in a form by what the communication module was sent Table interaction problems call semantic understanding engine to obtain interactive answer of filling in a form corresponding with the interaction problems of filling in a form, and will be described Interactive answer of filling in a form is sent to the auxiliary and fills in a form the communication module of equipment.

The third aspect is applied to implement as the present invention is any the embodiment of the invention also provides a kind of auxiliary form filling method Auxiliary described in example is filled in a form in equipment, comprising:

If it is determined that being currently placed with hand-written list in area of filling in a form, then passed by being set to the pressure of the area lower part of filling in a form The pen tip that sensor array real-time detection occurs in area of filling in a form；

Determine user for the position of currently filling in a form of the hand-written list according to the appearance position of the pen tip；

Obtain it is corresponding with the current position of filling in a form fill in prompt information and be sent to fill in suggestion device and be shown.

Fourth aspect, the embodiment of the invention also provides a kind of auxiliary form filling methods, comprising:

According to the first user instruction that user sends, Xiang Suoshu user provides the hand-written list of setting type；

During the list of the user is filled in, using the auxiliary form filling method as described in any embodiment of that present invention, It is provided to the user and fills in prompt information；

The second user instruction sent according to the user, Xiang Suoshu user collect the hand-written list for filling in completion.

5th aspect assists device of filling in a form the embodiment of the invention also provides a kind of, is applied to such as any implementation of the present invention Auxiliary described in example is filled in a form in equipment, comprising:

Pen tip detection module, it is for if it is determined that be currently placed with hand-written list in area of filling in a form, then described by being set to The pen tip that the array of pressure sensors real-time detection of area lower part of filling in a form occurs in area of filling in a form；

Current position determination module of filling in a form, for determining user for the hand-written table according to the appearance position of the pen tip Single position of currently filling in a form；

Prompt information display module is filled in, is sent for obtaining prompt information of filling in corresponding with the position of currently filling in a form It is shown to suggestion device is filled in.

6th aspect assists device of filling in a form the embodiment of the invention also provides a kind of, comprising:

Hand-written list provides module, the first user instruction for sending according to user, and Xiang Suoshu user provides setting class The hand-written list of type；

It fills in prompt information and module is provided, for during the list of the user is filled in, arbitrarily using such as the present invention Auxiliary form filling method described in embodiment, Xiang Suoshu user provide and fill in prompt information；

Hand-written list collects module, and the second user instruction for being sent according to the user, Xiang Suoshu user, which collects, to fill out The hand-written list write complete.

7th aspect, the embodiment of the invention also provides a kind of computer storage mediums, are stored thereon with computer program, The auxiliary form filling method as described in any embodiment of the present invention is realized when the program is executed by processor.

Fill in a form equipment, system, method, apparatus and storage medium are assisted the embodiment of the invention provides a kind of, by real-time The pen tip occurred in area of filling in a form is detected, and determines that pen tip position of the pen tip in area of filling in a form is sat according to the appearance position of pen tip Mark obtains and the pen tip position with the matched list coordinate mapping relations of hand-written list currently placed in area of filling in a form The target handwriting input frame of coordinate matching, for the technical solution of the position of currently filling in a form of hand-written list, may be implemented as user During user fills in hand-written list, the position of currently filling in a form of user is determined in real time, and then can be different according to user It fills in a form position, the fill substance of user is effectively prompted, to shorten the hand-written list fill in the time of user, correspondinglys increase use The list at family fills in efficiency.

Detailed description of the invention

Fig. 1 a is that one of embodiment of the present invention one auxiliary is filled in a form the structural schematic diagram of equipment；

Fig. 1 b is the display schematic diagram of one of the embodiment of the present invention one camera setting position；

Fig. 1 c is one of the embodiment of the present invention one high photographing instrument setting position display schematic diagram；

Fig. 1 d is the display schematic diagram of one of the embodiment of the present invention one projector and view field's setting position；

Fig. 2 is that one of embodiment of the present invention two auxiliary is filled in a form the structural schematic diagram of equipment；

Fig. 3 is the structural schematic diagram of one of embodiment of the present invention three auxiliary filling system；

Fig. 4 a is the flow chart of one of embodiment of the present invention four auxiliary form filling method；

Fig. 4 b is respective coordinates model in the handwriting input frame of the hand-written list of one of embodiment of the present invention four and area of filling in a form Mapping relations schematic diagram between enclosing；

Fig. 5 a is the flow chart of one of embodiment of the present invention five auxiliary form filling method；

Fig. 5 b is the schematic diagram of deflection angle between the hand-written list of one of embodiment of the present invention five and area of filling in a form；

Fig. 6 a is the flow chart of one of embodiment of the present invention six auxiliary form filling method；

Fig. 6 b is the process signal that one of embodiment of the present invention six identifies pen tip marginal point in area's image of filling in a form Figure；

Fig. 7 is the flow chart of one of embodiment of the present invention seven auxiliary form filling method；

Fig. 8 is that one of embodiment of the present invention eight auxiliary is filled in a form the structure chart of device；

Fig. 9 is that another auxiliary in the embodiment of the present invention nine is filled in a form the structure chart of device.

Specific embodiment

The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.

It also should be noted that only the parts related to the present invention are shown for ease of description, in attached drawing rather than Full content.It should be mentioned that some exemplary embodiments are described before exemplary embodiment is discussed in greater detail At the processing or method described as flow chart.Although operations (or step) are described as the processing of sequence by flow chart, It is that many of these operations can be implemented concurrently, concomitantly or simultaneously.In addition, the sequence of operations can be by again It arranges.The processing can be terminated when its operations are completed, it is also possible to have the additional step being not included in attached drawing. The processing can correspond to method, function, regulation, subroutine, subprogram etc..

The content of embodiment to facilitate the understanding of the present invention first introduces question and answer knowledge point and language in intelligent answer The related notion of adopted expression formula is simply introduced:

For ease of description, the application scenarios of the embodiment of the present invention are simply introduced first.Various embodiments of the present invention Method be primarily adapted for use in user and the list (that is, hand-written list) for filling in related content manually will be needed to be put into auxiliary and fill in a form and set In standby area of filling in a form, and the hand-written list is filled in the area of filling in a form.Wherein, fill in a form area area size generally and hand The size for writing list is consistent, alternatively, the reason of being identified with the placement region of hand-written list in area of filling in a form, being arranged in this way is to want The corresponding relationship for pre-establishing each point coordinate and the coordinate of corresponding points in area of filling in a form in hand-written list, is passed with realizing when by pressure It, can be by pen tip by above-mentioned corresponding relationship when sensor array detects pen tip of the user for being write in area of filling in a form Position maps in hand-written list, and then position of each handwriting input frame in hand-written list is known in hand-written list In the case of, accurately determine which handwriting input frame user is currently filling in, that is, determining user for hand-written list Currently fill in a form position.In turn, auxiliary fill in a form equipment can currently filling in a form position according to user, user is effectively filled out Table prompt.

Embodiment one

Fig. 1 a is that a kind of auxiliary provided in the embodiment of the present invention one is filled in a form the structural schematic diagram of equipment.As shown in Figure 1a, Auxiliary fill in a form equipment include: fill in a form platform 110, fill in suggestion device 120, and with the controller filling in suggestion device 120 and be connected 130。

Platform 110 of filling in a form includes for carrying out the plane 1101 of hand-written operation (that is, A, B, C and D point surround in such as Fig. 1 a Plane), fill in a form area 1102 and array of pressure sensors 1103 are provided in plane 1101, area 1102 of filling in a form is for placing Hand-written list, array of pressure sensors 1103 is corresponding with area 1102 of filling in a form, the pen occurred in area of filling in a form for real-time detection The position of point.

It should be noted that the cubic shaped shown in fig 1 a fills in a form platform only as an example, in fact, filling out Table platform can placement environment according to actual needs perhaps placement location is set as various shape or pattern, the present embodiment pair This is simultaneously not limited.Optionally, fill in a form platform shape to facilitate user under the scene stood or sat down, filled in a form using this Area 1102, which carries out filling in for hand-written list, to be advisable.Wherein, in order to guarantee that user can easily fill in the list, needing to guarantee should Fill in a form and be provided with a plane 1101 on platform, and be provided in the plane 1101 place hand-written list fill in a form area 1102 and The array of pressure sensors 1103 for the pen tip that real-time detection occurs in area of filling in a form.Plane 1101 can be a horizontal plane, It can be the plane being at an angle to the horizontal surface, to be conveniently used for hand-written be advisable.

Optionally, it fills in a form the size in area, fills in a form with auxiliary and be suitble to the size of hand-written list filled in consistent in equipment, Alternatively, the size in area of filling in a form can be greater than the size of hand-written list, additionally needs and be identified with putting for hand-written list in area of filling in a form Set region.

Array of pressure sensors 1103 is filled in a form the pen tip occurred in area for real-time detection.

In the present embodiment, the pen tip occurred in area 1102 of filling in a form by array of pressure sensors real-time detection is needed, And the pen tip testing result obtained according to each pressure sensor in array of pressure sensors, it is final to determine that user is directed to hand-written table Single position of currently filling in a form.

Optionally, array of pressure sensors 1103 can be set in 1102 lower part of area of filling in a form, and pass through several pressure sensors So that its detection range is covered area of entirely filling in a form, detects that the pressure of the pen tip occurred in area of filling in a form passes according at least one Sensor determines position of filling in a form corresponding to pen tip.

Controller 130, for if it is determined that be currently placed with hand-written list in area 1102 of filling in a form, then passing through pressure sensor The pen tip that 1103 real-time detection of array occurs in area 1102 of filling in a form, and determine user for hand-written according to the appearance position of pen tip List is currently filled in a form position, obtain it is corresponding with current position of filling in a form fill in prompt information and be sent to fill in suggestion device 120 It is shown.

As previously mentioned, need to be pre-established with the hand-written list of at least one type and fill in a form in area respective coordinates range it Between mapping relations, correspondingly, controller 130 determine fill in a form currently be placed with hand-written list in area when, can be according to placement Hand-written list type (for example, withdrawal list or deposit list etc.), obtain matched list coordinate mapping relations. It wherein, include: respective coordinates model at least one handwriting input frame of hand-written list and area of filling in a form in list coordinate mapping relations Mapping relations between enclosing.

In view of user is during hand-written fill in a form, position of the pen tip of writing pencil in hand-written list represents Currently fill in a form position of the user for hand-written list.Correspondingly, controller 130 respectively with it is each in array of pressure sensors 1103 Pressure sensor is connected, and by using array of pressure sensors 1103, real-time detection is filled in a form the pen tip of appearance in area, and then can be with Establish the mapping relations filled in a form in area in each pressure sensor and area of filling in a form between each coordinates regional.At this point, passing through pressure When force snesor detects pen tip in area of filling in a form, can according to detecting pressure sensor of the pen tip in area of filling in a form, and Mapping relations in above-mentioned area of filling in a form in each pressure sensor and area of filling in a form between each coordinates regional calculate pen tip and are filling in a form Pen tip position coordinate in area.

At least one the handwriting input frame for obtaining pen tip position coordinate and hand-written list of the pen tip in area of filling in a form with After the mapping relations filled in a form in area between respective coordinates range, the handwriting input that pen tip is currently hit can be easily determined Frame, and then can be using the handwriting input frame of above-mentioned hit as user for the position of currently filling in a form of hand-written list.

Suggestion device 120 is filled in, for showing that is received fills in prompt information.

In the present embodiment, for during user fills in list manually, sometimes because to certain project names Do not understand special attendant needed guide and fill in, in addition, user sometimes can also be because of to certain project names It misunderstands and certain contents of a project is accidentally filled in, when so that the list for having filled in completion occurring the case where calcellation, Not only the list fill in the time of user had been extended, but also has increased the cost of manual service, so that in the industry comprising filling in list manually Under scene of being engaged in, business handles inefficiency.It proposes after determining target handwriting input frame that user currently fills in, according to Different handwriting input frames, provides a user different types of prompt information, to avoid user to the content for currently needing to fill in There is doubt or be under a delusion, to save the filling date of user.

Correspondingly, filling in reflecting between prompt information with corresponding by pre-establishing handwriting input frame in controller 130 Relationship is penetrated, after can currently filling in handwriting input frame determining user, corresponding with the handwriting input frame will fill in prompt Information is shown.

Such as, if it is determined that user is currently filling in handwriting input frame corresponding with " political affiliation ", then can incite somebody to action " in Selecting to fill in party member and the masses altogether " this corresponding prompt information of filling in is supplied to user.

Optionally, it can fill in a form in equipment in the auxiliary, filming apparatus is set, and area 1102 is matched for shooting and filling in a form Image.Filming apparatus can be set fills in a form on equipment in auxiliary, and the shooting area of the filming apparatus can be covered completely It fills in a form area 1102, can completely cover the regional location for being placed with hand-written list in area 1102 of filling in a form in other words, to realize shooting The corresponding area image of hand-written list.Wherein, filming apparatus can be camera or high photographing instrument or the two Combination.

Non-limiting as example, Fig. 1 b is the display signal of one of the embodiment of the present invention one camera setting position Figure, in the present embodiment, camera are set to the top in area 1102 of filling in a form by L-type support construction 1201, wherein L-type support One end of the long side of structure 1201 is set in the plane for platform 110 of filling in a form, for example, it is flat to be set to this by integrally formed mode On face, or it can also be detachably arranged in the plane by the way that plug connector on this plane is arranged.L-type support construction The side in 1201 short side towards area of filling in a form is provided with camera 1202.

Wherein, the shooting area of camera 1202 is (for example, the subcircular that E, H, G and F point as shown in Figure 1 b forms Plane) it is required to completely cover area of filling in a form, the corresponding area image of hand-written list is shot to realize.

Non-limiting as example, Fig. 1 c is that one of the embodiment of the present invention one high photographing instrument setting position shows signal Figure.Wherein, high photographing instrument is a kind of matured product on the market, and content to be captured is placed by the bottom in the high photographing instrument, can With the image of the picture shooting assembly quick obtaining content to be captured provided by the high photographing instrument.Correspondingly, in the present embodiment, Ke Yizhi Connecing has the corresponding area image of hand-written list using the shooting of high photographing instrument 1203.

Correspondingly, as illustrated in figure 1 c, the plane of the bottom surface of high photographing instrument 1203 and platform of filling in a form is close to setting, in high photographing instrument 1203 Bottom surface on be provided with area of filling in a form.

Optionally, controller 130 can be also used for, and according to the image of filming apparatus captured in real-time, determines and works as in area of filling in a form It is preceding whether to be placed with hand-written list.

Optionally, it can fill in a form in equipment in the auxiliary, corresponding voice playing device (loudspeaker or sound equipment are set Deng), display screen or projection arrangement, be shown with filling in prompt information to this.

Optionally, the combination that suggestion device includes following one or more: loudspeaker, display screen and projector is filled in；

The loudspeaker, for fill in prompt information carry out voice broadcasting；

The display screen, for fill in prompt information carry out screen show；

The projector carries out Projection Display for will fill in the view field that prompt information is set in platform of filling in a form.

Correspondingly, controller 130, is connected with loudspeaker, display screen or projector respectively.

Wherein, loudspeaker is set on the platform 110 of filling in a form, and optionally, the quantity of loudspeaker can be for 1 or more It is a, it can be set on one or more outer surface for filling in a form platform 110.For example, being set on the plane 1101, Huo Zheyu On one or more adjacent side of the plane 1101；

Display screen is set on the platform 110 of filling in a form, and optionally, display screen can be embedded within plane 1101, and is pasted The setting of area 1102 of closely filling in a form can be directly viewable to facilitate user to be not necessarily to come back in the process of filling in a form and fill in prompt information accordingly, Alternatively, display screen can be set on plane 1101 by setting support construction, and display screen direction uses the platform of filling in a form 110 user that fills in a form.

Projector is set on platform 110 of filling in a form, and the view field of projector is set in plane 1101, Huo Zheshe One to be connected in platform 110 of filling in a form with plane 1101 is placed in upwardly extend on face.

In a specific example, can L-type support construction as shown in Figure 1 b short side towards the position in area of filling in a form, One small projector is set simultaneously, and in plane 1101, which has with area of filling in a form for the view field of the projector All or part of overlapping fills in prompt information by showing in the view field, user may be implemented in the process of filling in a form In, it, can the convenient corresponding effect for filling in prompt information of acquisition without coming back.

In another specific example, as shown in Figure 1 d, on platform 110 of filling in a form, further include one or more with it is flat What face 1101 was connected upwardly extends face.Correspondingly, can (user that fills in a form fills in a form the one of when institute's erect-position in one end of plane 1101 End) projector 1204 is set, which can form projected area on the extended surface that the user that fills in a form fills in a form when institute's direction Domain 1205, and show in the view field 1205 and corresponding to fill in prompt information.

The embodiment of the invention provides a kind of auxiliary to fill in a form equipment, by fill in suggestion device and with fill in suggestion device Common configuration between connected controller may be implemented during user fills in hand-written list, determine user's in real time Current fill in a form position, and then position of filling in a form that can be different according to user, effectively prompt the fill substance of user, with contracting The hand-written list fill in the time of short user, the list for correspondingling increase user fill in efficiency.

Embodiment two

Fig. 2 is that a kind of auxiliary provided in the embodiment of the present invention two is filled in a form the structural schematic diagram of equipment.As shown in Fig. 2, auxiliary Help equipment of filling in a form include: fill in a form platform 210, the area 220 of filling in a form filled in a form on platform, controller 230, identity information sweep unit are set 240, print member 250, printing entrance 260, high photographing instrument 270, display screen 280, microphone 290, loudspeaker 2100, communication mould Block 2110 and array of pressure sensors 2120.

Wherein, identity information sweep unit 240, print member 250, printing entrance 260, high photographing instrument 270, display screen 280, microphone 290, loudspeaker 2100, communication module 2110 and array of pressure sensors 2120 respectively with 230 phase of controller Even.Wherein, controller 230, print member 250 and communication module 2110 can be set the platform 210 of filling in a form inside or External (for example, outer surface), the present embodiment is to this and is not limited.

Platform 210 of filling in a form includes the plane for carrying out hand-written operation, is provided with fill in a form area 220 and pressure biography in the plane Sensor array 2120, for placing hand-written list, array of pressure sensors 2120 is filled in a form area for real-time detection in area 220 of filling in a form The pen tip occurred in 220；

High photographing instrument 270, for the matched image in area 220 that shoots and fill in a form；

Controller 230, for if it is determined that be currently placed with hand-written list in area 220 of filling in a form, then passing through pressure sensor The pen tip that 2120 real-time detection of array occurs in area 220 of filling in a form, and determine user for hand-written according to the appearance position of pen tip List is currently filled in a form position, obtain it is corresponding with current position of filling in a form fill in prompt information and be sent to display screen 280 opened up Show, and will fill in prompt information and be sent to loudspeaker 2100 and play out.

In the present embodiment, simultaneous selection display screen 280 and loudspeaker 2100 are shown to prompt information is filled in, can It is also available to believe to filling in prompt to realize under noisy environment or for some people with hearing or vision disorder Breath, has further expanded application scenarios and the target user of technical solution of the embodiment of the present invention, has further improved user's The versatility and applicability of usage experience and scheme.

In the present embodiment, auxiliary fill in a form equipment can also include: identity information sweep unit 240, print member 250 with And printing entrance 260, identity information sweep unit 240 and print member 250 are connected with controller 230 respectively, printing portion Part 250 is connected with printing entrance 260.

Identity information sweep unit 240, for user close to authentication article (for example, identity card, residence booklet, Medical insurance card or driving license etc. include the article in magnetic storage region) it is identified, and identification result is sent to control Device 230.

Print member 250 is connected with printing entrance 260, for the hand to be printed inputted by printing entrance 260 It writes list to be scanned, and list scanning result is supplied to controller 230；Receive the print control letter that controller 230 is sent Breath, and according to printing control information, hand-written list to be printed is printed and exported；

Controller 230 generates printing control information for identification result based on the received and list scanning result, And printing control information is sent to print member 250, printing control information will be with identification for controlling print member 250 As a result matched identity information is printed in advance in hand-written list to be printed.

By above-mentioned setting, may be implemented to the essential information of user (for example, name, age or identification card number etc. are believed Breath) acquisition, and printed in advance to user and needed in the hand-written list filled in, with reduce to the greatest extent user need it is hand-written Workload, enrich the auxiliary and fill in a form the function of equipment, further save the filling date of user.

In the present embodiment, auxiliary equipment of filling in a form can also include: microphone 290, microphone 290 and 230 phase of controller Even；

Microphone 290 (for example, selection microphone array) sends phonetic order for picking up the phonetic order of user To controller 230；

Wherein, microphone 290 are set on platform of filling in a form, and can fill in a form area's setting close to this, to facilitate user filling in a form It directly asks a question without carrying out certain pose adjustment or movement in the process.It is filled out for example, microphone 290 can be embedded in this In plane in table platform, or one or more being connected with the plane is set and is upwardly extended on face.Fig. 2 is only to wheat A kind of example of the set-up mode of gram wind 290.

Controller 230, is also used to: extracting interaction problems of filling in a form according to phonetic order, and obtains and interaction problems of filling in a form The interactive answer of filling in a form matched；The interactive answer that will fill in a form, which is sent to, fills in suggestion device and is shown；

Suggestion device (that is, display screen 280 and loudspeaker 2100 as shown in Figure 2) is filled in, be also used to: displaying connects The interactive answer of filling in a form received.

Specifically, can further during user fills in a form, receive that user is unasked and fill in a form in the problem of encountering (that is, interaction problems of filling in a form), and obtain matched interactive answer of filling in a form based on the interaction problems of filling in a form and be supplied to user.Specifically , user can input above-mentioned interaction problems of filling in a form by modes such as voice, gesture or text inputs.Based on the interaction of filling in a form Problem can be inquired by local search or server or turn artificial mode, and the interaction problems that obtain and fill in a form are matched It fills in a form interactive answer, and the interactive answer of filling in a form is supplied to currently in such a way that voice broadcast, screen show or project The user that fills in a form.

The benefit being arranged in this way is: further shortening the hand-written list fill in the time of user, the list for improving user is filled in Efficiency.

In the present embodiment, auxiliary equipment of filling in a form can also include: communication module 2110, communication module 2110 and controller 230 are connected；

Controller 230 is specifically used for: the interaction problems that will fill in a form are sent to server by communication module, and pass through communication mould The interactive answer of filling in a form of block reception server feedback.

The benefit being arranged in this way is, it is possible to reduce service is filled in a form the calculating and amount of storage of equipment local, and the service of reduction is filled out The calculation amount of table equipment local.

The embodiment of the invention provides it is a kind of auxiliary fill in a form equipment can by the common configuration between each hardware device To realize during user fills in hand-written list, the position of currently filling in a form of user is determined in real time, and then can be according to user Different positions of filling in a form effectively prompts the fill substance of user, to shorten the hand-written list fill in the time of user, accordingly The list for improving user fills in efficiency.

Embodiment three

Fig. 3 is a kind of structural schematic diagram of the auxiliary filling system provided in the embodiment of the present invention three.Shown in Fig. 3, auxiliary Filling system includes: that auxiliary as described in any embodiment of the present invention is filled in a form equipment 310 and server 320.

Assisting equipment 310 of filling in a form, comprising: platform 3101 of filling in a form, fills in suggestion device 3103 at array of pressure sensors 3102, And respectively with array of pressure sensors 3102 and fill in the controller 3104 that suggestion device 3103 is connected；

Platform 3101 of filling in a form includes the plane for carrying out hand-written operation, is provided with area of filling in a form in the plane, and area of filling in a form is used for Place hand-written list；

Array of pressure sensors 3102, the pen tip occurred in area of filling in a form for real-time detection；

Controller 3104, for if it is determined that being currently placed with hand-written list in area of filling in a form, then by pressure sensor battle array The pen tip that column real-time detection occurs in area of filling in a form, and determine user for the current of hand-written list according to the appearance position of pen tip Fill in a form position, obtain it is corresponding with current position of filling in a form fill in prompt information and be sent to fill in suggestion device 3103 and be shown；

Suggestion device 3103 is filled in, for showing that is received fills in prompt information.

Assist filling system 310 further include: microphone 3105 and communication module 3106, microphone 3105 and communication mould Block 3106 is connected with controller 3104 respectively；Server 320 is filled in a form in equipment 310 in a manner of wiredly and/or wirelessly with auxiliary Communication module 3106 be connected.

Microphone 3105 is used to pick up the phonetic order of user, and phonetic order is sent to controller 3104；

Controller 3104, is also used to: the interaction problems that will fill in a form are sent to server 320 by communication module 3106, and lead to It crosses communication module 3106 and receives the interactive answer of filling in a form that server 320 is fed back；The interactive answer that will fill in a form, which is sent to, fills in prompt dress 3103 are set to be shown；

Suggestion device 3103 is filled in, is also used to: showing the interactive answer of filling in a form received；

Server 320 is filled out for receiving the controller 3104 in the equipment that assists filling in a form by what communication module 3106 was sent Table interaction problems call semantic understanding engine to obtain interactive answer of filling in a form corresponding with interaction problems of filling in a form, and the interaction that will fill in a form Answer is sent to the communication module 3106 for the equipment 310 that assists filling in a form.

In the present embodiment, it is provided in advance in server 320 semantic understanding engine (question answering system), is managed by the semanteme Solve engine, server it is available it is matched with interaction problems of filling in a form fill in a form to interact answer and be sent to auxiliary fill in a form equipment 310 Communication module 3106 (for example, Wi-Fi module or mobile communication module (3G or 4G etc.) etc.), sent out by communication module 3106 It send to controller 3104 and carries out subsequent processing.

Auxiliary filling system provided in an embodiment of the present invention can by assisting the common cooperation of equipment and server of filling in a form To realize during user fills in hand-written list, the position of currently filling in a form of user is determined in real time, and different according to user It fills in a form position, the fill substance of user is effectively prompted, to shorten the hand-written list fill in the time of user, correspondinglys increase use While the list at family fills in efficiency, correspondence targetedly can also be fed back according to the interaction problems of filling in a form that user proposes in real time Interactive answer of filling in a form, further to shorten the hand-written list fill in the time of user, the list for improving user fills in efficiency.

Example IV

Fig. 4 a is a kind of flow chart for auxiliary form filling method that the embodiment of the present invention four provides, and the present embodiment is applicable to this Auxiliary described in invention any embodiment fills in a form equipment during user hand writes table, fill in a form the feelings of prompt to user Condition, this method can fill in a form device by auxiliary provided in an embodiment of the present invention to execute, which can be used software and/or hardware Mode realize, and generally can integrate and fill in a form in equipment for providing the fill in a form auxiliary of service of auxiliary, typically, be integrated in The auxiliary fill in a form equipment controller in.As shown in fig. 4 a, the method for the present embodiment specifically includes:

S410, if it is determined that be currently placed with hand-written list in area of filling in a form, then by being set to the pressure of area lower part of filling in a form The pen tip that sensor array real-time detection occurs in area of filling in a form.

In the present embodiment, the state of each pressure sensor obtained in real time by array of pressure sensors is examined in real time Survey the pen tip occurred in area of filling in a form.

It in the present embodiment, can also include: to obtain and fill out after being currently placed with hand-written list in determining area of filling in a form The matched list coordinate mapping relations of the hand-written list currently placed in table area.

Wherein, include: in list coordinate mapping relations hand-written list at least one handwriting input frame with it is right in area of filling in a form Answer the mapping relations between coordinate range.

In the present embodiment, instruction can be filled according to the list that user inputs or other lists are filled in instruction determination and filled out Hand-written list is currently placed in table area, alternatively, can also be by way of the image that captured in real-time is filled in a form in area, dynamically to filling out The hand-written list currently placed in table area is detected.

As previously mentioned, need to be pre-established with the hand-written list of at least one type and fill in a form in area respective coordinates range it Between mapping relations, correspondingly, determine fill in a form currently be placed with hand-written list in area when, can be according to the hand-written list of placement Type (for example, withdrawal list or deposit list etc.), obtain matched list coordinate mapping relations.Wherein, list It include: reflecting between respective coordinates range at least one handwriting input frame and area of filling in a form of hand-written list in coordinate mapping relations Penetrate relationship.

It the handwriting input frame of the hand-written list of one of embodiment of the present invention one and fills in a form in area shown in fig. 4b Mapping relations schematic diagram between respective coordinates range.As shown in Figure 4 b, it is preprinted in a type of hand-written list more A project name, such as: " name ", " gender " and " birthdate " etc..In the adjacent position of each project name, reserve User in need fills in the handwriting input frame (blank box) of corresponding contents manually.The hand-written list is being placed in setting for area of filling in a form Positioning postpones, so that it may establish reflecting between respective coordinates range in each handwriting input frame in the hand-written list and area of filling in a form Penetrate relationship.In Fig. 4 b example, corresponding coordinate value is (0,0) in area of filling in a form with the upper left corner of above-mentioned hand-written list out, and corresponding Determining corresponding coordinate value is (20,5) in area of filling in a form with the upper left corner for the handwriting input frame that " name " is adjacent, and the lower right corner is being filled out Corresponding coordinate value is (40,15) in table area.Then handwriting input frame corresponding with " name " corresponding coordinate model in area of filling in a form It encloses are as follows: (20,5)-(40,15).Accordingly, whole handwriting input frames can accordingly be established in a type of hand-written list and filled in Mapping relations in area between respective coordinates range.

S420, determined user for the position of currently filling in a form of hand-written list according to the appearance position of pen tip.

It is closed as previously described, because obtaining in advance with the matched list coordinate mapping of hand-written list currently placed in area of filling in a form System determines that user may include: for the position of currently filling in a form of hand-written list according to the appearance position of pen tip in the present embodiment Pen tip position coordinate of the pen tip in area of filling in a form is determined according to the appearance position of pen tip；In coordinate mapping relations, acquisition and pen The sharp matched target handwriting input frame of position coordinates is as user for the position of currently filling in a form of hand-written list.

Wherein, it is contemplated that user is during hand-written fill in a form, position of the pen tip of writing pencil in hand-written list, i.e. generation Currently fill in a form position of the table user for hand-written list.Correspondingly, real-time using array of pressure sensors in the present embodiment The pen tip occurred in area of filling in a form is detected, and then can establish each pressure sensor and each coordinate area in area of filling in a form in area of filling in a form Mapping relations between domain.At this point, when detecting pen tip in area of filling in a form by pressure sensor, it can be according to detecting pen Point in area of filling in a form pressure sensor and above-mentioned area of filling in a form in each pressure sensor and each coordinates regional in area of filling in a form Between mapping relations, calculate pen tip position coordinate of the pen tip in area of filling in a form.

In the present embodiment, at least the one of pen tip position coordinate and hand-written list of the pen tip in area of filling in a form is being obtained After mapping relations in a handwriting input frame and area of filling in a form between respective coordinates range, it can easily determine that pen tip is current The handwriting input frame of hit, and then can fill in a form using the handwriting input frame of above-mentioned hit as user for the current of hand-written list Position.

In a specific example, if it is determined that the pen tip position coordinate gone out is (37,7), at above-mentioned pen tip position coordinate In handwriting input frame corresponding with " name " in area of filling in a form corresponding coordinate range, namely: in (20,5)-(40,15).Cause This, can determine that user is currently filling in handwriting input frame corresponding with " name ".

S430, obtain it is corresponding with current position of filling in a form fill in prompt information and be sent to fill in suggestion device and be shown.

By S410 and S420, can be simple, quick and accurately determine that user is currently filling in it is hand-written defeated Enter frame.Reflecting between prompt information is filled in corresponding correspondingly, whole (or part) handwriting input frames can be pre-established Penetrate relationship.For example, only establishing user easily fills out wrong handwriting input frame, or the handwriting input frame that can be had a question is mentioned with corresponding fill in Show the mapping relations between information.

Correspondingly, effective voice or image can be carried out to user when user fills in a handwriting input frame Prompt substantially increases the table of user to reduce user's enquirement, think deeply or fill out after mistake and rewrite caused time loss Singly fill in efficiency.Such as, if it is determined that user is currently filling in handwriting input frame corresponding with " political affiliation ", then incite somebody to action " in Selecting to fill in party member and the masses altogether " this is filled in prompt information and is supplied to user.

Wherein, the combination that suggestion device includes following one or more: loudspeaker, display screen and projector is filled in；

The loudspeaker, for fill in prompt information carry out voice broadcasting；

The display screen, for fill in prompt information carry out screen show；

The embodiment of the invention provides a kind of auxiliary form filling method, the pen tip occurred in area of filling in a form by real-time detection, And appearance position of the pen tip in area of filling in a form is determined according to the appearance position of pen tip, user's needle is determined according to the appearance position of pen tip To the technical solution of the position of currently filling in a form of hand-written list, may be implemented during user fills in hand-written list, in real time really Currently fill in a form position, and the position of filling in a form that can be different according to user for determining user, effectively mention the fill substance of user Show, to shorten the hand-written list fill in the time of user, the list for correspondingling increase user fills in efficiency.

On the basis of the various embodiments described above, the method can also include:

If detecting that user completes to fill in hand-written list by filming apparatus, the area that shoots and fill in a form matched the Two fill in a form area's image；Optical character identification is carried out to second area's image of filling in a form, and according to optical character identification result, generates user It fills in a form information；Information preliminary hearing, and/or information-based filing are carried out to user's information of filling in a form.

Currently, although business handling mechanism needs the hand-written list of user be to complete corresponding business handling process still It is convenient for subsequent archive and management, generally there is still a need for carry out electronic archive to hand-written list.Correspondingly, in the present embodiment In, it can detect first whether user completes filling in for hand-written list, after the completion of determining that user fills in, completion is filled in user Hand-written list is taken pictures, and is obtained corresponding with the hand-written list of completion is filled in second and is filled in a form area's image, and second is filled out based on this Table area image is analyzed and determines fill substance of the user based on the hand-written list.

It can be with to the mode of hand-written list filled in specifically, determining whether user completes are as follows: the knot of detection user's input The handwriting input frame that beam fills in instruction or real-time detection user currently fills in, if it is determined that user fills in hand-written list The last one handwriting input frame, then wait setting duration (such as: after 30s or 40s etc.), determine user complete to hand-written list Fill in.

In the present embodiment, after information of filling in a form by optical character recognition technology acquisition user, setting can be passed through Preset rules preliminary hearing is carried out to the partial information in above- mentioned information, for example, determining corresponding with " age " this field user The value range for information of filling in a form is (1-130), then if identifying that the information of filling in a form of the user for the field is unsatisfactory for above-mentioned take It is worth range, then abnormal mark directly is carried out to above content.

By above- mentioned information preliminary hearing, and/or the operation of information-based filing, the function for the equipment that assists filling in a form can be further expanded Can, reduce the time of the hand-written list of artificial treatment.

Embodiment five

Fig. 5 a is a kind of flow chart for auxiliary form filling method that the embodiment of the present invention five provides, and the present embodiment is with above-mentioned implementation It is optimized based on example, in the present embodiment, the matched list of the hand-written list currently placed in the area that will acquire and fill in a form is sat The operation of mark mapping relations is embodied.Correspondingly, the method for the embodiment of the present invention includes:

S510, captured in real-time and area matched first of filling in a form fill in a form area's image.

In the present embodiment, it is filled in a form area's image by captured in real-time and area matched first of filling in a form, determines that this is filled in a form in area Whether place or there are hand-written lists.

Optionally, first can be obtained in real time and is filled in a form area's image by the filming apparatus that is arranged above area of filling in a form.

S520, judge whether identify that there are hand-written lists in area of filling in a form according to first area's image of filling in a form: if so, executing S530；Otherwise, it returns and executes S510.

In the present embodiment, it can fill in a form in advance first and be placed with hand-written list in area's image, and accordingly shoot multiple Image extracts at least one characteristics of image as standard feature as standard picture, and according to multiple above-mentioned standard pictures.Accordingly , after area's image is filled in a form in acquisition first, the characteristics of image of area's image can be filled in a form by first and above-mentioned standard feature compares It is right, and determine to whether there is in area of filling in a form have hand-written list according to comparison result.

S530, edge detection is carried out to hand-written list, and obtain the deflection between the object edge detected and normal line Angle.Wherein, normal line is associated with an edge in area of filling in a form.

In the present embodiment, in order to further increase hand-written list currently fill in a form position definitive result accuracy, Inventor further contemplates hand-written list and deviates the case where filling in a form area, effectively to be corrected to final result.

Wherein, deflection angle between the hand-written list of one of embodiment of the present invention five and area of filling in a form is shown in figure 5b Schematic diagram.Wherein, by edge detecting technology, it can determine that the object edge of hand-written list is filled in a form in area's image first Picture position, and preset normal line and fill in a form the picture position in area's image first, wherein normal line and object edge Position and/or directional correlation connection.It is compared by the object edge that will test out with preset normal line, it can in turn really Deflection angle between the two is made, namely: angle α.Above-mentioned angle α can be used to carry out the subsequent pen tip position coordinate being calculated Amendment.

S540, area's image of filling in a form according to first, determine the form types of hand-written list.

Optionally, the form types that user is manually entered can be directly acquired.In addition, in order to further decrease the work of user It measures, improves the intelligent of entire method, the identification of the form types to hand-written list can be automatically performed in the present embodiment, And matched list coordinate mapping relations are chosen according to recognition result.

Optionally, form types identification model that can be different for different types of hand-written list training, and then can be with It fills in a form after area's image in obtain that shooting has hand-written list first, above-mentioned first area's image of filling in a form is separately input into above-mentioned list In type identification model, and according to the output of form types identification model as a result, determining the form types of hand-written list.

Optionally, determine that the form types of hand-written list can be with are as follows: fill in a form in area's image first, identify hand-written list List profile；According to the list profile identified, gauge outfit corresponding with hand-written list region is determined；Light is carried out to gauge outfit region Character recognition is learned, and determines the form types of hand-written list according to optical character identification result.

In view of form types can carry out simple, effective recognition and verification by the content of text in gauge outfit region.Therefore, It can be filled in a form first first by outline identification technology and determine list profile in area's image, and table is determined based on the list profile Head region.After determining gauge outfit region, it is based on optical character recognition technology, corresponding gauge outfit text is identified in gauge outfit region Word, and then the form types of the hand-written list can be determined by the gauge outfit text.

S550, acquisition and the matched list coordinate mapping relations of form types, as with the hand currently placed in area of filling in a form Write the matched list coordinate mapping relations of list.

In the present embodiment, list coordinate mapping relations corresponding with each form types locally can be being prestored, And by local matched mode, obtain and the matched list coordinate mapping relations of form types；Alternatively, acquisition and form types The mode of matched list coordinate mapping relations can be with are as follows: form types are sent to server, and obtain server feedback With the matched list coordinate mapping relations of form types.

The pen tip that S560, real-time detection occur in area of filling in a form, and determine that pen tip is being filled in a form according to the appearance position of pen tip Pen tip position coordinate in area.

S570, according to deflection angle, coordinate modification is carried out to pen tip position coordinate.

As previously mentioned, list coordinate mapping relations refer to the coordinate mapping knot after hand-written list Complete Mappings to area of filling in a form Fruit, in other words in above-mentioned list coordinate mapping relations, the object edge of hand-written list is coincided with normal line.Therefore, When having angle of deflection between the object edge and normal line of hand-written list, pen tip position coordinate is directly mapped into list coordinate When mapping relations, there can be corresponding error, therefore, it is necessary to according to deflection angle, carry out coordinate first to pen tip position coordinate and repair Just.Specific correcting mode is, according to the expansion direction of angle of deflection, to obtain above-mentioned pen tip position coordinate after rotation alpha along x-axis.

Specifically, can be according to formula:Calculate the amendment of pen tip position coordinates (x, y) As a result (x ', y ').

S580, in coordinate mapping relations, obtain with the target handwriting input frame of pen tip position coordinate matching as user For the position of currently filling in a form of hand-written list.

S590, obtain it is corresponding with current position of filling in a form fill in prompt information and be sent to fill in suggestion device and be shown.

The technical solution of the embodiment of the present invention by be placed on area of filling in a form hand-written list carry out edge detection, and according to After edge detection results determine the deflection angle that hand-written list deviates area of filling in a form, according to deflection angle to determining pen tip position coordinate into Row amendment, it is ensured that finally obtained position of currently filling in a form is more accurate.And then can be different according to user position of filling in a form, The fill substance of user is effectively prompted, to shorten the hand-written list fill in the time of user, correspondinglys increase the list of user Fill in efficiency.

Embodiment six

Fig. 6 a is a kind of flow chart for auxiliary form filling method that the embodiment of the present invention six provides, and the present embodiment is with above-mentioned implementation It is optimized based on example, in the present embodiment, the pen tip that real-time detection is occurred in area of filling in a form, and according to the appearance of pen tip Position determines that the operation of pen tip position coordinate of the pen tip in area of filling in a form is embodied.Correspondingly, the side of the embodiment of the present invention Method includes:

S610, obtain and area of filling in a form in the matched list coordinate mapping relations of hand-written list currently placed.

S620, the pen tip occurred in area of filling in a form by array of pressure sensors real-time detection.

S630, judge whether to detect pen tip in area of filling in a form: if so, executing S640；Otherwise, it returns and executes S620.

So-called pen tip refers to written marginal point (being actually used in hand-written marginal point) in the present embodiment, such as Fig. 6 b institute Show.

Pass through the pressure value for arriving pressure sensor real-time detection each in above-mentioned array of pressure sensors and preset pen There is corresponding pressure value and is compared in point, and according to comparison result, detects in area of filling in a form with the presence or absence of pen tip.

S640, it is sat according at least one the goal pressure sensor and pressure sensor for detecting pen tip and area of filling in a form The mapping relations between region are marked, obtain the zone position coordinate of filling in a form at least one goal pressure sensor matching as pen tip Position coordinates.

In the present embodiment, it after acquisition detects at least one goal pressure sensor of pen tip, is passed based on pressure Mapping relations between sensor and area's coordinates regional of filling in a form can be obtained finally and be filled in a form with goal pressure sensor matching Area's coordinate is as pen tip position coordinate.

Specifically, obtain detect at least one goal pressure sensor of pen tip after, obtain by with each target Pressure sensor is corresponding to fill in a form the target area of area's coordinates regional composition, and by the corresponding position of filling in a form in the midpoint of target area Coordinate is set, as pen tip position coordinate.

S650, in coordinate mapping relations, obtain with the target handwriting input frame of pen tip position coordinate matching as user For the position of currently filling in a form of hand-written list.

S660, obtain it is corresponding with current position of filling in a form fill in prompt information and be sent to fill in suggestion device and be shown.

The technical solution of the embodiment of the present invention occurs in area of filling in a form by using array of pressure sensors real-time detection Pen tip, and according to reflecting between the goal pressure sensor and pressure sensor that detect pen tip and area's coordinates regional of filling in a form Relationship is penetrated, determines the mode of pen tip position coordinate of the pen tip in area of filling in a form, can be further improved and currently fill in a form position really Determine the accuracy of result.

Embodiment seven

Fig. 7 is a kind of flow chart for auxiliary form filling method that the embodiment of the present invention seven provides, and the present embodiment is applicable to this Auxiliary described in invention any embodiment fills in a form equipment during user hand writes table, fill in a form the feelings of prompt to user Condition, this method can fill in a form device by auxiliary provided in an embodiment of the present invention to execute, which can be used software and/or hardware Mode realize, and generally can integrate and fill in a form in equipment for providing the fill in a form auxiliary of service of auxiliary, typically, be integrated in The auxiliary fill in a form equipment controller in.As shown in fig. 7, the method for the present embodiment specifically includes:

S710, the first user instruction sent according to user, the hand-written list of setting type is provided to user.

Wherein, the first user instruction can be the instruction that user selects the triggered generation of hand-written list of a certain type, lead to Above-metioned instruction is crossed, the hand-written list of type needed for user can be directly determined, and accordingly provides the hand-written of corresponding types to user List；First user instruction can also be handled a certain type service (for example, deposit or withdrawal etc.) by user's selection and be triggered The instruction of generation can be determined needed for user by above-metioned instruction according to the corresponding relationship between type of service and form types The hand-written list of type, and accordingly provide to user the hand-written list of corresponding types.

S720, during the list of user is filled in, using the method as described in any embodiment of that present invention, mentioned to user For filling in prompt information.

In the present embodiment, it using method described in any embodiment of that present invention, is determined in real time for being directed to hand-written list Currently fill in a form position, and based on above-mentioned position of currently filling in a form, prompt of effectively filling in a form is carried out to user.

S730, it is instructed according to the second user that user sends, the hand-written list for filling in completion is collected to user.

Wherein, second user instruction can be confirmed that the instruction for completion triggering generation of filling in a form or user are filled in by user Triggering the instruction generated after to the last one handwriting input frame of hand-written list can be corresponding after detecting above-metioned instruction A list storage box is opened, and indicates that the hand-written list for having filled in completion is put into above-mentioned list storage box by user, with The hand-written list for filling in completion is collected to user.

The technical solution of the embodiment of the present invention provides setting class to user by the first user instruction sent according to user The hand-written list of type, using the method as described in any embodiment of that present invention, mentions during the list of user is filled in user It is instructed for filling in prompt information, and according to the second user that user sends, the side for filling in the hand-written list of completion is collected to user Formula, may be implemented the granting that the completely self-service hand-written list of realization of equipment is prompted by filling in a form, and auxiliary is filled in a form and final The operations such as list recycling, without the intervention and participation of any staff, effectively prompt the fill substance of user Meanwhile further reduced cost of labor, the investment of human resources is greatly saved.

Embodiment eight

Fig. 8 is that a kind of auxiliary that provides of the embodiment of the present invention eight is filled in a form the structure chart of device.The auxiliary device of filling in a form is answered It fills in a form in equipment for the auxiliary as described in any embodiment of that present invention, as shown in figure 8, described device includes: pen tip detection mould Block 810, position determination module 820 of currently filling in a form and fill in prompt information display module 830.Wherein:

Pen tip detection module 810, for if it is determined that be currently placed with hand-written list in area of filling in a form, then being filled out by being set to The pen tip that the array of pressure sensors real-time detection of table area lower part occurs in area of filling in a form；

Current position determination module 820 of filling in a form determines user for hand-written list for the appearance position according to pen tip Current position of filling in a form；

Fill in prompt information display module 830, for obtain with currently fill in a form position it is corresponding fill in prompt information transmission It is shown to suggestion device is filled in.

The embodiment of the invention provides a kind of auxiliary to fill in a form device, the pen tip occurred in area of filling in a form by real-time detection, And appearance position of the pen tip in area of filling in a form is determined according to the appearance position of pen tip, user's needle is determined according to the appearance position of pen tip To the technical solution of the position of currently filling in a form of hand-written list, may be implemented during user fills in hand-written list, in real time really Currently fill in a form position, and the position of filling in a form that can be different according to user for determining user, effectively mention the fill substance of user Show, to shorten the hand-written list fill in the time of user, the list for correspondingling increase user fills in efficiency.

On the basis of the various embodiments described above, described device can also include:

List coordinate mapping relations obtain module, after being currently placed with hand-written list in determining area of filling in a form, obtain Take and fill in a form the matched list coordinate mapping relations of hand-written list currently placed in area；

Wherein, include: in list coordinate mapping relations hand-written list at least one handwriting input frame with it is right in area of filling in a form Answer the mapping relations between coordinate range；

Correspondingly, position determination module 820 of currently filling in a form, can specifically include:

Pen tip position coordinate determination unit determines pen tip position of the pen tip in area of filling in a form for the appearance position according to pen tip Set coordinate；

Target handwriting input frame acquiring unit, in coordinate mapping relations, obtaining and pen tip position coordinate matching Target handwriting input frame is as user for the position of currently filling in a form of hand-written list.

On the basis of the various embodiments described above, list coordinate mapping relations obtain module, can specifically include:

Form types determination unit determines the form types of hand-written list for filling in a form area's image according to first, wherein First fills in a form area's image as filming apparatus captured in real-time, and is identified the figure that hand-written list is currently placed in area of filling in a form Picture；

Mapping relations acquiring unit, for obtain with the matched list coordinate mapping relations of form types, as with fill in a form The matched list coordinate mapping relations of the hand-written list currently placed in area.

On the basis of the various embodiments described above, form types determination unit can be specifically used for: in area's image of filling in a form, know The list profile of not hand-written list；

According to the list profile identified, gauge outfit corresponding with hand-written list region is determined；

Optical character identification is carried out to gauge outfit region, and determines the list class of hand-written list according to optical character identification result Type.

On the basis of the various embodiments described above, mapping relations acquiring unit can be specifically used for:

Form types are sent to server, and obtain mapping with the matched list coordinate of form types for server feedback Relationship.

On the basis of the various embodiments described above, pen tip position coordinate determination unit can be specifically used for:

According at least one goal pressure sensor and pressure sensor for detecting pen tip and area's coordinates regional of filling in a form Between mapping relations, obtain at least one goal pressure sensor matching fill in a form zone position coordinate as pen tip position seat Mark.

On the basis of the various embodiments described above, pen tip position coordinate determination unit can also include that target area obtains son Unit, for obtaining the target area being made of area's coordinates regional of filling in a form corresponding with each goal pressure sensor；Pen tip position It sets coordinate and obtains subelement, for by the corresponding zone position coordinate of filling in a form in the midpoint of target area, as pen tip position coordinate.

Deflection angle detection unit, for after determining and filling in a form and be currently placed with hand-written list in area, to hand-written list into Row edge detection, and the deflection angle between the object edge detected and normal line is obtained, a side of normal line and area of filling in a form Edge association；

Correspondingly, described device can also include: coordinate modification module, for determining pen according to the appearance position of pen tip Point is after the pen tip position coordinate in area of filling in a form, and according to deflection angle, carries out coordinate modification to pen tip position coordinate.

On the basis of the various embodiments described above, described device can also include that post-processing module is used for:

If detecting that user completes to fill in hand-written list by filming apparatus, the area that shoots and fill in a form matched the Two fill in a form area's image；

Optical character identification is carried out to second area's image of filling in a form, and according to optical character identification result, generates user and fills in a form Information；

Information preliminary hearing, and/or information-based filing are carried out to user's information of filling in a form.

On the basis of the various embodiments described above, can also include that pre-print module is used for:

The identification of received identity information scan module identification as a result, and print member to hand-written list to be printed Scan obtained list scanning result；

Printing control information is generated according to identification result and list scanning result, and printing control information is sent To print member, printing control information will print in advance for controlling print member with the matched identity information of identification result In hand-written list to be printed.

On the basis of the various embodiments described above, can also include:

Interaction problems of filling in a form extraction module for receiving the phonetic order of microphone pickup, and is extracted according to phonetic order It fills in a form interaction problems；

Interactive answer of filling in a form obtains module, interacts answer with matched fill in a form of interaction problems of filling in a form for obtaining；

It fills in a form interactive answer display module, is sent to for the interactive answer that will fill in a form and fills in suggestion device and be shown.

On the basis of the various embodiments described above, interactive answer of filling in a form, which obtains module, to be specifically used for:

The interaction problems that will fill in a form are sent to server by communication module, and receive server feedback by communication module It fills in a form interactive answer.

The device of filling in a form of auxiliary provided by the embodiment of the present invention can be performed auxiliary provided by any embodiment of the invention and fill out Table method has the corresponding functional module of execution method and beneficial effect.

Embodiment nine

Fig. 9 is that a kind of auxiliary that provides of the embodiment of the present invention nine is filled in a form the structure chart of device.The auxiliary device of filling in a form is answered It fills in a form in equipment for the auxiliary as described in any embodiment of that present invention, as shown in figure 9, described device includes: hand-written list hair Amplification module 910 fills in prompt information and provides module 920 and hand-written list and collects module 930, in which:

Hand-written list provides module 910, and the first user instruction for being sent according to user provides setting type to user Hand-written list；

It fills in prompt information and module 920 is provided, for during the list of user is filled in, using any reality of such as the present invention Example auxiliary form filling method is applied, provides a user and fills in prompt information；

Hand-written list collects module 930, and the second user instruction for being sent according to user collects to user and fills in completion Hand-written list.

The technical solution of the embodiment of the present invention provides setting class to user by the first user instruction sent according to user The hand-written list of type, using the method as described in any embodiment of that present invention, mentions during the list of user is filled in user It is instructed for filling in prompt information, and according to the second user that user sends, the side for filling in the hand-written list of completion is collected to user Formula, may be implemented the granting that the completely self-service hand-written list of realization of equipment is prompted by filling in a form, and auxiliary is filled in a form and final The operations such as list recycling, without the access and participation of any staff, effectively prompt the fill substance of user, contract The hand-written list fill in the time of short user further reduced cost of labor, greatly while improving the list of user and fill in efficiency The investment of human resources has been saved greatly.

Embodiment ten

The embodiment of the present invention ten provides a kind of computer readable storage medium, is stored thereon with computer program, the journey The auxiliary form filling method provided such as all inventive embodiments of the application is provided when sequence is executed by processor:

Namely: the realization when program is executed by processor: if it is determined that being currently placed with hand-written list in area of filling in a form, then lead to The pen tip that over-voltage force sensor array real-time detection occurs in area of filling in a form；Determine user for hand according to the appearance position of pen tip Write the position of currently filling in a form of list；Obtain it is corresponding with current position of filling in a form fill in prompt information be sent to fill in suggestion device into Row is shown.

Alternatively, realizing the auxiliary side of filling in a form provided such as all inventive embodiments of the application when the program is executed by processor Method:

Namely: the realization when program is executed by processor: the first user instruction sent according to user is provided to user and is set Determine the hand-written list of type；

During the list of user is filled in, using the method as described in any embodiment of that present invention, provides a user and fill out Writeprompt information；

The second user instruction sent according to user, the hand-written list for filling in completion is collected to user.

It can be using any combination of one or more computer-readable media.Computer-readable medium can be calculating Machine readable signal medium or computer readable storage medium.Computer readable storage medium for example can be --- but it is unlimited In system, device or the device of --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, or any above combination.It calculates The more specific example (non exhaustive list) of machine readable storage medium storing program for executing includes: electrical connection with one or more conducting wires, just Taking formula computer disk, hard disk, random access memory (RAM), read-only memory (ROM), erasable type may be programmed read-only storage Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device, Or above-mentioned any appropriate combination.In this document, computer readable storage medium can be it is any include or storage journey The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.

Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal, Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including --- but It is not limited to --- electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be Any computer-readable medium other than computer readable storage medium, which can send, propagate or Transmission is for by the use of instruction execution system, device or device or program in connection.

The program code for including on computer-readable medium can transmit with any suitable medium, including --- but it is unlimited In --- wireless, electric wire, optical cable, RF etc. or above-mentioned any appropriate combination.

The computer for executing operation of the present invention can be write with one or more programming languages or combinations thereof Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++, It further include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with It fully executes, partly execute on the user computer on the user computer, being executed as an independent software package, portion Divide and partially executes or executed on a remote computer or server completely on the remote computer on the user computer.? Be related in the situation of remote computer, remote computer can pass through the network of any kind --- including local area network (LAN) or Wide area network (WAN)-be connected to subscriber computer, or, it may be connected to outer computer (such as mentioned using Internet service It is connected for quotient by internet).

Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation, It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.

Claims

The equipment 1. a kind of auxiliary is filled in a form characterized by comprising platform of filling in a form fills in suggestion device, and fills in prompt with described The connected controller of device；

The platform of filling in a form includes the horizontal plane for carrying out hand-written operation, and area of filling in a form is provided on the horizontal plane, described to fill out Table area is for placing hand-written list；

The area lower part of filling in a form is provided with array of pressure sensors, each pressure sensor difference in the array of pressure sensors It is connected with the controller；

The controller, for if it is determined that being currently placed with hand-written list in the area of filling in a form, then by the pressure sensing The pen tip that device array real-time detection occurs in area of filling in a form, and determine user for the hand according to the appearance position of the pen tip Write the position of currently filling in a form of list；Obtain it is corresponding with the position of currently filling in a form fill in prompt information be sent to described in fill in and mention Showing device is shown；

It is described to fill in suggestion device, for show receive described in fill in prompt information.
2. equipment according to claim 1, which is characterized in that further include: identity information sweep unit and print member, The identity information sweep unit and the print member are connected with the controller respectively, and the print member is beaten with described Entrance is printed off to be connected；

The identity information sweep unit, for user close to authentication article identify, and by identification knot Fruit is sent to the controller；

The print member, for being scanned to the hand-written list to be printed by the printing entrance input, and by table Single sweep result is supplied to the controller；The printing control information that the controller is sent is received, and is controlled according to the printing Information processed is printed and is exported to hand-written list to be printed；

The controller generates print control for the identification result based on the received and the list scanning result Information, and the printing control information is sent to the print member, the printing control information is for controlling the printing Component will print in advance in the hand-written list to be printed with the matched identity information of identification result.
3. equipment according to claim 1, which is characterized in that further include: filming apparatus；

The filming apparatus, for shooting and the matched image in area of filling in a form；

The controller, is also used to: according to the image of the filming apparatus captured in real-time, determine described in fill in a form in area it is current whether It is placed with hand-written list.
4. equipment according to claim 3, which is characterized in that the filming apparatus includes: camera and/or high photographing instrument；

The camera is set to the top in the area of filling in a form by L-type support construction, wherein the length of the L-type support construction The one end on side is set on the horizontal plane of the platform of filling in a form, the side setting in area of filling in a form described in the short side direction of the L-type support There is the camera；

The plane of the bottom surface of the high photographing instrument and the platform of filling in a form is provided with described close to setting on the bottom surface of the high photographing instrument It fills in a form area.
5. equipment according to claim 1, which is characterized in that

It is described to fill in the combination that suggestion device includes following one or more: loudspeaker, display screen and projector；

The loudspeaker, for carrying out voice broadcasting to the prompt information of filling in；

The display screen, for being shown to the prompt information progress screen of filling in；

The projector, for filling in that carry out projection in the view field that prompt information is set in the platform of filling in a form aobvious for described Show.
6. equipment according to claim 1-5, which is characterized in that further include: microphone, the microphone and institute Controller is stated to be connected；

The microphone is used to pick up the phonetic order of user, and the phonetic order is sent to the controller；

The controller, is also used to: filled in a form interaction problems according to phonetic order extraction, and obtain with it is described fill in a form to interact ask Inscribe matched interactive answer of filling in a form；The interactive answer of filling in a form is sent to and described fill in suggestion device and is shown；

It is described to fill in suggestion device, it is also used to: showing the interactive answer of filling in a form received.
7. equipment according to claim 6, which is characterized in that further include: communication module, the communication module and the control Device processed is connected；

The controller is specifically used for: the interaction problems of filling in a form being sent to server by the communication module, and are passed through The communication module receives the interactive answer of filling in a form of the server feedback.
8. a kind of auxiliary filling system characterized by comprising as described in claim 1 to assist fill in a form equipment and service Device；

The auxiliary filling system further include: microphone and communication module, the microphone and communication module difference It is connected with the controller；The server is filled in a form the communication mould in equipment in a manner of wiredly and/or wirelessly with the auxiliary Block is connected；

The microphone is used to pick up the phonetic order of user, and the phonetic order is sent to the controller；

The controller, is also used to: the interaction problems of filling in a form being sent to server by the communication module, and pass through institute State the interactive answer of filling in a form that communication module receives the server feedback；The interactive answer of filling in a form is sent to described fill out Writeprompt device is shown；

It is described to fill in suggestion device, it is also used to: showing the interactive answer of filling in a form received；

The server is filled in a form the friendship of filling in a form that the controller in equipment sent by the communication module for receiving the auxiliary Mutual problem calls semantic understanding engine to obtain interactive answer of filling in a form corresponding with the interaction problems of filling in a form, and fills in a form described Interaction answer is sent to the auxiliary and fills in a form the communication module of equipment.
9. a kind of auxiliary form filling method, fill in a form in equipment applied to the described in any item auxiliary of such as claim 1-7, feature exists In, comprising:

If it is determined that be currently placed with hand-written list in area of filling in a form, then by being set to the pressure sensor of the area lower part of filling in a form The pen tip that array real-time detection occurs in area of filling in a form；

Determine user for the position of currently filling in a form of the hand-written list according to the appearance position of the pen tip；

Obtain it is corresponding with the current position of filling in a form fill in prompt information and be sent to fill in suggestion device and be shown.
10. according to the method described in claim 9, it is characterized in that, determine fill in a form currently be placed in area hand-written list it Afterwards, further includes:

Obtain and fill in a form the matched list coordinate mapping relations of hand-written list currently placed in area；

It wherein, include: that at least one handwriting input frame of the hand-written list is filled out with described in the list coordinate mapping relations Mapping relations in table area between respective coordinates range；

Determine user for the position of currently filling in a form of the hand-written list according to the appearance position of the pen tip, comprising:

Determine the pen tip in the pen tip position coordinate filled in a form in area according to the appearance position of the pen tip；

In the coordinate mapping relations, the target handwriting input frame with the pen tip position coordinate matching is obtained as user's needle To the position of currently filling in a form of the hand-written list.
11. according to the method described in claim 10, it is characterized in that, the hand-written list currently placed in the area that obtains and fill in a form The list coordinate mapping relations matched, comprising:

It fills in a form area's image according to first, determines the form types of the hand-written list, wherein described first fills in a form area's image to clap Device captured in real-time is taken the photograph, and is identified the image for being currently placed with hand-written list in area of filling in a form；

Obtain with the matched list coordinate mapping relations of the form types, as with the hand-written list currently placed in area of filling in a form Matched list coordinate mapping relations.
12. according to the method for claim 11, which is characterized in that fill in a form area's image according to described first, determine the hand Write the form types of list, comprising:

In area's image of filling in a form, the list profile of the hand-written list is identified；

According to the list profile identified, determining gauge outfit region corresponding with the hand-written list；

Optical character identification is carried out to the gauge outfit region, and determines the table of the hand-written list according to optical character identification result Single type.
13. according to the method for claim 11, which is characterized in that acquisition is reflected with the matched list coordinate of the form types Penetrate relationship, comprising:

The form types are sent to server, and obtain the server feedback with the matched list of the form types Coordinate mapping relations.
14. according to the method described in claim 9, it is characterized in that, determining the pen tip according to the appearance position of the pen tip In the pen tip position coordinate filled in a form in area, comprising:

According at least one goal pressure sensor and pressure sensor for detecting the pen tip and area's coordinates regional of filling in a form Between mapping relations, obtain with the zone position coordinate of filling in a form of at least one goal pressure sensor matching as the pen Sharp position coordinates.
15. according to the method for claim 14, which is characterized in that obtain and at least one described goal pressure sensor The zone position coordinate of filling in a form matched is as the pen tip position coordinate, comprising:

Obtain the target area being made of area's coordinates regional of filling in a form corresponding with each goal pressure sensor；

By the corresponding zone position coordinate of filling in a form in the midpoint of the target area, as the pen tip position coordinate.
16. the described in any item methods of 0-15 according to claim 1, which is characterized in that be currently placed with determining in area of filling in a form After hand-written list, further includes:

Edge detection is carried out to the hand-written list, and obtains the deflection angle between the object edge detected and normal line, institute Normal line is stated to be associated with an edge in the area of filling in a form；

Determining that the pen tip after the pen tip position coordinate filled in a form in area, also wraps according to the appearance position of the pen tip It includes:

According to the deflection angle, coordinate modification is carried out to the pen tip position coordinate.
17. according to the method described in claim 9, it is characterized by further comprising:

If detecting that user completes to fill in the hand-written list by filming apparatus, shooting is matched with the area of filling in a form Second fill in a form area's image；

Optical character identification is carried out to described second area's image of filling in a form, and according to optical character identification result, generates user and fills in a form Information；

Information preliminary hearing, and/or information-based filing are carried out to user information of filling in a form.
18. according to the method described in claim 9, it is characterized by further comprising:

The identification of received identity information scan module identification as a result, and print member hand-written list to be printed is scanned Obtained list scanning result；

Printing control information is generated according to the identification result and the list scanning result, and by the print control Information is sent to the print member, and the printing control information will be with the identification knot for controlling the print member The matched identity information of fruit is printed in advance in the hand-written list to be printed.
19. according to the method described in claim 9, it is characterized by further comprising:

The phonetic order that microphone picks up is received, and interaction problems of filling in a form are extracted according to the phonetic order；

It obtains and interacts answer with matched fill in a form of interaction problems of filling in a form；

The interactive answer of filling in a form is sent to and described fill in suggestion device and is shown.
20. according to the method for claim 19, which is characterized in that obtain and the matched friendship of filling in a form of the interaction problems of filling in a form Mutual answer, comprising:

The interaction problems of filling in a form are sent to server by communication module, and the service is received by the communication module The interactive answer of filling in a form of device feedback.
21. a kind of auxiliary form filling method characterized by comprising

According to the first user instruction that user sends, Xiang Suoshu user provides the hand-written list of setting type；

During the list of the user is filled in, using such as described in any item methods of claim 9-20, Xiang Suoshu user Prompt information is filled in offer；

The second user instruction sent according to the user, Xiang Suoshu user collect the hand-written list for filling in completion.
22. a kind of auxiliary is filled in a form device, applied in the described in any item equipment that assist filling in a form of such as claim 1-7, feature It is, comprising:

Pen tip detection module, for if it is determined that being currently placed with hand-written list in area of filling in a form, then by being set to described fill in a form The pen tip that the array of pressure sensors real-time detection of area lower part occurs in area of filling in a form；

Current position determination module of filling in a form, for determining user for the hand-written list according to the appearance position of the pen tip Current position of filling in a form；

Fill in prompt information display module, for obtain it is corresponding with the current position of filling in a form fill in prompt information and be sent to fill out Writeprompt device is shown.
The device 23. a kind of auxiliary is filled in a form characterized by comprising

Hand-written list provides module, the first user instruction for sending according to user, and Xiang Suoshu user provides setting type Hand-written list；

It fills in prompt information and module is provided, for being appointed during the list of the user is filled in using such as claim 9-20 Method described in one, Xiang Suoshu user provide and fill in prompt information；

Hand-written list collects module, and the second user instruction for being sent according to the user, Xiang Suoshu user, which collects, to have filled in At the hand-written list.
24. a kind of computer storage medium, is stored thereon with computer program, which is characterized in that the program is executed by processor Auxiliary form filling method of the Shi Shixian as described in any in claim 9-20, alternatively, realizing auxiliary as claimed in claim 21 Form filling method.