CN112306333A - Data filling method and device - Google Patents

Data filling method and device Download PDF

Info

Publication number
CN112306333A
CN112306333A CN202011254950.9A CN202011254950A CN112306333A CN 112306333 A CN112306333 A CN 112306333A CN 202011254950 A CN202011254950 A CN 202011254950A CN 112306333 A CN112306333 A CN 112306333A
Authority
CN
China
Prior art keywords
data
filling
input
selection
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011254950.9A
Other languages
Chinese (zh)
Inventor
吴先锋
李志�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin Huishang Gongda Technology Co ltd
Original Assignee
Tianjin Huishang Gongda Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin Huishang Gongda Technology Co ltd filed Critical Tianjin Huishang Gongda Technology Co ltd
Priority to CN202011254950.9A priority Critical patent/CN112306333A/en
Publication of CN112306333A publication Critical patent/CN112306333A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/22Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • G06V10/225Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on a marking or identifier characterising the area
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a data filling method and a data filling device, wherein a corresponding frame image in a script is determined according to a current frame of an operation interface, the current frame is the current image of the operation interface captured when the script is executed, and the image of the operation interface captured when the frame image script is recorded; acquiring a key area corresponding to the identifier on the current picture frame according to the identifier on the frame image, wherein the identifier is used for calibrating the position of data filling on the frame image; determining a data filling position on an operation interface according to the key area; and filling the data to be input into the data filling position. According to the technical scheme, the data filling position on the operation interface can be found by utilizing the corresponding relation between the identification and the key area, then different operations are carried out on the position according to different filling types on the data filling position, the data to be input is filled into the position, and the situation that some data cannot be knocked in or copied and the butt joint of two system data cannot be realized is prevented.

Description

Data filling method and device
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a method and an apparatus for data padding.
Background
An erp (enterprise Resource planning) system is a management platform which is established on the basis of information technology, integrates the information technology and advanced management ideas, and provides decision means for enterprise employees and decision layers by using a systematized management idea. What is more important in the practical application of the ERP system is to embody the essence of the management tool, and the main purpose of the ERP system is to perform comprehensive balance and optimized management on the comprehensive resources of people, property, objects, information, time, space and the like owned by an enterprise.
As shown in fig. 1, taking an e-commerce platform and a dealer as an example, a terminal device 200 installed with an ERP system is usually installed at one end of the dealer, after a user places an order on the e-commerce platform, the e-commerce platform generates order information and stores the order information in the e-commerce platform data system 100, and the dealer needs to obtain a receipt from the e-commerce platform data system 100 and input the receipt into its own ERP system, so as to conveniently manage a commodity sales condition. After a dealer party takes a document from the e-commerce platform, the document data can be automatically input into the ERP system corresponding to the dealer through the modes of pre-recording scripts and executing the scripts, and the problem that data generated by the e-commerce platform data system and the ERP systems of different versions due to the fact that interfaces are not corresponding cannot be butted is avoided.
However, although the above method implements data interfacing between the e-commerce platform data system and the ERP system, the method is limited by the development tool of the ERP system, some data cannot be typed or copied and only readable data, and thus data interfacing between the two systems cannot be implemented, so that a script cannot be smoothly executed, and the efficiency of the whole data interfacing process is reduced. Therefore, how to fill the data of the e-commerce platform into the ERP system and ensure the smooth execution of the script becomes a problem to be solved urgently by those in the art.
Disclosure of Invention
The application provides a data filling method and device, which can ensure smooth execution of a script and avoid the problems of time consumption and low execution efficiency.
In one aspect, the present application provides a data padding method, including:
determining a corresponding frame image in the script according to a current frame of the operation interface, wherein the current frame is the current image of the operation interface captured when the script is executed, and the image of the operation interface captured when the frame image script is recorded;
acquiring a key area corresponding to the identifier on the current picture frame according to the identifier on the frame image, wherein the identifier is used for calibrating the position of data filling on the frame image;
determining a data filling position on the operation interface according to the key area;
and filling data to be input into the data filling position according to the filling type.
With reference to the first aspect, the step of filling the data to be input in the data filling position includes:
judging the filling type of a data filling position, wherein the filling type comprises an input type and a selection type;
and filling the data to be input according to the filling type.
With reference to the first aspect, the step of filling in the data to be input according to the filling type includes:
if the filling type is a selection type, acquiring the data to be input;
according to the data to be input, OCR recognition is carried out on the content of the selection column of the data filling position, and the same selection item as the data to be input is recognized;
and selecting the option to fill in a data filling position.
In combination with the first aspect, the method further comprises:
if the selection bar comprises a longitudinal selection bar and/or a transverse selection bar, recognizing the same selection item as the data to be input in the initial selection bar by adopting an OCR recognition method;
if the selection item is not identified in the initial selection bar, executing the operation of moving at the position of the longitudinal selection bar and/or the transverse selection bar;
and after the moving operation is finished, continuously identifying whether the selection item which is the same as the data to be input exists in the current selection bar.
With reference to the first aspect, before filling the data to be input in the data filling position according to the filling type, the method further includes:
activating the data population location;
judging whether the activated data filling position has system data or not;
and if the system data exist, clearing the system data to obtain blank data filling positions.
In a second aspect, the present application further provides an apparatus for data padding, including:
the image determining unit is used for determining a corresponding frame image in the script according to a current frame of the operation interface, wherein the current frame is the current image of the operation interface captured when the script is executed, and the image of the operation interface captured when the frame image script is recorded;
a key area obtaining unit, configured to obtain a key area corresponding to the identifier on the current frame according to the identifier on the frame image, where the identifier is used to calibrate a position of data filling on the frame image;
the position determining unit is used for determining a data filling position on the operation interface according to the key area;
and the first data filling unit is used for filling the data to be input into the data filling position according to the filling type.
With reference to the second aspect, the first data padding unit further includes:
the type judging unit is used for judging the filling type of the data filling position, and the filling type comprises an input type and a selection type;
and the second data filling unit is used for filling the data to be input according to the filling type.
With reference to the second aspect, the second data padding unit is further configured to: if the filling type is a selection type, acquiring the data to be input; according to the data to be input, OCR recognition is carried out on the content of the selection column of the data filling position, and the same selection item as the data to be input is recognized; and selecting the option to fill in a data filling position.
With reference to the second aspect, the second data padding unit is further configured to: if the selection bar comprises a longitudinal selection bar and/or a transverse selection bar; identifying the same selection item as the data to be input in the initial selection bar by adopting an OCR (optical character recognition) method; if the selection item is not identified in the initial selection bar, executing the operation of moving at the position of the longitudinal selection bar and/or the transverse selection bar; and after the moving operation is finished, continuously identifying whether the selection item which is the same as the data to be input exists in the current selection bar.
In combination with the second aspect, the apparatus further comprises:
an activation unit for activating the data fill location; judging whether the activated data filling position has system data or not; and if the system data exist, clearing the system data to obtain blank data filling positions.
According to the technical scheme, the method and the device for data filling are provided, wherein the corresponding frame image in the script is determined according to the current frame of the operation interface, the current frame is the current image of the operation interface captured when the script is executed, and the image of the operation interface captured when the frame image script is recorded; acquiring a key area corresponding to the identifier on the current picture frame according to the identifier on the frame image, wherein the identifier is used for calibrating the position of data filling on the frame image; determining a data filling position on an operation interface according to the key area; and filling the data to be input into the data filling position. According to the technical scheme, the data filling position on the operation interface can be found by utilizing the corresponding relation between the identification and the key area, then different operations are carried out on the position according to different filling types on the data filling position, the data to be input is filled into the position, and the situation that some data cannot be knocked in or copied and the butt joint of two system data cannot be realized is prevented.
Drawings
In order to more clearly illustrate the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.
Fig. 1 is a schematic diagram illustrating an e-commerce platform data system and an ERP system provided in the present application;
fig. 2 is a flowchart of a method for data padding according to an embodiment of the present application;
fig. 3 is a schematic diagram of a login interface of the ERP system according to an embodiment of the present application;
FIG. 4 is a diagram illustrating a first data stuffing position according to an embodiment of the present disclosure;
FIG. 5 is a diagram illustrating a second data stuffing position provided by an embodiment of the present application;
FIG. 6 is a diagram illustrating a third data stuffing position according to an embodiment of the present application;
fig. 7 is a block diagram of a data stuffing apparatus according to an embodiment of the present application.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.
The script in the application is a set of some frame images recorded in advance, and the frame images represent corresponding actions executed on an operation interface. The script recording is to collect a series of operations on an operation interface, each action can collect a current picture frame, then the current picture frame is identified, the position of the action is marked by the identification, then the current picture frame of one picture is formed into the script according to the logic sequence of the execution steps, and at this time, the current picture frame in the script becomes a frame image. The script execution process is to execute the frame images in the script on the operation interface frame by frame, and automatically execute corresponding actions on the operation interface according to the actions on the frame images. Taking fig. 1 as an example, the script is executed for the purpose that the dealer takes out the document from the data system of the e-commerce platform and stores the document into its own ERP system.
Referring to fig. 2, an embodiment of the present application provides a data padding method, including:
step 101, determining a corresponding frame image in the script according to a current frame of the operation interface, wherein the current frame is an image of the operation interface captured when the script is executed, and the image of the operation interface captured when the frame image script is recorded. Generally, when a script is executed on an operating system, the script is executed against frame images in the script, if the frame images do not match with the current operating system interface, the position of an action cannot be accurately found on the operating interface, and if an operation of data filling needs to be executed, the position of data filling cannot be found, so that data cannot be imported from one system into another system, so that the purpose of step 101 in the present application is to find a frame image matching with the current frame of the operating system.
And 102, acquiring a key area corresponding to the identifier on the current picture frame according to the identifier on the frame image, wherein the identifier is used for calibrating the position of data filling on the frame image. Usually, when a script is recorded, the action position on the operation interface is difficult to represent, and at this time, a mark is required to mark the position of the action, and the mark is usually a block of area or several blocks of areas, and the block of area is also a block of image because of existing on the frame image. Generally, in the process of recording a script, one or more images different from other parts of the image are usually detected on the recorded image, and the position of the action is marked by the block image or the block image, and the block image or the block image can also be used for representing the operation steps represented by the whole image, so that the function of identification is achieved. As shown in fig. 3, on a login interface in the ERP system, a position indicated by a mouse may be understood as a data filling position, and then the identifier 1 may be used to calibrate the data filling position, where the identifier 1 has a "book cover" word and belongs to a unique image on the login interface.
The key area can be understood as an identifier on the current picture frame, which has the same shape and size as the identifier on the corresponding frame image, and since the identifier is unique on the frame image, the key area should also be unique on the current picture frame. In the embodiment of the present application, the location of the action may be a data fill location. When the script is recorded, the mark and the action position have relative position relation, so when the script is executed, the key area and the action position also have relative position relation.
It should be noted that the mark and key area is a selected image, and the shape and size of the selected image can be determined according to the content of the selected image, but preferably, a rectangle is selected so as to present the coordinate relationship between the mark or key area and the data filling position in the coordinate system.
And 103, determining a data filling position on the operation interface according to the key area. The current frame is a screenshot of the operation interface, all contents on the frame are the same as the operation interface, but finding the actual execution position on the current frame cannot really complete the action, and the action is actually completed on the operation interface.
And 104, filling data to be input into the data filling position according to the filling type. Specifically, step 104 further includes:
step 201, judging the filling type of the data filling position, wherein the filling type comprises an input type and a selection type. The input type is represented by only one input box, and the input box supports copying and inputting of data, such as the input box 2-bit input type shown in fig. 4; while the selection type is represented by an input box with selection items, which does not allow data copying and input and only supports selection of data, as shown in fig. 5.
As shown in fig. 4, after the data filling positions are found according to the key area, the data to be input may be directly copied from a system to the data filling positions on the current operation interface, or the data may be automatically input to the data filling positions one by one according to the data to be input.
And step 202, filling data to be input according to the filling type. Since the data filling position includes two filling types, filling in different manners is performed according to different types, otherwise, the script is easy to be unable to execute. Specifically, step 202 further includes:
step 301, if the filling type is a selection type, acquiring the data to be input.
Step 302, according to the data to be input, performing OCR recognition on the content of the selection bar at the data filling position, and recognizing the same selection item as the data to be input. As shown in fig. 5, a button for displaying options is provided on the right side of the data filling position, when the button is clicked, all the selection items are displayed, after all the options are displayed, whether the selection item is the same as the data to be input is detected by using an OCR technology, if the selection item exists, the selection item can be selected, and after the data is clicked, the data directly enters the data filling position.
In addition, the process of displaying all the options at the data filling position also needs to execute the script, after the current picture frame is matched with the frame image, the position needing to be clicked by the mouse is found according to the mark on the frame image, namely the position of the button, then the clicking operation is executed, and after all the options are displayed, the identification operation is continued.
Step 303, selecting the option to fill in the data filling position. When a selection item which is the same as the data to be input is recognized, the background color of the selection item is different from that of other selection items, and the mouse only needs to click the selection item at the moment, so that the content of the selection item is automatically input into the data filling position.
Of course, if there are too many selection items in the embodiment of the present application, one selection page may not display all the selection items, and at this time, a selection bar may also appear on the selection page, so that the selection page may be turned vertically or horizontally to display more selection items. Specifically, as shown in fig. 6, the selection page at the data filling position in fig. 6 has a vertical selection bar, and the selection bar can be moved to browse the selection items on different pages up and down. The specific steps for operating the selection bar with the selection strip are as follows:
step 401, if the selection bar comprises a longitudinal selection bar and/or a transverse selection bar, recognizing the same selection item as the data to be input in the initial selection bar by using an OCR recognition method. Firstly, OCR recognition is carried out in the initially displayed selection bar, if the same selection item as the data to be input can be recognized at the moment, filling can be selected according to the steps, and the operation of pulling the selection bar is not needed.
And 402, if the selection item is not identified in the initial selection bar, executing the operation of moving at the position of the longitudinal selection bar and/or the transverse selection bar. Specifically, the operation of moving the selection bar is performed by executing the script, the identifier related to the moving action is found on the frame image corresponding to the script, then the key area same as the identifier is found on the current picture frame, the position of the movement action to be performed, namely the position of the selection bar, is determined according to the key area, the position below the selection bar is clicked, the page can be turned downwards, the content of the selection item below the selection bar is displayed, the position above the selection bar is clicked, the page can be turned upwards, and the content of the selection item above the selection item is displayed.
And step 403, after the moving operation is finished, continuously identifying whether a selection item which is the same as the data to be input exists in the current selection bar, if so, executing a click action by a mouse to select the item, and if not, continuously performing the operation of moving the selection bar until the selection item which is the same as the data to be input is identified.
The technical solution in this embodiment of the application needs to fill the data to be input in the data filling position, but there may be a case where the data filling position is not blank initially, for example, the system may give an initial system data, such as a default value, a default option, and the like. However, none of these system data may be data that needs to be filled, and the data that does not match the data to be substituted, the data filling position with the system data needs to be cleared, and specifically, before step 104, the method further includes:
step 501, activating the data filling position. Generally, if the operation interface changes from one frame to the next frame, the mouse has no focus, that is, the mouse does not have any action of clicking at the moment, even if the mouse is found through the frame image, only the clicked position is found, and not all actions on the frame image have the operation of clicking. Therefore, once data input is involved, an additional activation action needs to be set, so that when the mouse clicks at the data filling position, a cursor flickers at the data filling position, and data can be input according to the current state of the position.
Step 502, judging whether the activated data filling position has system data. If no system data exists, the filling steps of the data to be input, namely the processes of the steps 301 to 303 and the steps 401 to 403, can be directly carried out.
And 503, if the system data exists, clearing the system data to obtain a blank data filling position. In the technical scheme of the application, the action of full-selection deletion adopted by the mode of clearing the system data is specifically that after the data filling position is activated, if the system data is detected to exist in the position, the system data needs to be selected fully, then after the data is in a full-selection state, a numerical value is conveniently input, and then the data is deleted, so that the data filling position can be completely emptied, and the situation that the data is deleted in the full-selection state and the lattice is strung is avoided.
According to the technical scheme, the method for filling the data is provided, wherein the corresponding frame image in the script is determined according to the current frame of the operation interface, the current frame is the current image of the operation interface captured when the script is executed, and the image of the operation interface captured when the frame image script is recorded; acquiring a key area corresponding to the identifier on the current picture frame according to the identifier on the frame image, wherein the identifier is used for calibrating the position of data filling on the frame image; determining a data filling position on an operation interface according to the key area; and filling the data to be input into the data filling position. According to the technical scheme, the data filling position on the operation interface can be found by utilizing the corresponding relation between the identification and the key area, then different operations are carried out on the position according to different filling types on the data filling position, the data to be input is filled into the position, and the situation that some data cannot be knocked in or copied and the butt joint of two system data cannot be realized is prevented.
Referring to fig. 7, an embodiment of the present application further provides an apparatus for data population, including:
the image determining unit 71 is configured to determine a corresponding frame image in the script according to a current frame of the operation interface, where the current frame is a current image of the operation interface captured when the script is executed, and the image of the operation interface captured when the frame image script is recorded;
a key area obtaining unit 72, configured to obtain, according to an identifier on the frame image, a key area corresponding to the identifier on the current frame, where the identifier is used to calibrate a position of data filling on the frame image;
a position determining unit 73, configured to determine a data filling position on the operation interface according to the key area;
and a first data filling unit 74 for filling the data to be input in the data filling position according to the filling type.
Optionally, the first data padding unit 75 further includes:
the type judging unit is used for judging the filling type of the data filling position, and the filling type comprises an input type and a selection type;
and the second data filling unit is used for filling the data to be input according to the filling type.
Optionally, the second data padding unit is further configured to: if the filling type is a selection type, acquiring the data to be input; according to the data to be input, OCR recognition is carried out on the content of the selection column of the data filling position, and the same selection item as the data to be input is recognized; and selecting the option to fill in a data filling position.
Optionally, the second data padding unit is further configured to: if the selection bar comprises a longitudinal selection bar and/or a transverse selection bar; identifying the same selection item as the data to be input in the initial selection bar by adopting an OCR (optical character recognition) method; if the selection item is not identified in the initial selection bar, executing the operation of moving at the position of the longitudinal selection bar and/or the transverse selection bar; and after the moving operation is finished, continuously identifying whether the selection item which is the same as the data to be input exists in the current selection bar.
Optionally, the apparatus further comprises:
an activation unit for activating the data fill location; judging whether the activated data filling position has system data or not; and if the system data exist, clearing the system data to obtain blank data filling positions.
According to the technical scheme, the method and the device for data filling are provided, wherein the corresponding frame image in the script is determined according to the current frame of the operation interface, the current frame is the current image of the operation interface captured when the script is executed, and the image of the operation interface captured when the frame image script is recorded; acquiring a key area corresponding to the identifier on the current picture frame according to the identifier on the frame image, wherein the identifier is used for calibrating the position of data filling on the frame image; determining a data filling position on an operation interface according to the key area; and filling the data to be input into the data filling position. According to the technical scheme, the data filling position on the operation interface can be found by utilizing the corresponding relation between the identification and the key area, then different operations are carried out on the position according to different filling types on the data filling position, the data to be input is filled into the position, and the situation that some data cannot be knocked in or copied and the butt joint of two system data cannot be realized is prevented.
The application is operational with numerous general purpose or special purpose computing system environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet-type devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims (10)

1. A method of data population, comprising:
determining a corresponding frame image in the script according to a current frame of the operation interface, wherein the current frame is the current image of the operation interface captured when the script is executed, and the image of the operation interface captured when the frame image script is recorded;
acquiring a key area corresponding to the identifier on the current picture frame according to the identifier on the frame image, wherein the identifier is used for calibrating the position of data filling on the frame image;
determining a data filling position on the operation interface according to the key area;
and filling data to be input into the data filling position according to the filling type.
2. The method according to claim 1, wherein the step of filling the data to be input in the data filling position according to the filling type comprises:
judging the filling type of a data filling position, wherein the filling type comprises an input type and a selection type;
and filling the data to be input according to the filling type.
3. The method according to claim 2, wherein the step of filling in the data to be input according to the filling type comprises:
if the filling type is a selection type, acquiring the data to be input;
according to the data to be input, OCR recognition is carried out on the content of the selection column of the data filling position, and the same selection item as the data to be input is recognized;
and selecting the option to fill in a data filling position.
4. The method of claim 3, further comprising:
if the selection bar comprises a longitudinal selection bar and/or a transverse selection bar, recognizing the same selection item as the data to be input in the initial selection bar by adopting an OCR recognition method;
if the selection item is not identified in the initial selection bar, executing the operation of moving at the position of the longitudinal selection bar and/or the transverse selection bar;
and after the moving operation is finished, continuously identifying whether the selection item which is the same as the data to be input exists in the current selection bar.
5. The method according to any one of claims 1-4, further comprising, before filling in data to be input at the data filling location according to a filling type:
activating the data population location;
judging whether the activated data filling position has system data or not;
and if the system data exist, clearing the system data to obtain blank data filling positions.
6. An apparatus for data population, comprising:
the image determining unit is used for determining a corresponding frame image in the script according to a current frame of the operation interface, wherein the current frame is the current image of the operation interface captured when the script is executed, and the image of the operation interface captured when the frame image script is recorded;
a key area obtaining unit, configured to obtain a key area corresponding to the identifier on the current frame according to the identifier on the frame image, where the identifier is used to calibrate a position of data filling on the frame image;
the position determining unit is used for determining a data filling position on the operation interface according to the key area;
and the first data filling unit is used for filling the data to be input into the data filling position according to the filling type.
7. The apparatus of claim 6, wherein the first data padding unit further comprises:
the type judging unit is used for judging the filling type of the data filling position, and the filling type comprises an input type and a selection type;
and the second data filling unit is used for filling the data to be input according to the filling type.
8. The apparatus of claim 7, wherein the second data padding unit is further configured to: if the filling type is a selection type, acquiring the data to be input; according to the data to be input, OCR recognition is carried out on the content of the selection column of the data filling position, and the same selection item as the data to be input is recognized; and selecting the option to fill in a data filling position.
9. The apparatus of claim 8, wherein the second data padding unit is further configured to: if the selection bar comprises a longitudinal selection bar and/or a transverse selection bar, recognizing the same selection item as the data to be input in the initial selection bar by adopting an OCR recognition method; if the selection item is not identified in the initial selection bar, executing the operation of moving at the position of the longitudinal selection bar and/or the transverse selection bar; and after the moving operation is finished, continuously identifying whether the selection item which is the same as the data to be input exists in the current selection bar.
10. The apparatus according to any one of claims 6-9, further comprising:
an activation unit for activating the data fill location; judging whether the activated data filling position has system data or not; and if the system data exist, clearing the system data to obtain blank data filling positions.
CN202011254950.9A 2020-11-11 2020-11-11 Data filling method and device Pending CN112306333A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011254950.9A CN112306333A (en) 2020-11-11 2020-11-11 Data filling method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011254950.9A CN112306333A (en) 2020-11-11 2020-11-11 Data filling method and device

Publications (1)

Publication Number Publication Date
CN112306333A true CN112306333A (en) 2021-02-02

Family

ID=74324976

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011254950.9A Pending CN112306333A (en) 2020-11-11 2020-11-11 Data filling method and device

Country Status (1)

Country Link
CN (1) CN112306333A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1673995A (en) * 2004-03-24 2005-09-28 微软公司 Method and apparatus for populating electronic forms from scanned documents
AU2006307452A1 (en) * 2005-10-25 2007-05-03 Charactell Ltd Form data extraction without customization
CN109360065A (en) * 2018-10-24 2019-02-19 北京赢销通软件技术有限公司 A kind of script execution and device
CN109445788A (en) * 2018-10-24 2019-03-08 北京赢销通软件技术有限公司 A kind of script execution and device
CN109829444A (en) * 2019-02-28 2019-05-31 广州达安临床检验中心有限公司 Document input method, device, computer equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1673995A (en) * 2004-03-24 2005-09-28 微软公司 Method and apparatus for populating electronic forms from scanned documents
AU2006307452A1 (en) * 2005-10-25 2007-05-03 Charactell Ltd Form data extraction without customization
CN109360065A (en) * 2018-10-24 2019-02-19 北京赢销通软件技术有限公司 A kind of script execution and device
CN109445788A (en) * 2018-10-24 2019-03-08 北京赢销通软件技术有限公司 A kind of script execution and device
CN109829444A (en) * 2019-02-28 2019-05-31 广州达安临床检验中心有限公司 Document input method, device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
US9977654B2 (en) Method of developing an application for execution in a workflow management system and apparatus to assist with generation of an application for execution in a workflow management system
KR101076867B1 (en) Automatic image capture for generating content
US7974960B2 (en) System for identification of context related information in knowledge sources
CN109360065B (en) Script execution method and device
KR102369604B1 (en) Presenting fixed format documents in reflowed format
CN109324864B (en) Method and device for acquiring man-machine interaction operation information
TWI545450B (en) Browser and method for displaying subsites
CN103714114A (en) Natural language metric condition alerts orchestration
CN103714450A (en) Natural language metric condition alerts generation
CN104572067A (en) Associating a visualization of user interface with source code
US8954342B2 (en) Publishing an industry business architecture model
CN112764736B (en) Web end flow chart modeling method, device and system
WO2021158902A1 (en) System and method for creating a process flow diagram which incorporates knowledge of the technical implementations of flow nodes
CN114049631A (en) Data labeling method and device, computer equipment and storage medium
JP2023107749A (en) Browser-based robotic process automation (RPA) robot design interface
JP2018159966A (en) Information processing apparatus and information processing program
US10877651B2 (en) Displaying a series of reports within a single user interface
CN114489625A (en) Method and device for converting JSON format text into visual configuration tool
CN114416516A (en) Test case and test script generation method, system and medium based on screenshot
CN113419711A (en) Page guiding method and device, electronic equipment and storage medium
CN110020279A (en) Page data processing method, device and storage medium
CN110162301B (en) Form rendering method, form rendering device and storage medium
CN114415911B (en) Data entry method and device
CN112306333A (en) Data filling method and device
US20160086127A1 (en) Method and system for generating interaction diagrams for a process

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210202