WO2020029388A1 - File transmission method, system, computer device and storage medium - Google Patents

File transmission method, system, computer device and storage medium Download PDF

Info

Publication number
WO2020029388A1
WO2020029388A1 PCT/CN2018/106693 CN2018106693W WO2020029388A1 WO 2020029388 A1 WO2020029388 A1 WO 2020029388A1 CN 2018106693 W CN2018106693 W CN 2018106693W WO 2020029388 A1 WO2020029388 A1 WO 2020029388A1
Authority
WO
WIPO (PCT)
Prior art keywords
file
path
remote server
data
target path
Prior art date
Application number
PCT/CN2018/106693
Other languages
French (fr)
Chinese (zh)
Inventor
李琦
刘琼
谢云
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2020029388A1 publication Critical patent/WO2020029388A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Definitions

  • the present application relates to the field of data processing technologies, and in particular, to a file transmission method, system, computer device, and storage medium.
  • the application on the client generates a large number of files every day, such as the most common log files.
  • part of the data is what the remote server wants to obtain.
  • the remote server establishes a connection with the client, if you manually find the data and upload the file, obviously the workload is very heavy.
  • the file is automatically uploaded to the remote server by automatically finding the file, when the file size is large, the client cannot determine which data is required by the remote server, and all files may be uploaded to the remote server, which may cause the remote server to receive it. A lot of unwanted data. If multiple clients upload a large number of files to a remote server at the same time, it is also prone to network congestion, which puts pressure on transferring files.
  • a file transfer method includes:
  • the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to one of the data extraction rules,
  • the data extraction rule includes a data field to be extracted, a file renaming name, and a target path;
  • the file stored in the target path is sent to the remote server.
  • a file transfer system includes:
  • the obtaining unit is configured to obtain a file search directory table, where the file search directory table is stored in a client database, and the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to an The data extraction rule, which includes a data field to be extracted, a file renaming name, and a target path;
  • a file generating unit is set to periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database according to the file path, and use the file path
  • the data field in the data extraction rule extracts data information, saves the data information in the file, and sequentially generates the files for several of the file paths;
  • the sending unit is configured to periodically establish a connection with a remote server through a preset secure file transfer protocol SFTP client software on the client, and send the file stored in the target path to the remote server.
  • a computer device includes a memory and a processor.
  • the memory stores computer-readable instructions.
  • the processor causes the processor to perform the following steps:
  • the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to one of the data extraction rules,
  • the data extraction rule includes a data field to be extracted, a file renaming name, and a target path;
  • the file stored in the target path is sent to the remote server.
  • a storage medium storing computer-readable instructions.
  • the one or more processors execute the following steps:
  • the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to one of the data extraction rules,
  • the data extraction rule includes a data field to be extracted, a file renaming name, and a target path;
  • the file stored in the target path is sent to the remote server.
  • the above file transmission method, device, computer equipment and storage medium include obtaining a file search directory table, the file search directory table is stored in a client database, and the file search directory table includes a number of file paths and data extraction rules, each of which corresponds to a file path A data extraction rule.
  • the data extraction rule includes the data fields to be extracted, the file renaming name, and the target path.
  • the file is periodically created in the target path corresponding to the file path, and the file is renamed by the file renaming name.
  • Access the database use the data fields in the data extraction rules to extract the data information, and save the data information in the file, and generate files for several file paths in sequence; by presetting the secure file transfer protocol SFTP client software on the client with the remote server Establish a connection and send the file stored in the destination path to the remote server.
  • the present application can accurately classify files by re-extracting data, renaming and sorting files, and by deploying SFTP client software, the purpose of remote and automatic file transmission with remote servers can be achieved.
  • FIG. 1 is a flowchart of a file transmission method according to an embodiment of the present application
  • FIG. 2 is a flowchart of step S1 in an embodiment
  • step S2 is a flowchart of step S2 in an embodiment
  • step S3 is a flowchart of step S3 in an embodiment
  • FIG. 5 is a structural diagram of a file transmission system according to an embodiment of the present application.
  • FIG. 6 is a structural diagram of a file generating unit in one embodiment.
  • FIG. 1 is a flowchart of a file transmission method according to an embodiment of the present application. As shown in FIG. 1, a file transmission method includes the following steps:
  • Step S1 obtaining a file search directory table: obtaining a file search directory table, the file search directory table is stored in a client database, and the file search directory table includes a number of file paths and data extraction rules, and each file path corresponds to a data extraction rule
  • the data extraction rules include the data fields to be extracted, the file renaming name, and the target path.
  • a file search directory table is preset in the client's database.
  • the file search directory table contains a number of file paths. Each file path can access files or data in the database. Each file path also corresponds to a file path. Data extraction rules, such as which data fields in the file or data need to be extracted after accessing the file or data in the database, the file name of the new file to be renamed, the path location of the new file to be generated in the database, etc. .
  • Step S2 generate a file: periodically create a file in a target path corresponding to the file path, rename the file with a file rename name, access the database according to the file path, extract data information from the data fields in the data extraction rule, and save the data
  • the information is saved in a file, and files are sequentially generated for several file paths.
  • the timing in this step is to select a certain time, such as sequentially generating files from 9:00 in the morning. In order to avoid system pressure on the client when the client processes data, the time can also be set to 9 in the evening. 0:00 and other non-working hours, automatically generate several files.
  • Step S3 Send the file:
  • the SFTP client software which is a preset secure file transfer protocol on the client, is used to periodically establish a connection with the remote server, and send the file stored in the target path to the remote server.
  • SFTP is the abbreviation of Secure File Transfer and Protocol, which is a secure file transfer protocol that can provide a secure network encryption method for transferring files.
  • SFTP is part of SSH and is a secure way to transfer files to a server.
  • the SSH software package contains the secure file information transmission subsystem of SFTP.
  • SFTP itself does not have a separate daemon process. It uses the SSHD process to complete the corresponding connection and reply operations.
  • SFTP uses encryption to transmit authentication information and data. Therefore, using SFTP in this step is very secure.
  • the SFTP client software When the SFTP client software establishes a connection with a remote server, there are two connection methods, one is to use the SFTP client software to connect to the remote server IP, and the other is to log in to the remote server first and then enable the SFTP function. This step uses the SFTP client software to connect to the remote server, periodically establishes a connection with the remote server, and sends the file stored in the target path to the remote server.
  • the SFTP client software is used to periodically establish a connection with the remote server, and the generated files are sent to the remote server at regular intervals to ensure that the remote server receives the received packets at regular intervals.
  • the data in the file is the required data, avoiding receiving many unnecessary data, and avoiding the problem of network congestion caused by the client uploading a large number of files.
  • the method of transferring files through SFTP can not only achieve the purpose of automatically uploading files, but also ensure that the uploaded files are safe and reliable.
  • the method before obtaining the file search directory table, the method includes:
  • Step S101 preset input interface and file search directory table: preset input interface and file search directory table on the client, and set file path search button, file path field, data field, file rename name field and target path in the input interface Field.
  • Step S102 storing field information: after obtaining the field information input in the entry interface, storing the field information in a file search directory table.
  • this step is to increase the file through the input interface.
  • Get the data generate a new file and send it to the remote server.
  • the entry interface can also be set to modify and delete related functions, in order to modify and delete the saved dry file path and data extraction rules in the file search directory table, increasing the flexibility of this step.
  • step S2 includes:
  • step S201 a file is created: a preset java timed task is called, a file is sequentially created in a target path corresponding to the file path, and the file is renamed with the current timestamp and the file is renamed.
  • the file renaming name can be preset with different names. For example, if the file path indicates a fund ranking file, when extracting data fields from the fund ranking file, the file renaming name can be defined as FundRank, the file name when renaming the file in this step is FundRank20180719134209. If the file path indicates a wealth management product ranking file, when extracting data fields from the wealth management product ranking file, the file renaming name can be defined as FinPrdRank, and the file name when renaming the file in this step is FinPrdRank20180719134209.
  • Step S202 Save the data information: According to the file path, extract the data field corresponding to the file path from the database, set the data field to the data information, and then store the data information in the file.
  • the file path indicates a fund ranking file
  • data fields are extracted from the fund ranking file, and the data information corresponding to the data field is stored in the file generated in step S201.
  • Step S203 sorting: place the files in the target path, and sort the file names in descending order in chronological order.
  • the file path indicates the fund ranking file.
  • the file rename name can be defined as FundRank
  • the file name is generated on July 18 as FundRank20180718134128
  • the file, FundRank20180719134209 was generated on July 19.
  • This step sorts all the files in a target path in chronological order in descending order to ensure that the first generated file is the most recently generated file, and the file is sent to the remote in the future.
  • the server get the first file.
  • Step S204 traverse the file path: according to the java timed task, traverse several file paths, and sequentially generate files in the target path corresponding to the file path.
  • the file search directory table contains several file paths, it is possible to ensure that all the file paths correspond to the latest file by traversing.
  • a number of files are generated periodically by invoking a Java timed task, which can achieve the purpose of automatically capturing data by the client and automatically generating required files.
  • step S3 includes: calling the SFTP client software preset on the client, periodically establishing a connection with the remote server, reading the file in the target path, and sending the file to the remote server through the SFTP client software. As shown in FIG. 4, it specifically includes the following steps:
  • step S301 the parameters are automatically set: obtaining the user name and password of the SFTP client software, calling the SFTP client software, and automatically setting the file sending port number and the IP address of the remote server.
  • the user name, password file sending port number, and remote server IP address of the SFTP client software can be preset in a form or file. This step obtains this information from the preset form or file and calls the SFTP client software. Automatically set file sending port number and IP address of remote server.
  • the file sending port number of the SFTP client software is 22 by default.
  • step S302 a connection is established: a shell script is invoked, and the user name, password, port number, and IP address are used as parameters of the SFTP client software, and the SFTP client software is used to periodically establish a connection with the remote server.
  • Shell scripting is both a command language and a programming language. Shell scripts are put into a file with various commands in advance, which is a program file that is convenient for one-time execution. Shell scripts are more powerful than batch processing under Windows and more efficient than programs edited with other programming programs. This step uses a shell script to periodically establish a connection between the SFTP client software and a remote server.
  • step S303 the file is sent: the newly generated files in the target path are sequentially read and sent to the remote server.
  • This step reads the files in several target paths in the client, reads the newly generated files, and sends the newly generated files to the remote server. In this step, you can also use a shell script to automatically upload files.
  • the file transmission method of the present application accesses data information in a database through a file path in a file search directory table, generates a file and renames a file through a data extraction rule, and stores the data information in a newly generated file.
  • the SFTP client software After accessing the data information corresponding to all file paths and generating several files, the SFTP client software periodically establishes a connection with the remote server and sends the newly generated files to the remote server.
  • the method of the present application does not need to manually find a file uploaded to a remote server. Because the data information in the file is the designated data, it avoids the problem that the remote server receives many unnecessary data.
  • the SFTP client software is used for regular sending to avoid network congestion caused by multiple clients uploading a large number of files at the same time. And use SFTP client software to send, can ensure the safe and stable sending of files.
  • a file transfer system is proposed, as shown in FIG. 5, and includes the following units:
  • the obtaining unit is configured to obtain a file search directory table.
  • the file search directory table is stored in the client's database.
  • the file search directory table includes several file paths and data extraction rules. Each file path corresponds to a data extraction rule and a data extraction rule. Including the data fields to be extracted, the file renaming name, and the target path;
  • Generate a file unit set it to periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database by the file path, extract data information from the data fields in the data extraction rule, and save the data Information is stored in files, and files are generated for several file paths in sequence;
  • the sending unit is configured to periodically establish a connection with the remote server through a preset secure file transfer protocol SFTP client software on the client, and send the file stored in the target path to the remote server.
  • it further includes a storage file search directory table unit, which is configured to preset the input interface and the file search directory table on the client, and set a file path search button, a file path field, a data field, and a file rename name in the input interface. Field and target path field. After obtaining the field information entered in the entry interface, store the field information in the file search directory table.
  • generating a file unit includes:
  • Create a file module set to call a preset java timed task, create files in the target path corresponding to the file path in turn, and rename the file with the file rename name plus the current timestamp;
  • Save data information module set to extract the data field corresponding to the file path from the database, set the data field to data information, and store the data information in the file;
  • Sorting module set to sort files in the target path, and sort file names in descending order according to chronological order;
  • the traversal module is set to traverse several file paths according to the java timed task, and sequentially generate files in the target path corresponding to the file path.
  • the sending unit is further configured to call the SFTP client software preset on the client, periodically establish a connection with the remote server, read the file in the target path, and send the file to the remote server through the SFTP client software .
  • the sending unit is further configured to obtain the user name and password of the SFTP client software, invoke the SFTP client software, automatically set the file sending port number, the IP address of the remote server, and invoke a shell script with the user name and password. , Port number, and IP address are used as parameters of the SFTP client software.
  • the SFTP client software is used to periodically establish a connection with the remote server. The newly generated files in the target path are sequentially read and sent to the remote server.
  • a computer device which includes a memory and a processor.
  • the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the processor is caused to implement the foregoing when the computer-readable instructions are executed.
  • a storage medium storing computer-readable instructions.
  • the computer-readable instructions are executed by one or more processors, the one or more processors are caused to execute the file transfer method in the foregoing embodiments. Steps.
  • the storage medium may be a non-volatile storage medium.
  • the program may be stored in a computer-readable storage medium.
  • the storage medium may include: Read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks, etc.

Abstract

The present application relates to the technical field of data processing, in particular to a file transmission method, a system, a computer device and a storage medium. The method comprises: acquiring a file lookup directory table, which comprises a plurality of file paths and a data extraction rule, creating files in target paths corresponding to the file paths at regular intervals, renaming the files with a file rename name, accessing a database according to the file paths, extracting data information according to data fields in the data extraction rule, and storing the data information in the files; establishing a connection with a remote server at regular intervals through SFTP client software of a client, and transmitting the files stored in the target paths to the remote server. The present application can accurately classify the files by re-extracting the data, renaming and sorting the files, and can implement the remote automatic secure transmission of the files with the remote server by deploying the SFTP client software.

Description

文件传输方法、系统、计算机设备和存储介质File transmission method, system, computer equipment and storage medium
本申请要求于2018年08月08日提交中国专利局、申请号为201810891980.7、发明名称为“文件传输方法、系统、计算机设备和存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority from a Chinese patent application filed with the Chinese Patent Office on August 08, 2018, with application number 201810891980.7, and the invention name is "File Transfer Method, System, Computer Equipment, and Storage Medium", the entire contents of which are incorporated by reference. In this application.
技术领域Technical field
本申请涉及数据处理技术领域,尤其涉及一种文件传输方法、系统、计算机设备和存储介质。The present application relates to the field of data processing technologies, and in particular, to a file transmission method, system, computer device, and storage medium.
背景技术Background technique
客户端上的应用程序每天均会产生大量的文件,比如最常见的日志文件,在众多文件中,一部分数据是远程服务器希望获取的。远程服务器与客户端建立连接后,如果采用人工查找数据并上传文件,显然工作量非常大。如果以自动查找文件的方式,自动上传到远程服务器,在文件量大时,客户端无法确定哪些数据是远程服务器需要的前提下,可能将所有文件均上传给远程服务器,容易造成远程服务器接收到很多不需要的数据。多个客户端如果同时上传大量文件给远程服务器,还容易出现网络堵塞,给传输文件带来了压力。The application on the client generates a large number of files every day, such as the most common log files. Among the many files, part of the data is what the remote server wants to obtain. After the remote server establishes a connection with the client, if you manually find the data and upload the file, obviously the workload is very heavy. If the file is automatically uploaded to the remote server by automatically finding the file, when the file size is large, the client cannot determine which data is required by the remote server, and all files may be uploaded to the remote server, which may cause the remote server to receive it. A lot of unwanted data. If multiple clients upload a large number of files to a remote server at the same time, it is also prone to network congestion, which puts pressure on transferring files.
发明内容Summary of the invention
有鉴于此,有必要针对大量客户端已产生的文件无法准确定位查找并传输给远程服务器的问题,提供一种文件传输方法、系统、计算机设备和存储介质。In view of this, it is necessary to provide a file transmission method, system, computer device, and storage medium for the problem that a large number of files generated by clients cannot be accurately located and searched and transmitted to a remote server.
一种文件传输方法,包括:A file transfer method includes:
获取文件查找目录表,所述文件查找目录表存储在客户端的数据库中,所述文件查找目录表中包括若干文件路径及数据提取规则,每项所述文件路径对应一项所述数据提取规则,所述数据提取规则包括需要提取的数据字段、文件 重命名名称和目标路径;Obtaining a file search directory table, where the file search directory table is stored in a client database, the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to one of the data extraction rules, The data extraction rule includes a data field to be extracted, a file renaming name, and a target path;
定时在所述文件路径对应的所述目标路径中创建文件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件;Periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database according to the file path, and extract data from the data extraction rule Field to extract data information, and save the data information in the file, and sequentially generate the files for several of the file paths;
通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器。By presetting a secure file transfer protocol SFTP client software on the client to periodically establish a connection with a remote server, the file stored in the target path is sent to the remote server.
一种文件传输系统,包括:A file transfer system includes:
获取单元,设置为获取文件查找目录表,所述文件查找目录表存储在客户端的数据库中,所述文件查找目录表中包括若干文件路径及数据提取规则,每项所述文件路径对应一项所述数据提取规则,所述数据提取规则包括需要提取的数据字段、文件重命名名称和目标路径;The obtaining unit is configured to obtain a file search directory table, where the file search directory table is stored in a client database, and the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to an The data extraction rule, which includes a data field to be extracted, a file renaming name, and a target path;
生成文件单元,设置为定时在所述文件路径对应的所述目标路径中创建文件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件;A file generating unit is set to periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database according to the file path, and use the file path The data field in the data extraction rule extracts data information, saves the data information in the file, and sequentially generates the files for several of the file paths;
发送单元,设置为通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器。The sending unit is configured to periodically establish a connection with a remote server through a preset secure file transfer protocol SFTP client software on the client, and send the file stored in the target path to the remote server.
一种计算机设备,包括存储器和处理器,所述存储器中存储有计算机可读指令,所述计算机可读指令被所述处理器执行时,使得所述处理器执行以下步骤:A computer device includes a memory and a processor. The memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor causes the processor to perform the following steps:
获取文件查找目录表,所述文件查找目录表存储在客户端的数据库中,所述文件查找目录表中包括若干文件路径及数据提取规则,每项所述文件路径对应一项所述数据提取规则,所述数据提取规则包括需要提取的数据字段、文件 重命名名称和目标路径;Obtaining a file search directory table, where the file search directory table is stored in a client database, the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to one of the data extraction rules, The data extraction rule includes a data field to be extracted, a file renaming name, and a target path;
定时在所述文件路径对应的所述目标路径中创建文件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件;Periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database according to the file path, and extract data from the data extraction rule Field to extract data information, and save the data information in the file, and sequentially generate the files for several of the file paths;
通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器。By presetting a secure file transfer protocol SFTP client software on the client to periodically establish a connection with a remote server, the file stored in the target path is sent to the remote server.
一种存储有计算机可读指令的存储介质,所述计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器执行以下步骤:A storage medium storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the following steps:
获取文件查找目录表,所述文件查找目录表存储在客户端的数据库中,所述文件查找目录表中包括若干文件路径及数据提取规则,每项所述文件路径对应一项所述数据提取规则,所述数据提取规则包括需要提取的数据字段、文件重命名名称和目标路径;Obtaining a file search directory table, where the file search directory table is stored in a client database, the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to one of the data extraction rules, The data extraction rule includes a data field to be extracted, a file renaming name, and a target path;
定时在所述文件路径对应的所述目标路径中创建文件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件;Periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database according to the file path, and extract data from the data extraction rule Field to extract data information, and save the data information in the file, and sequentially generate the files for several of the file paths;
通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器。By presetting a secure file transfer protocol SFTP client software on the client to periodically establish a connection with a remote server, the file stored in the target path is sent to the remote server.
上述文件传输方法、装置、计算机设备和存储介质,包括获取文件查找目录表,文件查找目录表存储在客户端的数据库中,文件查找目录表中包括若干文件路径及数据提取规则,每项文件路径对应一项数据提取规则,数据提取规则包括需要提取的数据字段、文件重命名名称和目标路径;定时在文件路径对应的目标路径中创建文件,对文件以文件重命名名称进行重命名,按文件路径访问数据库,以数据提取规则中的数据字段提取数据信息,并将数据信息保存在文件中,对若干文件路径依次生成文件;通过预设在客户端的安全文件传送 协议SFTP客户端软件定时与远程服务器建立连接,将存储在目标路径中的文件发送给远程服务器。本申请通过对数据的再次提取,对文件的重命名和排序,能准确分类文件,通过部署SFTP客户端软件,与远程服务器能实现远程自动安全传输文件的目的。The above file transmission method, device, computer equipment and storage medium include obtaining a file search directory table, the file search directory table is stored in a client database, and the file search directory table includes a number of file paths and data extraction rules, each of which corresponds to a file path A data extraction rule. The data extraction rule includes the data fields to be extracted, the file renaming name, and the target path. The file is periodically created in the target path corresponding to the file path, and the file is renamed by the file renaming name. Access the database, use the data fields in the data extraction rules to extract the data information, and save the data information in the file, and generate files for several file paths in sequence; by presetting the secure file transfer protocol SFTP client software on the client with the remote server Establish a connection and send the file stored in the destination path to the remote server. The present application can accurately classify files by re-extracting data, renaming and sorting files, and by deploying SFTP client software, the purpose of remote and automatic file transmission with remote servers can be achieved.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本申请的限制。Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the detailed description of the preferred embodiments below. The drawings are only for the purpose of illustrating preferred embodiments and are not to be considered as limiting the present application.
图1为本申请一个实施例中的文件传输方法的流程图;FIG. 1 is a flowchart of a file transmission method according to an embodiment of the present application;
图2为一个实施例中步骤S1的流程图;FIG. 2 is a flowchart of step S1 in an embodiment; FIG.
图3为一个实施例中步骤S2的流程图;3 is a flowchart of step S2 in an embodiment;
图4为一个实施例中步骤S3的流程图;4 is a flowchart of step S3 in an embodiment;
图5为本申请一个实施例中文件传输系统的结构图;5 is a structural diagram of a file transmission system according to an embodiment of the present application;
图6为一个实施例中生成文件单元的结构图。FIG. 6 is a structural diagram of a file generating unit in one embodiment.
具体实施方式detailed description
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the purpose, technical solution, and advantages of the present application clearer, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the application, and are not used to limit the application.
本技术领域技术人员可以理解,除非特意声明,这里使用的单数形式“一”、“一个”、“所述”和“该”也可包括复数形式。应该进一步理解的是,本申请的说明书中使用的措辞“包括”是指存在所述特征、整数、步骤、操作、元件和/或组件,但是并不排除存在或添加一个或多个其他特征、整数、步骤、操作、 元件、组件和/或它们的组。Those skilled in the art will understand that, unless specifically stated otherwise, the singular forms "a", "an", "the" and "the" may include plural forms. It should be further understood that the word "comprising" used in the specification of the present application refers to the presence of the described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components, and / or groups thereof.
图1为本申请一个实施例中的文件传输方法的流程图,如图1所示,一种文件传输方法,包括以下步骤:FIG. 1 is a flowchart of a file transmission method according to an embodiment of the present application. As shown in FIG. 1, a file transmission method includes the following steps:
步骤S1,获取文件查找目录表:获取文件查找目录表,文件查找目录表存储在客户端的数据库中,文件查找目录表中包括若干文件路径及数据提取规则,每项文件路径对应一项数据提取规则,数据提取规则包括需要提取的数据字段、文件重命名名称和目标路径。Step S1, obtaining a file search directory table: obtaining a file search directory table, the file search directory table is stored in a client database, and the file search directory table includes a number of file paths and data extraction rules, and each file path corresponds to a data extraction rule The data extraction rules include the data fields to be extracted, the file renaming name, and the target path.
本步骤预先在客户端的数据库中预设文件查找目录表,文件查找目录表中包含有若干文件路径,按每一项文件路径可以访问到数据库中的文件或数据,每一项文件路径还对应一项数据提取规则,比如访问到数据库中的文件或数据后,需要提取文件或数据中的哪些数据字段、生成的新文件需要重命名的文件名称,需要生成的新文件在数据库中的路径位置等。In this step, a file search directory table is preset in the client's database. The file search directory table contains a number of file paths. Each file path can access files or data in the database. Each file path also corresponds to a file path. Data extraction rules, such as which data fields in the file or data need to be extracted after accessing the file or data in the database, the file name of the new file to be renamed, the path location of the new file to be generated in the database, etc. .
步骤S2,生成文件:定时在文件路径对应的目标路径中创建文件,对文件以文件重命名名称进行重命名,按文件路径访问数据库,以数据提取规则中的数据字段提取数据信息,并将数据信息保存在文件中,对若干文件路径依次生成文件。Step S2, generate a file: periodically create a file in a target path corresponding to the file path, rename the file with a file rename name, access the database according to the file path, extract data information from the data fields in the data extraction rule, and save the data The information is saved in a file, and files are sequentially generated for several file paths.
在生成文件时,首先获取某一文件路径后,在此文件路径对应的数据提取规则中的目标路径中创建文件,对创建的文件以文件重命名名称进行重命名,生成了此文件路径对应的文件。按此文件路径访问数据库,获取此文件路径对应的数据提取规则中的需要提取的数据字段,提取出数据信息,将提取的数据信息存储在上述生成的文件,完成此文件路径的文件生成过程。由于文件查找目录表内含有若干文件路径,因此对每个文件路径均定时依次生成对应的文件,即在每一项文件路径对应的目标路径中均生成一项文件。When generating a file, first obtain a file path, create a file in the target path in the data extraction rule corresponding to this file path, rename the created file with the file rename name, and generate the corresponding file path file. Access the database according to this file path, obtain the data fields that need to be extracted in the data extraction rules corresponding to this file path, extract the data information, and store the extracted data information in the file generated above to complete the file generation process of this file path. Because the file search directory table contains several file paths, corresponding files are generated in sequence for each file path, that is, one file is generated in the target path corresponding to each file path.
本步骤中的定时是选定某一时间,比如每天的早上9:00开始依次生成文件,为了避免客户端处理数据时给客户端带来的系统压力,也可以将时间设定为如晚上9:00等非工作时间,自动生成若干文件。The timing in this step is to select a certain time, such as sequentially generating files from 9:00 in the morning. In order to avoid system pressure on the client when the client processes data, the time can also be set to 9 in the evening. 0:00 and other non-working hours, automatically generate several files.
步骤S3,发送文件:通过预设在客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在目标路径中的文件发送给远程服务器。Step S3: Send the file: The SFTP client software, which is a preset secure file transfer protocol on the client, is used to periodically establish a connection with the remote server, and send the file stored in the target path to the remote server.
SFTP是Secure File Transfer Protocol的缩写,即安全文件传送协议,可以为传输文件提供一种安全的网络的加密方法。SFTP为SSH的其中一部分,是一种传输文件至服务器的安全方式。通常在SSH软件包中,包含了SFTP的安全文件信息传输子系统,SFTP本身没有单独的守护进程,它使用SSHD进程来完成相应的连接和答复操作。SFTP是使用加密传输认证信息和传输的数据,因此本步骤使用SFTP非常安全。SFTP客户端软件与远程服务器建立连接时,有两种连接方式,一种采用SFTP客户端软件连接远程服务器IP的方式,另一种则先登录远程服务器,再开启SFTP功能。本步骤采用SFTP客户端软件连接远程服务器的方式,定时与远程服务器建立连接,将存储在目标路径中的文件发送给远程服务器。SFTP is the abbreviation of Secure File Transfer and Protocol, which is a secure file transfer protocol that can provide a secure network encryption method for transferring files. SFTP is part of SSH and is a secure way to transfer files to a server. Usually, the SSH software package contains the secure file information transmission subsystem of SFTP. SFTP itself does not have a separate daemon process. It uses the SSHD process to complete the corresponding connection and reply operations. SFTP uses encryption to transmit authentication information and data. Therefore, using SFTP in this step is very secure. When the SFTP client software establishes a connection with a remote server, there are two connection methods, one is to use the SFTP client software to connect to the remote server IP, and the other is to log in to the remote server first and then enable the SFTP function. This step uses the SFTP client software to connect to the remote server, periodically establishes a connection with the remote server, and sends the file stored in the target path to the remote server.
本实施例,通过文件路径及数据提取规则生成若干远程服务器需要的文件后,通过SFTP客户端软件定时与远程服务器建立连接,定时将生成的文件发送给远程服务器,保证了远程服务器定时收到的文件中的数据是所需数据,避免收到很多不需要的数据,也避免了客户端上传大量文件造成网络堵塞的问题。通过SFTP传输文件的方式,不仅可以实现自动上传文件的目的,还确保了上传的文件安全可靠。In this embodiment, after several files required by the remote server are generated through the file path and data extraction rules, the SFTP client software is used to periodically establish a connection with the remote server, and the generated files are sent to the remote server at regular intervals to ensure that the remote server receives the received packets at regular intervals. The data in the file is the required data, avoiding receiving many unnecessary data, and avoiding the problem of network congestion caused by the client uploading a large number of files. The method of transferring files through SFTP can not only achieve the purpose of automatically uploading files, but also ensure that the uploaded files are safe and reliable.
在一个实施例中,如图2所示,获取文件查找目录表前,包括:In an embodiment, as shown in FIG. 2, before obtaining the file search directory table, the method includes:
步骤S101,预设录入界面和文件查找目录表:在客户端预设录入界面和文件查找目录表,录入界面中设置文件路径查找按钮、文件路径字段、数据字段、文件重命名名称字段和目标路径字段。Step S101, preset input interface and file search directory table: preset input interface and file search directory table on the client, and set file path search button, file path field, data field, file rename name field and target path in the input interface Field.
步骤S102,存储字段信息:获取录入界面中输入的字段信息后,将字段信息存储在文件查找目录表中。Step S102, storing field information: after obtaining the field information input in the entry interface, storing the field information in a file search directory table.
由于客户端发送给远程服务器的文件会有增加数据的可能,本步骤通过录入界面实现增加文件目的,在录入界面填写文件路径、需要提取的数据字段、 文件重命名名称及目标路径等信息,增加获取的数据,生成新的文件发给远程服务器。录入界面还可以设置修改和删除相关功能,以便于对文件查找目录表中已保存的干文件路径及数据提取规则进行修改和删除,增加本步骤的灵活性。As the file sent by the client to the remote server may increase the data, this step is to increase the file through the input interface. Fill in the file path, the data fields to be extracted, the file renaming name, and the target path in the input interface. Get the data, generate a new file and send it to the remote server. The entry interface can also be set to modify and delete related functions, in order to modify and delete the saved dry file path and data extraction rules in the file search directory table, increasing the flexibility of this step.
在一个实施例中,如图3所示,步骤S2,包括:In one embodiment, as shown in FIG. 3, step S2 includes:
步骤S201,创建文件:调用预设的java定时任务,依次在文件路径对应的目标路径中创建文件,并以文件重命名名称加上当前时间戳,重命名文件。In step S201, a file is created: a preset java timed task is called, a file is sequentially created in a target path corresponding to the file path, and the file is renamed with the current timestamp and the file is renamed.
在对文件进行重命名时,文件重命名名称可以根据业务预设不同的名称,如文件路径指示的是基金排名文件,则在向基金排名文件中提取数据字段时,文件重命名名称可以定义为FundRank,则本步骤中重命名文件时的文件名称为FundRank20180719134209。如文件路径指示的是理财产品排名文件,则在向理财产品排名文件中提取数据字段时,文件重命名名称可以定义为FinPrdRank,则本步骤中重命名文件时的文件名称为FinPrdRank20180719134209。When renaming a file, the file renaming name can be preset with different names. For example, if the file path indicates a fund ranking file, when extracting data fields from the fund ranking file, the file renaming name can be defined as FundRank, the file name when renaming the file in this step is FundRank20180719134209. If the file path indicates a wealth management product ranking file, when extracting data fields from the wealth management product ranking file, the file renaming name can be defined as FinPrdRank, and the file name when renaming the file in this step is FinPrdRank20180719134209.
步骤S202,保存数据信息:按文件路径,从数据库中提取文件路径对应的数据字段,将数据字段设置为数据信息后,将数据信息存入文件中。Step S202: Save the data information: According to the file path, extract the data field corresponding to the file path from the database, set the data field to the data information, and then store the data information in the file.
如文件路径指示的是基金排名文件,则根据文件路径,从基金排名文件中提取数据字段,将数据字段对应的数据信息保存在步骤S201生成的文件中。If the file path indicates a fund ranking file, according to the file path, data fields are extracted from the fund ranking file, and the data information corresponding to the data field is stored in the file generated in step S201.
步骤S203,排序:将文件在目标路径中,将文件名称按照时间顺序进行降序排序。Step S203, sorting: place the files in the target path, and sort the file names in descending order in chronological order.
由于定时生成文件后,在某一目标路径中,会生成多个文件,比如文件路径指示的是基金排名文件,文件重命名名称可以定义为FundRank时,在7月18日生成了文件名称为FundRank20180718134128的文件,在7月19日生成了FundRank20180719134209的文件,本步骤对某一目标路径中的所有文件按时间顺序进行降序排序,保证排在首位的是最新生成的文件,在后续将文件发送给远程服务器时,获取首位的文件即可。After the file is generated regularly, multiple files will be generated in a certain target path. For example, the file path indicates the fund ranking file. When the file rename name can be defined as FundRank, the file name is generated on July 18 as FundRank20180718134128 The file, FundRank20180719134209 was generated on July 19. This step sorts all the files in a target path in chronological order in descending order to ensure that the first generated file is the most recently generated file, and the file is sent to the remote in the future. When the server, get the first file.
步骤S204,遍历文件路径:根据java定时任务,遍历若干文件路径,在文 件路径对应的目标路径中依次生成文件。Step S204, traverse the file path: according to the java timed task, traverse several file paths, and sequentially generate files in the target path corresponding to the file path.
由于文件查找目录表内含有若干文件路径,因此通过遍历的方式,能保证所有的文件路径对应生成一个最新的文件。Because the file search directory table contains several file paths, it is possible to ensure that all the file paths correspond to the latest file by traversing.
本实施例,通过调用java定时任务的方式定时生成若干文件,能实现客户端自动抓取数据,自动生成所需文件的目的。In this embodiment, a number of files are generated periodically by invoking a Java timed task, which can achieve the purpose of automatically capturing data by the client and automatically generating required files.
在一个实施例中,步骤S3,包括:调用预设在客户端的SFTP客户端软件,定时与远程服务器建立连接后,读取目标路径中的文件,通过SFTP客户端软件将文件发送给远程服务器。如图4所示,具体包括如下步骤:In one embodiment, step S3 includes: calling the SFTP client software preset on the client, periodically establishing a connection with the remote server, reading the file in the target path, and sending the file to the remote server through the SFTP client software. As shown in FIG. 4, it specifically includes the following steps:
步骤S301,自动设置参数:获取SFTP客户端软件的用户名和密码,调用SFTP客户端软件,自动设置文件发送端口号、远程服务器的IP地址。In step S301, the parameters are automatically set: obtaining the user name and password of the SFTP client software, calling the SFTP client software, and automatically setting the file sending port number and the IP address of the remote server.
SFTP客户端软件的用户名、密码文件发送端口号和远程服务器的IP地址可以预设在某表格或文件中,本步骤从预设的表格或文件中,获取这些信息,调用SFTP客户端软件,自动设置文件发送端口号、远程服务器的IP地址。SFTP客户端软件的文件发送端口号默认为22。The user name, password file sending port number, and remote server IP address of the SFTP client software can be preset in a form or file. This step obtains this information from the preset form or file and calls the SFTP client software. Automatically set file sending port number and IP address of remote server. The file sending port number of the SFTP client software is 22 by default.
步骤S302,建立连接:调用shell脚本,以用户名、密码、端口号和IP地址作为SFTP客户端软件的参数,通过SFTP客户端软件定时与远程服务器建立连接。In step S302, a connection is established: a shell script is invoked, and the user name, password, port number, and IP address are used as parameters of the SFTP client software, and the SFTP client software is used to periodically establish a connection with the remote server.
shell脚本既是一种命令语言,又是一种程序设计语言。shell脚本用各类命令预先放入到一个文件中,方便一次性执行的一个程序文件。shell脚本比Windows下的批处理更强大,比用其他编程程序编辑的程序效率更高。本步骤采用shell脚本进行SFTP客户端软件与远程服务器定时建立连接。Shell scripting is both a command language and a programming language. Shell scripts are put into a file with various commands in advance, which is a program file that is convenient for one-time execution. Shell scripts are more powerful than batch processing under Windows and more efficient than programs edited with other programming programs. This step uses a shell script to periodically establish a connection between the SFTP client software and a remote server.
步骤S303,发送文件:依次读取目标路径中最新生成的文件,发送给远程服务器。In step S303, the file is sent: the newly generated files in the target path are sequentially read and sent to the remote server.
本步骤将客户端中若干目标路径中的文件进行读取,且读取了最新生成的文件,将最新生成的文件发给远程服务器。本步骤也可以采用shell脚本实现 文件的自动上传。This step reads the files in several target paths in the client, reads the newly generated files, and sends the newly generated files to the remote server. In this step, you can also use a shell script to automatically upload files.
本申请的文件传输方法,通过文件查找目录表中的文件路径访问数据库中的数据信息,通过数据提取规则生成文件和重命名文件,并将数据信息存储在新生成的文件中。在访问所有的文件路径对应的数据信息并生成若干文件后,通过SFTP客户端软件定时与远程服务器建立连接,将最新生成的若干文件发送给远程服务器。本申请的方法无需人为查找上传给远程服务器的文件。由于文件中的数据信息是指定数据,因此避免了远程服务器接收很多不需要的数据问题。另外,采用SFTP客户端软件定时发送,可以避免多个客户端同时上传大量文件带来的网络堵塞问题。且采用SFTP客户端软件发送,可以确保文件的安全稳定发送。The file transmission method of the present application accesses data information in a database through a file path in a file search directory table, generates a file and renames a file through a data extraction rule, and stores the data information in a newly generated file. After accessing the data information corresponding to all file paths and generating several files, the SFTP client software periodically establishes a connection with the remote server and sends the newly generated files to the remote server. The method of the present application does not need to manually find a file uploaded to a remote server. Because the data information in the file is the designated data, it avoids the problem that the remote server receives many unnecessary data. In addition, the SFTP client software is used for regular sending to avoid network congestion caused by multiple clients uploading a large number of files at the same time. And use SFTP client software to send, can ensure the safe and stable sending of files.
在一个实施例中,提出了一种文件传输系统,如图5所示,包括如下单元:In one embodiment, a file transfer system is proposed, as shown in FIG. 5, and includes the following units:
获取单元,设置为获取文件查找目录表,文件查找目录表存储在客户端的数据库中,文件查找目录表中包括若干文件路径及数据提取规则,每项文件路径对应一项数据提取规则,数据提取规则包括需要提取的数据字段、文件重命名名称和目标路径;The obtaining unit is configured to obtain a file search directory table. The file search directory table is stored in the client's database. The file search directory table includes several file paths and data extraction rules. Each file path corresponds to a data extraction rule and a data extraction rule. Including the data fields to be extracted, the file renaming name, and the target path;
生成文件单元,设置为定时在文件路径对应的目标路径中创建文件,对文件以文件重命名名称进行重命名,按文件路径访问数据库,以数据提取规则中的数据字段提取数据信息,并将数据信息保存在文件中,对若干文件路径依次生成文件;Generate a file unit, set it to periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database by the file path, extract data information from the data fields in the data extraction rule, and save the data Information is stored in files, and files are generated for several file paths in sequence;
发送单元,设置为通过预设在客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在目标路径中的文件发送给远程服务器。The sending unit is configured to periodically establish a connection with the remote server through a preset secure file transfer protocol SFTP client software on the client, and send the file stored in the target path to the remote server.
在一个实施例中,还包括存储文件查找目录表单元,设置为在客户端预设录入界面和文件查找目录表,录入界面中设置文件路径查找按钮、文件路径字段、数据字段、文件重命名名称字段和目标路径字段,获取录入界面中输入的字段信息后,将字段信息存储在文件查找目录表中。In one embodiment, it further includes a storage file search directory table unit, which is configured to preset the input interface and the file search directory table on the client, and set a file path search button, a file path field, a data field, and a file rename name in the input interface. Field and target path field. After obtaining the field information entered in the entry interface, store the field information in the file search directory table.
在一个实施例中,如图6所示,生成文件单元,包括:In one embodiment, as shown in FIG. 6, generating a file unit includes:
创建文件模块,设置为调用预设的java定时任务,依次在文件路径对应的目标路径中创建文件,并以文件重命名名称加上当前时间戳,重命名文件;Create a file module, set to call a preset java timed task, create files in the target path corresponding to the file path in turn, and rename the file with the file rename name plus the current timestamp;
保存数据信息模块,设置为从数据库中提取文件路径对应的数据字段,将数据字段设置为数据信息后,将数据信息存入文件中;Save data information module, set to extract the data field corresponding to the file path from the database, set the data field to data information, and store the data information in the file;
排序模块,设置为将文件在目标路径中,将文件名称按照时间顺序进行降序排序;Sorting module, set to sort files in the target path, and sort file names in descending order according to chronological order;
遍历模块,设置为根据java定时任务,遍历若干文件路径,在文件路径对应的目标路径中依次生成文件。The traversal module is set to traverse several file paths according to the java timed task, and sequentially generate files in the target path corresponding to the file path.
在一个实施例中,发送单元,还设置为调用预设在客户端的SFTP客户端软件,定时与远程服务器建立连接后,读取目标路径中的文件,通过SFTP客户端软件将文件发送给远程服务器。In one embodiment, the sending unit is further configured to call the SFTP client software preset on the client, periodically establish a connection with the remote server, read the file in the target path, and send the file to the remote server through the SFTP client software .
在一个实施例中,发送单元,还设置为获取SFTP客户端软件的用户名和密码,调用SFTP客户端软件,自动设置文件发送端口号、远程服务器的IP地址,调用shell脚本,以用户名、密码、端口号和IP地址作为SFTP客户端软件的参数,通过SFTP客户端软件定时与远程服务器建立连接,依次读取目标路径中最新生成的文件,发送给远程服务器。In one embodiment, the sending unit is further configured to obtain the user name and password of the SFTP client software, invoke the SFTP client software, automatically set the file sending port number, the IP address of the remote server, and invoke a shell script with the user name and password. , Port number, and IP address are used as parameters of the SFTP client software. The SFTP client software is used to periodically establish a connection with the remote server. The newly generated files in the target path are sequentially read and sent to the remote server.
在一个实施例中,提出了一种计算机设备,包括存储器和处理器,存储器中存储有计算机可读指令,计算机可读指令被处理器执行时,使得处理器执行计算机可读指令时实现上述各实施例里文件传输方法中的步骤。In one embodiment, a computer device is provided, which includes a memory and a processor. The memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the processor is caused to implement the foregoing when the computer-readable instructions are executed. The steps in the file transfer method in the embodiment.
在一个实施例中,提出了一种存储有计算机可读指令的存储介质,计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器执行上述各实施例里文件传输方法中的步骤。其中,存储介质可以为非易失性存储介质。In one embodiment, a storage medium storing computer-readable instructions is provided. When the computer-readable instructions are executed by one or more processors, the one or more processors are caused to execute the file transfer method in the foregoing embodiments. Steps. The storage medium may be a non-volatile storage medium.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:只读存储器(ROM,Read Only Memory)、随 机存取存储器(RAM,Random Access Memory)、磁盘或光盘等。A person of ordinary skill in the art may understand that all or part of the steps in the various methods of the foregoing embodiments may be implemented by a program instructing related hardware. The program may be stored in a computer-readable storage medium. The storage medium may include: Read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks, etc.
以上所述实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the embodiments described above can be arbitrarily combined. In order to simplify the description, all possible combinations of the technical features in the above embodiments have not been described. However, as long as there is no contradiction in the combination of these technical features, It should be considered as the scope described in this specification.
以上所述实施例仅表达了本申请一些示例性实施例,其描述较为具体和详细,但并不能因此而理解为对本申请专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only express some exemplary embodiments of the present application, and their descriptions are more specific and detailed, but cannot be understood as a limitation on the scope of the patent of the present application. It should be noted that, for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can be made, which all belong to the protection scope of the present application. Therefore, the protection scope of this application patent shall be subject to the appended claims.

Claims (20)

  1. 一种文件传输方法,包括:A file transfer method includes:
    获取文件查找目录表,所述文件查找目录表存储在客户端的数据库中,所述文件查找目录表中包括若干文件路径及数据提取规则,每项所述文件路径对应一项所述数据提取规则,所述数据提取规则包括需要提取的数据字段、文件重命名名称和目标路径;Obtaining a file search directory table, where the file search directory table is stored in a client database, the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to one of the data extraction rules, The data extraction rule includes a data field to be extracted, a file renaming name, and a target path;
    定时在所述文件路径对应的所述目标路径中创建文件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件;Periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database according to the file path, and extract data from the data extraction rule Field to extract data information, and save the data information in the file, and sequentially generate the files for several of the file paths;
    通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器。By presetting a secure file transfer protocol SFTP client software on the client to periodically establish a connection with a remote server, the file stored in the target path is sent to the remote server.
  2. 根据权利要求1所述的文件传输方法,其中,所述获取文件查找目录表前,包括:The file transfer method according to claim 1, wherein before the obtaining a file to search a directory table, comprises:
    在所述客户端预设录入界面和文件查找目录表,所述录入界面中设置文件路径查找按钮、文件路径字段、数据字段、文件重命名名称字段和目标路径字段;Presetting an entry interface and a file search directory table in the client, and setting a file path search button, a file path field, a data field, a file rename name field, and a target path field in the input interface;
    获取所述录入界面中输入的字段信息后,将字段信息存储在所述文件查找目录表中。After obtaining the field information input in the entry interface, the field information is stored in the file search directory table.
  3. 根据权利要求1所述的文件传输方法,其中,所述定时在所述文件路径对应的所述目标路径中创建文件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件,包括:The file transfer method according to claim 1, wherein the timing creates a file in the target path corresponding to the file path, renames the file with the file rename name, and presses the file Accessing the database via a path, extracting data information from a data field in the data extraction rule, and storing the data information in the file, and sequentially generating the files for several of the file paths include:
    调用预设的java定时任务,依次在所述文件路径对应的所述目标路径中创建所述文件,并以所述文件重命名名称加上当前时间戳,重命名所述文件;Calling a preset java timed task, sequentially creating the file in the target path corresponding to the file path, and renaming the file with the file renaming name plus the current timestamp;
    按所述文件路径,从所述数据库中提取所述文件路径对应的数据字段,将所述数据字段设置为数据信息后,将所述数据信息存入所述文件中;Extracting a data field corresponding to the file path from the database according to the file path, setting the data field to data information, and storing the data information in the file;
    将所述文件在所述目标路径中,将文件名称按照时间顺序进行降序排序;Place the file in the target path, and sort the file names in descending order according to chronological order;
    根据所述java定时任务,遍历若干所述文件路径,在所述文件路径对应的所述目标路径中依次生成所述文件。According to the java timed task, traverse several of the file paths, and sequentially generate the files in the target path corresponding to the file path.
  4. 根据权利要求1所述的文件传输方法,其中,所述通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器,包括:The file transfer method according to claim 1, wherein the secure file transfer protocol SFTP client software preset on the client periodically establishes a connection with a remote server to store the file in the target path Sending to the remote server includes:
    调用预设在所述客户端的SFTP客户端软件,定时与所述远程服务器建立连接后,读取所述目标路径中的文件,通过所述SFTP客户端软件将所述文件发送给所述远程服务器。Calling the SFTP client software preset on the client, periodically establishing a connection with the remote server, reading a file in the target path, and sending the file to the remote server through the SFTP client software .
  5. 根据权利要求4所述的文件传输方法,其中,所述通过所述SFTP客户端软件将所述文件发送给所述远程服务器,包括:The file transfer method according to claim 4, wherein said sending said file to said remote server through said SFTP client software comprises:
    获取所述SFTP客户端软件的用户名和密码,调用所述SFTP客户端软件,自动设置文件发送端口号、远程服务器的IP地址;Obtaining the user name and password of the SFTP client software, calling the SFTP client software, and automatically setting the file sending port number and the IP address of the remote server;
    调用shell脚本,以所述用户名、密码、端口号和IP地址作为所述SFTP客户端软件的参数,通过所述SFTP客户端软件定时与所述远程服务器建立连接;Invoking a shell script, using the user name, password, port number, and IP address as parameters of the SFTP client software, and establishing a connection with the remote server through the SFTP client software periodically;
    依次读取所述目标路径中最新生成的所述文件,发送给所述远程服务器。The newly generated files in the target path are sequentially read and sent to the remote server.
  6. 一种文件传输系统,包括:A file transfer system includes:
    获取单元,设置为获取文件查找目录表,所述文件查找目录表存储在客户端的数据库中,所述文件查找目录表中包括若干文件路径及数据提取规则,每项所述文件路径对应一项所述数据提取规则,所述数据提取规则包括需要提取的数据字段、文件重命名名称和目标路径;The obtaining unit is configured to obtain a file search directory table, where the file search directory table is stored in a client database, and the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to an The data extraction rule, which includes a data field to be extracted, a file renaming name, and a target path;
    生成文件单元,设置为定时在所述文件路径对应的所述目标路径中创建文 件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件;A file generating unit is set to periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database according to the file path, and use the file path The data field in the data extraction rule extracts data information, saves the data information in the file, and sequentially generates the files for several of the file paths;
    发送单元,设置为通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器。The sending unit is configured to periodically establish a connection with a remote server through a preset secure file transfer protocol SFTP client software on the client, and send the file stored in the target path to the remote server.
  7. 根据权利要求6所述的文件传输系统,其中,还包括存储文件查找目录表单元,设置为在所述客户端预设录入界面和文件查找目录表,所述录入界面中设置文件路径查找按钮、文件路径字段、数据字段、文件重命名名称字段和目标路径字段,获取所述录入界面中输入的字段信息后,将字段信息存储在所述文件查找目录表中。The file transfer system according to claim 6, further comprising a file search directory table storage unit configured to preset the input interface and the file search directory table on the client, and set a file path search button in the input interface, The file path field, the data field, the file rename name field, and the target path field, after obtaining the field information entered in the entry interface, store the field information in the file lookup directory table.
  8. 根据权利要求6所述的文件传输系统,其中,所述生成文件单元,包括:The file transfer system according to claim 6, wherein the file generating unit comprises:
    创建文件模块,设置为调用预设的java定时任务,依次在所述文件路径对应的所述目标路径中创建所述文件,并以所述文件重命名名称加上当前时间戳,重命名所述文件;Create a file module, set to call a preset java timed task, sequentially create the file in the target path corresponding to the file path, and rename the file with the current timestamp and rename the file;
    保存数据信息模块,设置为从所述数据库中提取所述文件路径对应的数据字段,将所述数据字段设置为数据信息后,将所述数据信息存入所述文件中;The data information saving module is configured to extract a data field corresponding to the file path from the database, and after the data field is set to data information, the data information is stored in the file;
    排序模块,设置为将所述文件在所述目标路径中,将文件名称按照时间顺序进行降序排序;A sorting module, configured to sort the files in the target path, and sort the file names in descending order according to chronological order;
    遍历模块,设置为根据所述java定时任务,遍历若干所述文件路径,在所述文件路径对应的所述目标路径中依次生成所述文件。The traversal module is configured to traverse several of the file paths according to the java timed task, and sequentially generate the files in the target path corresponding to the file path.
  9. 根据权利要求6所述的文件传输系统,其中,所述发送单元,还设置为调用预设在所述客户端的SFTP客户端软件,定时与所述远程服务器建立连接后,读取所述目标路径中的文件,通过所述SFTP客户端软件将所述文件发送给所述远程服务器。The file transfer system according to claim 6, wherein the sending unit is further configured to call the SFTP client software preset on the client, and periodically establish a connection with the remote server to read the target path The file is sent to the remote server through the SFTP client software.
  10. 根据权利要求9所述的文件传输系统,其中,所述发送单元,还设置为获取所述SFTP客户端软件的用户名和密码,调用所述SFTP客户端软件,自动设置文件发送端口号、远程服务器的IP地址,调用shell脚本,以所述用户名、密码、端口号和IP地址作为所述SFTP客户端软件的参数,通过所述SFTP客户端软件定时与所述远程服务器建立连接,依次读取所述目标路径中最新生成的所述文件,发送给所述远程服务器。The file transfer system according to claim 9, wherein the sending unit is further configured to obtain a user name and password of the SFTP client software, invoke the SFTP client software, and automatically set a file sending port number and a remote server. Call the shell script with the user name, password, port number, and IP address as parameters of the SFTP client software, periodically establish a connection with the remote server through the SFTP client software, and sequentially read The latest generated file in the target path is sent to the remote server.
  11. 一种计算机设备,包括存储器和处理器,所述存储器中存储有计算机可读指令,所述计算机可读指令被所述处理器执行时,使得所述处理器执行以下步骤:A computer device includes a memory and a processor. The memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor causes the processor to perform the following steps:
    获取文件查找目录表,所述文件查找目录表存储在客户端的数据库中,所述文件查找目录表中包括若干文件路径及数据提取规则,每项所述文件路径对应一项所述数据提取规则,所述数据提取规则包括需要提取的数据字段、文件重命名名称和目标路径;Obtaining a file search directory table, where the file search directory table is stored in a client database, the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to one of the data extraction rules, The data extraction rule includes a data field to be extracted, a file renaming name, and a target path;
    定时在所述文件路径对应的所述目标路径中创建文件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件;Periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database according to the file path, and extract data from the data extraction rule Field to extract data information, and save the data information in the file, and sequentially generate the files for several of the file paths;
    通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器。By presetting a secure file transfer protocol SFTP client software on the client to periodically establish a connection with a remote server, the file stored in the target path is sent to the remote server.
  12. 根据权利要求11所述的计算机设备,其中,所述获取文件查找目录表前,使得所述处理器执行以下步骤:The computer device according to claim 11, wherein before the obtaining a file to search a directory table, the processor is caused to perform the following steps:
    在所述客户端预设录入界面和文件查找目录表,所述录入界面中设置文件路径查找按钮、文件路径字段、数据字段、文件重命名名称字段和目标路径字段;Presetting an entry interface and a file search directory table in the client, and setting a file path search button, a file path field, a data field, a file rename name field, and a target path field in the input interface;
    获取所述录入界面中输入的字段信息后,将字段信息存储在所述文件查找目录表中。After obtaining the field information input in the entry interface, the field information is stored in the file search directory table.
  13. 根据权利要求11所述的计算机设备,其中,所述定时在所述文件路径对应的所述目标路径中创建文件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件时,使得所述处理器执行以下步骤:The computer device according to claim 11, wherein the timing creates a file in the target path corresponding to the file path, renames the file with the file rename name, and presses the file path When accessing the database, extracting data information by using data fields in the data extraction rule, and storing the data information in the file, when sequentially generating the files for several of the file paths, the processor Perform the following steps:
    调用预设的java定时任务,依次在所述文件路径对应的所述目标路径中创建所述文件,并以所述文件重命名名称加上当前时间戳,重命名所述文件;Calling a preset java timed task, sequentially creating the file in the target path corresponding to the file path, and renaming the file with the file renaming name plus the current timestamp;
    按所述文件路径,从所述数据库中提取所述文件路径对应的数据字段,将所述数据字段设置为数据信息后,将所述数据信息存入所述文件中;Extracting a data field corresponding to the file path from the database according to the file path, setting the data field to data information, and storing the data information in the file;
    将所述文件在所述目标路径中,将文件名称按照时间顺序进行降序排序;Place the file in the target path, and sort the file names in descending order according to chronological order;
    根据所述java定时任务,遍历若干所述文件路径,在所述文件路径对应的所述目标路径中依次生成所述文件。According to the java timed task, traverse several of the file paths, and sequentially generate the files in the target path corresponding to the file path.
  14. 根据权利要求11所述的计算机设备,其中,所述通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器时,使得所述处理器执行以下步骤:The computer device according to claim 11, wherein the secure file transfer protocol SFTP client software preset on the client establishes a connection with a remote server at regular intervals, and sends the file stored in the target path When given to the remote server, the processor is caused to perform the following steps:
    调用预设在所述客户端的SFTP客户端软件,定时与所述远程服务器建立连接后,读取所述目标路径中的文件,通过所述SFTP客户端软件将所述文件发送给所述远程服务器。Calling the SFTP client software preset on the client, periodically establishing a connection with the remote server, reading a file in the target path, and sending the file to the remote server through the SFTP client software .
  15. 根据权利要求14所述的计算机设备,其中,所述通过所述SFTP客户端软件将所述文件发送给所述远程服务器时,使得所述处理器执行以下步骤:The computer device according to claim 14, wherein when said sending said file to said remote server through said SFTP client software, causes said processor to perform the following steps:
    获取所述SFTP客户端软件的用户名和密码,调用所述SFTP客户端软件,自动设置文件发送端口号、远程服务器的IP地址;Obtaining the user name and password of the SFTP client software, calling the SFTP client software, and automatically setting the file sending port number and the IP address of the remote server;
    调用shell脚本,以所述用户名、密码、端口号和IP地址作为所述SFTP客户端软件的参数,通过所述SFTP客户端软件定时与所述远程服务器建立连接;Invoking a shell script, using the user name, password, port number, and IP address as parameters of the SFTP client software, and establishing a connection with the remote server through the SFTP client software periodically;
    依次读取所述目标路径中最新生成的所述文件,发送给所述远程服务器。The newly generated files in the target path are sequentially read and sent to the remote server.
  16. 一种存储有计算机可读指令的存储介质,所述计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器执行以下步骤:A storage medium storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the following steps:
    获取文件查找目录表,所述文件查找目录表存储在客户端的数据库中,所述文件查找目录表中包括若干文件路径及数据提取规则,每项所述文件路径对应一项所述数据提取规则,所述数据提取规则包括需要提取的数据字段、文件重命名名称和目标路径;Obtaining a file search directory table, where the file search directory table is stored in a client database, the file search directory table includes a plurality of file paths and data extraction rules, and each of the file paths corresponds to one of the data extraction rules, The data extraction rule includes a data field to be extracted, a file renaming name, and a target path;
    定时在所述文件路径对应的所述目标路径中创建文件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件;Periodically create a file in the target path corresponding to the file path, rename the file with the file rename name, access the database according to the file path, and extract data from the data extraction rule Field to extract data information, and save the data information in the file, and sequentially generate the files for several of the file paths;
    通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器。By presetting a secure file transfer protocol SFTP client software on the client to periodically establish a connection with a remote server, the file stored in the target path is sent to the remote server.
  17. 根据权利要求16所述的存储介质,其中,所述获取文件查找目录表前,使得一个或多个所述处理器执行以下步骤:The storage medium according to claim 16, wherein before the obtaining a file to search a directory table, one or more of the processors are caused to perform the following steps:
    在所述客户端预设录入界面和文件查找目录表,所述录入界面中设置文件路径查找按钮、文件路径字段、数据字段、文件重命名名称字段和目标路径字段;Presetting an entry interface and a file search directory table in the client, and setting a file path search button, a file path field, a data field, a file rename name field, and a target path field in the input interface;
    获取所述录入界面中输入的字段信息后,将字段信息存储在所述文件查找目录表中。After obtaining the field information input in the entry interface, the field information is stored in the file search directory table.
  18. 根据权利要求16所述的存储介质,其中,所述定时在所述文件路径对应的所述目标路径中创建文件,对所述文件以所述文件重命名名称进行重命名,按所述文件路径访问所述数据库,以所述数据提取规则中的数据字段提取数据信息,并将所述数据信息保存在所述文件中,对若干所述文件路径依次生成所述文件时,使得一个或多个所述处理器执行以下步骤:The storage medium according to claim 16, wherein the timing creates a file in the target path corresponding to the file path, renames the file with the file rename name, and presses the file path When accessing the database, extracting data information by using data fields in the data extraction rule, and storing the data information in the file, when sequentially generating the files for several of the file paths, one or more The processor performs the following steps:
    调用预设的java定时任务,依次在所述文件路径对应的所述目标路径中创建所述文件,并以所述文件重命名名称加上当前时间戳,重命名所述文件;Calling a preset java timed task, sequentially creating the file in the target path corresponding to the file path, and renaming the file with the file renaming name plus the current timestamp;
    按所述文件路径,从所述数据库中提取所述文件路径对应的数据字段,将所述数据字段设置为数据信息后,将所述数据信息存入所述文件中;Extracting a data field corresponding to the file path from the database according to the file path, setting the data field to data information, and storing the data information in the file;
    将所述文件在所述目标路径中,将文件名称按照时间顺序进行降序排序;Place the file in the target path, and sort the file names in descending order according to chronological order;
    根据所述java定时任务,遍历若干所述文件路径,在所述文件路径对应的所述目标路径中依次生成所述文件。According to the java timed task, traverse several of the file paths, and sequentially generate the files in the target path corresponding to the file path.
  19. 根据权利要求16所述的存储介质,其中,所述通过预设在所述客户端的安全文件传送协议SFTP客户端软件定时与远程服务器建立连接,将存储在所述目标路径中的所述文件发送给所述远程服务器时,使得一个或多个所述处理器执行以下步骤:The storage medium according to claim 16, wherein the preset secure file transfer protocol SFTP client software on the client establishes a connection with a remote server at regular intervals, and sends the file stored in the target path When given to the remote server, one or more of the processors are caused to perform the following steps:
    调用预设在所述客户端的SFTP客户端软件,定时与所述远程服务器建立连接后,读取所述目标路径中的文件,通过所述SFTP客户端软件将所述文件发送给所述远程服务器。Calling the SFTP client software preset on the client, periodically establishing a connection with the remote server, reading a file in the target path, and sending the file to the remote server through the SFTP client software .
  20. 根据权利要求16所述的存储介质,其中,所述通过所述SFTP客户端软件将所述文件发送给所述远程服务器时,使得一个或多个所述处理器执行以下步骤:The storage medium according to claim 16, wherein when the file is sent to the remote server through the SFTP client software, one or more of the processors are caused to perform the following steps:
    获取所述SFTP客户端软件的用户名和密码,调用所述SFTP客户端软件,自动设置文件发送端口号、远程服务器的IP地址;Obtaining the user name and password of the SFTP client software, calling the SFTP client software, and automatically setting the file sending port number and the IP address of the remote server;
    调用shell脚本,以所述用户名、密码、端口号和IP地址作为所述SFTP客户端软件的参数,通过所述SFTP客户端软件定时与所述远程服务器建立连接;Invoking a shell script, using the user name, password, port number, and IP address as parameters of the SFTP client software, and establishing a connection with the remote server through the SFTP client software periodically;
    依次读取所述目标路径中最新生成的所述文件,发送给所述远程服务器。The newly generated files in the target path are sequentially read and sent to the remote server.
PCT/CN2018/106693 2018-08-07 2018-09-20 File transmission method, system, computer device and storage medium WO2020029388A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810891980.7A CN109040252B (en) 2018-08-07 2018-08-07 File transmission method, system, computer device and storage medium
CN201810891980.7 2018-08-07

Publications (1)

Publication Number Publication Date
WO2020029388A1 true WO2020029388A1 (en) 2020-02-13

Family

ID=64649305

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/106693 WO2020029388A1 (en) 2018-08-07 2018-09-20 File transmission method, system, computer device and storage medium

Country Status (2)

Country Link
CN (1) CN109040252B (en)
WO (1) WO2020029388A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112468531A (en) * 2020-09-07 2021-03-09 厦门天锐科技股份有限公司 File transmission control method and device
CN113377720A (en) * 2021-06-23 2021-09-10 上海商汤科技开发有限公司 Data processing method and device, electronic equipment and storage medium
CN113590536A (en) * 2021-05-20 2021-11-02 济南浪潮数据技术有限公司 Data storage method, system, electronic equipment and storage medium
CN113835613A (en) * 2020-06-24 2021-12-24 浙江宇视科技有限公司 File reading method and device, electronic equipment and storage medium
CN114443651A (en) * 2021-12-31 2022-05-06 北京发现角科技有限公司 Method and device for processing buried point data to ODS layer
CN114826909A (en) * 2022-05-27 2022-07-29 苏州浪潮智能科技有限公司 Server production instruction information maintenance system, method, device and storage medium

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110417860A (en) * 2019-06-21 2019-11-05 深圳壹账通智能科技有限公司 File transfer management method, apparatus, equipment and storage medium
CN110557507B (en) * 2019-09-05 2021-06-11 曙光信息产业(北京)有限公司 File transmission method and device, electronic equipment and computer readable storage medium
US11822522B2 (en) * 2020-01-31 2023-11-21 EMC IP Holding Company LLC Intelligent filesystem for container images
CN111352904B (en) * 2020-03-04 2023-05-05 海南金盘智能科技股份有限公司 Method and device for replacing model file
CN111538666B (en) * 2020-04-27 2024-04-02 深圳忆联信息系统有限公司 Method, device, computer equipment and storage medium for collecting test results in batches
CN111586187A (en) * 2020-05-12 2020-08-25 甬矽电子(宁波)股份有限公司 Data transmission method, device, application server and data transmission system
CN111756818B (en) * 2020-06-05 2022-01-14 腾讯科技(深圳)有限公司 File transfer method, device, equipment and storage medium
CN114338655A (en) * 2022-03-10 2022-04-12 北京宇信科技集团股份有限公司 Remote server file transmission engine, transmission method and device
CN115277206B (en) * 2022-07-28 2023-09-05 通号智慧城市研究设计院有限公司 Data processing method and server

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105262845A (en) * 2015-11-27 2016-01-20 中国建设银行股份有限公司 File transmission processing method and system
CN105357584A (en) * 2015-12-11 2016-02-24 Tcl集团股份有限公司 User behavior log classification uploading method and system based on intelligent television
US20170366580A1 (en) * 2011-12-21 2017-12-21 Ssh Communications Security Oyj Extracting information in a computer system
CN107660283A (en) * 2015-04-03 2018-02-02 甲骨文国际公司 For realizing the method and system of daily record resolver in Log Analysis System
CN108235069A (en) * 2016-12-22 2018-06-29 北京国双科技有限公司 The processing method and processing device of Web TV daily record

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8126851B2 (en) * 2006-10-31 2012-02-28 Rebit, Inc. System for automatically recovering a computer memory using shadowed data and file directory structures
CN103823797A (en) * 2012-11-16 2014-05-28 镇江诺尼基智能技术有限公司 FTP (file transfer protocol) based real-time industry database data synchronization system
CN105808284B (en) * 2014-12-31 2019-10-22 广州市动景计算机科技有限公司 A kind of method for updating increment and the server using it
CN106470231A (en) * 2015-08-19 2017-03-01 互联网域名系统北京市工程研究中心有限公司 SFTP service system and its application process
CN105389463B (en) * 2015-10-26 2017-11-28 武汉帕菲利尔信息科技有限公司 The synchronous method and front server of medical RIS system diagnostics report
CN106941476B (en) * 2016-01-05 2019-10-22 中国科学院声学研究所 A kind of method and system SFTP data acquisition and audited
CN107612730A (en) * 2017-09-18 2018-01-19 山东浪潮云服务信息科技有限公司 A kind of log collection analysis method, device and system
CN108055315A (en) * 2017-12-08 2018-05-18 郑州云海信息技术有限公司 The method and system of knowledge base synchronization between a kind of cascade management platform
CN108255993A (en) * 2017-12-29 2018-07-06 北京三快在线科技有限公司 Extract method, apparatus, electronic equipment and the storage medium of service fields

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170366580A1 (en) * 2011-12-21 2017-12-21 Ssh Communications Security Oyj Extracting information in a computer system
CN107660283A (en) * 2015-04-03 2018-02-02 甲骨文国际公司 For realizing the method and system of daily record resolver in Log Analysis System
CN105262845A (en) * 2015-11-27 2016-01-20 中国建设银行股份有限公司 File transmission processing method and system
CN105357584A (en) * 2015-12-11 2016-02-24 Tcl集团股份有限公司 User behavior log classification uploading method and system based on intelligent television
CN108235069A (en) * 2016-12-22 2018-06-29 北京国双科技有限公司 The processing method and processing device of Web TV daily record

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113835613A (en) * 2020-06-24 2021-12-24 浙江宇视科技有限公司 File reading method and device, electronic equipment and storage medium
CN113835613B (en) * 2020-06-24 2024-03-29 浙江宇视科技有限公司 File reading method and device, electronic equipment and storage medium
CN112468531A (en) * 2020-09-07 2021-03-09 厦门天锐科技股份有限公司 File transmission control method and device
CN112468531B (en) * 2020-09-07 2024-02-09 厦门天锐科技股份有限公司 File transmission control method and device
CN113590536A (en) * 2021-05-20 2021-11-02 济南浪潮数据技术有限公司 Data storage method, system, electronic equipment and storage medium
CN113590536B (en) * 2021-05-20 2023-12-29 济南浪潮数据技术有限公司 Data storage method, system, electronic equipment and storage medium
CN113377720A (en) * 2021-06-23 2021-09-10 上海商汤科技开发有限公司 Data processing method and device, electronic equipment and storage medium
CN114443651A (en) * 2021-12-31 2022-05-06 北京发现角科技有限公司 Method and device for processing buried point data to ODS layer
CN114826909A (en) * 2022-05-27 2022-07-29 苏州浪潮智能科技有限公司 Server production instruction information maintenance system, method, device and storage medium
CN114826909B (en) * 2022-05-27 2023-08-08 苏州浪潮智能科技有限公司 Server production instruction information maintenance system, method, device and storage medium

Also Published As

Publication number Publication date
CN109040252A (en) 2018-12-18
CN109040252B (en) 2022-04-12

Similar Documents

Publication Publication Date Title
WO2020029388A1 (en) File transmission method, system, computer device and storage medium
AU2017218936B2 (en) Multi-cloud network proxy for control and normalization of tagging data
US11206451B2 (en) Information interception processing method, terminal, and computer storage medium
US9311326B2 (en) Virtual file system for automated data replication and review
WO2019184164A1 (en) Method for automatically deploying kubernetes worker node, device, terminal apparatus, and readable storage medium
WO2021012568A1 (en) Data processing method and related device
US11025724B2 (en) Transport of control data in proxy-based network communications
WO2020223268A1 (en) A declarative and reactive data layer for component-based user interfaces
CN103780700A (en) Application system and method for achieving compatibility and sharing among multi-source heterogeneous systems
CN109600385B (en) Access control method and device
JP2016533594A (en) WEB PAGE ACCESS METHOD, WEB PAGE ACCESS DEVICE, ROUTER, PROGRAM, AND RECORDING MEDIUM
US7831959B1 (en) Method and apparatus to manage configuration for multiple file server appliances
CN111258627B (en) Interface document generation method and device
US11494503B2 (en) Hybrid approach to data governance
WO2019228034A1 (en) Method and apparatus for data synchronization
US11799798B1 (en) Generating infrastructure templates for facilitating the transmission of user data into a data intake and query system
US10140121B2 (en) Sending a command with client information to allow any remote server to communicate directly with client
CN102932391A (en) Method and device for processing data in peer to server/peer (P2SP) system, and P2SP system
US20120266186A1 (en) Providing inter-platform application launch in context
CN110460668B (en) File uploading method and device, computer equipment and storage medium
US20190370034A1 (en) Remote application access in a virtual desktop infrastructure environment
WO2017114365A1 (en) Mail attachment filing method and cloud storage server
US11431795B2 (en) Method, apparatus and storage medium for resource configuration
US20200177544A1 (en) Secure internet gateway
US9141287B2 (en) Remote enabling of storage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18929345

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18929345

Country of ref document: EP

Kind code of ref document: A1