CN109992596A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN109992596A CN109992596A CN201910138646.9A CN201910138646A CN109992596A CN 109992596 A CN109992596 A CN 109992596A CN 201910138646 A CN201910138646 A CN 201910138646A CN 109992596 A CN109992596 A CN 109992596A
- Authority
- CN
- China
- Prior art keywords
- target
- data
- database
- target database
- query
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention proposes a kind of data processing method and device, since big data platform is additionally arranged HTTP interface, external operation system can carry out data interaction by the HTTP interface and big data platform, realize the storing data for obtaining and being stored in the databases such as MySQL, Kudu, MongoDB, OpenTSDB, Druid, HBase of big data platform to carry out corresponding business processing.It is easy to learn, understandable easy-to-use due to HTTP interface, for the front end developer of the operation system outside exploitation, it can quickly and easily realize that the front end of external operation system has the function of calling the data in big data platform, the working principle of big data platform is grasped without front end developer, and exploitation drives or writes corresponding reading code accordingly to call each database in big data platform, the consuming of human and material resources is significantly reduced, the development efficiency of external operation system is improved.
Description
Technical field
The present invention relates to big data technical field more particularly to a kind of data processing method and devices.
Background technique
With the development of big data technology, more and more Internet companies are dedicated to developing big data platform, big data
Platform can help enterprise-class tools quickly in business scenario using big data, power-assisted business development and industrial upgrading.
Big data platform provides diversified database to store the data of different characteristics.For example, single table data volume
It can store in MySQL in 1,000,000 management datas below, MySQL is Relational DBMS；Single table data
The management data measured at 1,000,000 or more can store in Kudu, and Kudu is the novel column storage system of Cloudera open source
System；Picture, document class data etc. can store in MongoDB, and MongoDB is the data based on distributed document storage
Library, equipment upload real-time Internet of Things data can store in OpenTSDB, OpenTSDB be based on Hbase it is distributed,
Telescopic time series databases；The data being polymerize to real-time Internet of Things data can store in Druid, and Druid is
Distributed system that one height for big data real-time query and analysis is fault-tolerant, high-performance is increased income；Data that crawler crawls, half hitch
Structure data or unstructured data etc. can store in HBase, and HBase is a distributed open source number towards column
According to library.
Currently, its corresponding driving and read-write code are different due to different databases, front end developer want from
It reads data in the databases such as MySQL, Kudu, MongoDB, OpenTSDB, Druid, HBase to be developed again, before needing
End developer, which grasps enough big data technologies and has exploitation, drives or writes accordingly the corresponding ability for reading code,
A large amount of man power and material is expended, front end development efficiency is influenced, therefore, how to promote front end development efficiency becomes urgently to be resolved
Technical problem.
Summary of the invention
The present invention is directed to solve at least some of the technical problems in related technologies.
For this purpose, the first purpose of this invention is to propose a kind of data processing method.
Second object of the present invention is to propose a kind of data processing equipment.
Third object of the present invention is to propose a kind of computer equipment.
Fourth object of the present invention is to propose a kind of computer readable storage medium.
In order to achieve the above object, first aspect present invention embodiment proposes a kind of data processing method, comprising:
HTTP request and the parsing that query traffic data is received by HTTP interface, obtain identification information and target data lattice
The query condition information of formula；
Target database is determined according to the identification information；
The query condition information of the target data format is converted into the corresponding target query item of the target database
Part；
It is obtained and the matched query result of target query condition in the target database；
The query result is converted into the business datum of the target data format.
Further, the HTTP request further includes user right data,
It is described determine according to the identification information target database after, further includes:
Whether there is the permission for inquiring the target database according to the user right data verification user；
When determining that user has the permission for inquiring the target database, the looking into the target data format is executed
Ask the step of conditional information is converted into the target database corresponding target query condition.
It is further, described that target database is determined according to the identification information, comprising:
Determine the corresponding target data source of the identification information；
Database corresponding with the target data source is determined as target database.
Further, the target data format is JSON format.
Data processing method provided in an embodiment of the present invention, by receiving HTTP request and the parsing of query traffic data,
Obtain the query condition information of identification information and target data format；Target database is determined according to the identification information；By institute
The query condition information for stating target data format is converted into the corresponding target query condition of the target database；In the target
It is obtained and the matched query result of target query condition in database；The query result is converted into the target data
The business datum of format.Since big data platform is additionally arranged HTTP interface, external operation system can pass through the HTTP
Interface and big data platform carry out data interaction, realize obtain the MySQL, Kudu for being stored in big data platform, MongoDB,
Storing data in the databases such as OpenTSDB, Druid, HBase is to carry out corresponding business processing.Due to the letter of HTTP interface
It is single easy to learn, understandable easy-to-use, for the front end developer of the operation system outside exploitation, it can quickly and easily realize outside
The front end of operation system have the function of calling the data in big data platform, it is flat to grasp big data without front end developer
The working principle of platform, and exploitation drive or write corresponding reading code accordingly to call each number in big data platform
According to library, the consuming of human and material resources is significantly reduced, improves the development efficiency of external operation system.
In order to achieve the above object, second aspect of the present invention embodiment proposes a kind of data processing equipment, comprising:
Module is obtained, for receiving HTTP request and the parsing of query traffic data by HTTP interface, obtains mark letter
The query condition information of breath and target data format；
Processing module, for determining target database according to the identification information；
Processing module is also used to the query condition information of the target data format being converted into the target database pair
The target query condition answered；
Processing module is also used to obtain in the target database and tie with the matched inquiry of the target query condition
Fruit；
The processing module is also used to for the query result being converted into the business datum of target data format.
Further, the HTTP request further includes user right data, and the processing module is also used in the basis
After the identification information determines target database, whether the inquiry target is had according to the user right data verification user
The permission of database；
When determining that user has the permission for inquiring the target database, the looking into the target data format is executed
Ask the step of conditional information is converted into the target database corresponding target query condition.
Further, the processing module is specifically used for: determining the corresponding target data source of the identification information；Will with institute
It states the corresponding database of target data source and is determined as target database.
Further, the target data format is JSON format.
Data processing equipment provided in an embodiment of the present invention, by receiving HTTP request and the parsing of query traffic data,
Obtain the query condition information of identification information and target data format；Target database is determined according to the identification information；By institute
The query condition information for stating target data format is converted into the corresponding target query condition of the target database；In the target
It is obtained and the matched query result of target query condition in database；The query result is converted into the target data
The business datum of format.Since big data platform is additionally arranged HTTP interface, external operation system can pass through the HTTP
Interface and big data platform carry out data interaction, realize obtain the MySQL, Kudu for being stored in big data platform, MongoDB,
Storing data in the databases such as OpenTSDB, Druid, HBase is to carry out corresponding business processing.Due to the letter of HTTP interface
It is single easy to learn, understandable easy-to-use, for the front end developer of the operation system outside exploitation, it can quickly and easily realize outside
The front end of operation system have the function of calling the data in big data platform, it is flat to grasp big data without front end developer
The working principle of platform, and exploitation drive or write corresponding reading code accordingly to call each number in big data platform
According to library, the consuming of human and material resources is significantly reduced, improves the development efficiency of external operation system.
In order to achieve the above object, third aspect present invention embodiment proposes computer equipment, including memory, processor and
The computer program that can be run on a memory and on a processor is stored, the processor is realized as above when executing described program
The data processing method.
To achieve the goals above, fourth aspect present invention embodiment proposes a kind of computer readable storage medium, when
When instruction in the storage medium is executed by processor, data processing method as described above is realized.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partially become from the following description
Obviously, or practice through the invention is recognized.
Detailed description of the invention
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, in which:
Fig. 1 is a kind of flow diagram of data processing method provided in an embodiment of the present invention；
Fig. 2 is the flow diagram of another data processing method provided in an embodiment of the present invention；
Fig. 3 is a kind of structural schematic diagram of data processing equipment provided in an embodiment of the present invention；
Fig. 4 is a kind of structural schematic diagram of computer equipment provided in an embodiment of the present invention.
Specific embodiment
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to is used to explain the present invention, and is not considered as limiting the invention.
Below with reference to the accompanying drawings the data processing method and device of the embodiment of the present invention are described.
Fig. 1 is a kind of flow diagram of data processing method provided in an embodiment of the present invention.Present embodiments provide one
Kind data processing method, executing subject are data processing equipment, which is made of hardware and/or software.
As shown in Figure 1, the data processing method, comprising the following steps:
S101, HTTP request and the parsing that query traffic data is received by HTTP interface, obtain identification information and target
The query condition information of data format.
In the present embodiment, business datum is had stored in advance in the database of big data platform.For example, performance analysis class
Business datum be stored in MySQL, the business datum of magnanimity performance analysis class is stored in Kudu, the business of picture video class
Data are stored in MongoDB, and the business datum of Internet of Things timing class is stored in OpenTSDB, the business datum of Internet of Things polymeric type
It is stored in Druid, the business datums such as data, semi-structured data or unstructured data that crawler crawls are stored in HBase.
In the present embodiment, big data platform receives inquiry business transmitted by external operation system by HTTP interface
The HTTP request of data, wherein external operation system can be understood as the front end system of big data platform, the business of the outside
System needs to be stored in the business datum in big data platform and carries out corresponding business processing.
Specifically, external operation system sends the HTTP request of query traffic data to big data platform, and big data is flat
Platform receives and parses through the HTTP request, obtains the identification information and target data format of business datum entrained in HTTP request
Query condition information etc..Wherein, the identification information of business datum can be understood as the title of business datum, for example, mark letter
Breath is financial data.Target data format can be JSON format, but be not limited thereto.The querying condition of target data format
Information is, for example, " filter ": " fields ": [" field ": " date ", " type ": " in ", " values ": ["
2018.08.29 "] }], which is interpreted as filtering out the date as the related data on the 29th of August in 2018.
In the present embodiment, since big data platform is additionally arranged HTTP interface, external operation system can pass through the HTTP
Interface and big data platform carry out data interaction, realize obtain the MySQL, Kudu for being stored in big data platform, MongoDB,
Storing data in the databases such as OpenTSDB, Druid, HBase is to carry out corresponding business processing.
And in the prior art, front end developer will realize that external operation system has and call big data platform
The function of data in the databases such as MySQL, Kudu, MongoDB, OpenTSDB, Druid, HBase, it is to be understood that big data
The working principle of platform, and develop and drive or write corresponding reading code accordingly, development efficiency is low.For example, to realize
The operation system for the outside developed locally calls the function of the data in MySQL, needs new construction, installation MySQL driving
It wraps, writes jdbc connection, writes sql script, establish connection and inquired, return to inquiry data.Obviously, it needs to develop outside
Operation system front end developer grasp SQL query voice and the working principle of big data platform etc., study how to develop
To write SQL script, development efficiency is low for MySQL driving, study SQL query language.
It is easy to learn, understandable easy-to-use due to HTTP interface in the present embodiment, to the front end of the operation system outside exploitation
For developer, it can quickly and easily realize that the front end of external operation system has the data called in big data platform
Function, the working principle of big data platform is grasped without front end developer, and exploitation drives or write correspondence accordingly
Reading code call each database in big data platform, significantly reduce the consuming of human and material resources, improve outer
The development efficiency of the operation system in portion.
In the present embodiment, big data platform is after receiving the HTTP request of query traffic data, to the HTTP request
It is parsed, then, the mesh of storage service data is determined according to the identification information of business datum entrained in HTTP request
Mark database；By the data that different target database needs that it is called to be stored in different ways, in inquiry target
Before database, the query condition information of target data format entrained in HTTP request is adaptively converted, is turned
Change the corresponding target query condition of target database into；Then, target data library inquiry with target query condition is matched looks into
Ask result；Before returning to query result to external operation system, query result is first converted into the industry of target data format
Business data, then pass through the business datum that HTTP interface returns to target data format to external operation system.
S102, target database is determined according to the identification information.
In the present embodiment, the target of storage service data can be determined according to the identification information of business datum to be checked
Database.Specifically, it is determined that the corresponding target data source of the identification information；It will database corresponding with the target data source
It is determined as target database.For example, the identification information of business datum is financial data, which is stored in financial resources library
In, financial resources library is stored in MySQL.Wherein, financial resources library is the target data source of financial data, is wealth in MySQL
Business resources bank.
It should be pointed out that the identification information of business datum and the corresponding relationship of data source are established in advance, for example, financial
The corresponding data source of data is financial resources library, and the corresponding data source of manpower data is manpower resources bank, and image data is corresponding
Data source is picture video library.
It should be pointed out that the corresponding relationship of data source and database is established in advance, for example, financial resources library, manpower
Resources bank is stored in MySQL, and it is medium that picture video library is stored in MongoDB.After target data source has been determined, based on number
Target database corresponding with target data source can be determined according to the corresponding relationship of source and database.
S103, it the query condition information of the target data format is converted into the corresponding target of the target database looks into
Inquiry condition.
S104, it is obtained and the matched query result of target query condition in the target database.
In the present embodiment, data that different target database needs that it is called to be stored in different ways.For example,
The data in MySQL are called, need the query condition information by target data format to be converted into SQL (structuralized query language
Speech, Structured Query Language) sentence expression target query condition；Call the data in Kudu, need by
The query condition information of target data format be converted into developed based on Impala SQL (structured query language,
Structured Query Language) sentence expression target query condition；Call the number in OpenTSDB or Druid
According to, since OpenTSDB and Druid can receive HTTP request and return to corresponding http response, directly in OpenTSDB or
The corresponding query result of query condition information of Druid inquiry target data format；The data in HBase are called, due to
HBase receives access request and returning response data by Java API, can be by the query condition information of target data format
It is converted into the target query condition of Java code form, inquires the target query condition of Java code form in HBase to obtain
Corresponding query result.It should be pointed out that on how to from MySQL, Kudu, MongoDB, OpenTSDB, Druid, HBase
More introductions of data are called to be detailed in the relevant technologies in equal databases.
S105, the business datum that the query result is converted into the target data format.
In the present embodiment, before returning to query result to external operation system, query result is first converted into target
The business datum of data format, then pass through the business datum that HTTP interface returns to target data format to external operation system.
Since the query result of each database of big data platform has all been unified into the business datum of target data format, can facilitate
The subsequent applications of external operation system.
Data processing method provided in an embodiment of the present invention, by receiving HTTP request and the parsing of query traffic data,
Obtain the query condition information of identification information and target data format；Target database is determined according to the identification information；By institute
The query condition information for stating target data format is converted into the corresponding target query condition of the target database；In the target
It is obtained and the matched query result of target query condition in database；The query result is converted into the target data
The business datum of format.Since big data platform is additionally arranged HTTP interface, external operation system can pass through the HTTP
Interface and big data platform carry out data interaction, realize obtain the MySQL, Kudu for being stored in big data platform, MongoDB,
Storing data in the databases such as OpenTSDB, Druid, HBase is to carry out corresponding business processing.Due to the letter of HTTP interface
It is single easy to learn, understandable easy-to-use, for the front end developer of the operation system outside exploitation, it can quickly and easily realize outside
The front end of operation system have the function of calling the data in big data platform, it is flat to grasp big data without front end developer
The working principle of platform, and exploitation drive or write corresponding reading code accordingly to call each number in big data platform
According to library, the consuming of human and material resources is significantly reduced, improves the development efficiency of external operation system.
Further, in conjunction with reference Fig. 2, on the basis of embodiment shown in Fig. 1, the HTTP request further includes user
Permissions data, the method are after step s 102, further comprising the steps of before step S103:
S106, whether the permission for inquiring the target database is had according to the user right data verification user, true
When determining user has the permission for inquiring the target database, step S103 is executed.
In the present embodiment, the user of unauthorized calls the data in the database of big data platform in order to prevent, and verifying is used
Whether family has the permission of inquiry target database, if not having, to terminate if so, thening follow the steps S103, refusal inquiry number of targets
According to library.
Data processing method provided in an embodiment of the present invention, it is easy to learn, understandable easy-to-use due to HTTP interface, to exploitation
For the front end developer of external operation system, it can quickly and easily realize that the front end of external operation system has tune
With the function of the data in big data platform, the working principle of big data platform, and exploitation are grasped without front end developer
Corresponding reading code is driven or write to call each database in big data platform accordingly, significantly reduce people
The consuming of power, material resources improves the development efficiency of external operation system.Further, it before inquiring target database, tests
Whether card user has the permission of inquiry target database, to prevent the user of unauthorized from calling in the database of big data platform
Data improve the safety of data.
Fig. 3 is a kind of structural schematic diagram of data processing equipment provided in an embodiment of the present invention.Present embodiments provide one
Kind data processing equipment, which is the executing subject of data processing method, which is made of hardware and/or software.
As shown in figure 3, the data processing equipment includes: to obtain module 11, processing module 12.
Module 11 is obtained, for receiving HTTP request and the parsing of query traffic data by HTTP interface, obtains mark
The query condition information of information and target data format.
Processing module 12, for determining target database according to the identification information.
Processing module 12 is also used to the query condition information of the target data format being converted into the target database
Corresponding target query condition.
Processing module 12 is also used to obtain in the target database and tie with the matched inquiry of the target query condition
Fruit.
The processing module 12 is also used to for the query result being converted into the business datum of target data format.
Further, the HTTP request further includes user right data, and the processing module 12 is also used at described
After determining target database according to the identification information, whether the inquiry mesh is had according to the user right data verification user
Mark the permission of database；
When determining that user has the permission for inquiring the target database, the looking into the target data format is executed
Ask the step of conditional information is converted into the target database corresponding target query condition.
Further, the processing module 12 is specifically used for: determining the corresponding target data source of the identification information；It will be with
The corresponding database of the target data source is determined as target database.
Further, the target data format is JSON format.
It should be noted that the aforementioned data for being also applied for the embodiment to the explanation of data processing method embodiment
Processing unit, details are not described herein again.
Data processing equipment provided in an embodiment of the present invention, by receiving HTTP request and the parsing of query traffic data,
Obtain the query condition information of identification information and target data format；Target database is determined according to the identification information；By institute
The query condition information for stating target data format is converted into the corresponding target query condition of the target database；In the target
It is obtained and the matched query result of target query condition in database；The query result is converted into the target data
The business datum of format.Since big data platform is additionally arranged HTTP interface, external operation system can pass through the HTTP
Interface and big data platform carry out data interaction, realize obtain the MySQL, Kudu for being stored in big data platform, MongoDB,
Storing data in the databases such as OpenTSDB, Druid, HBase is to carry out corresponding business processing.Due to the letter of HTTP interface
It is single easy to learn, understandable easy-to-use, for the front end developer of the operation system outside exploitation, it can quickly and easily realize outside
The front end of operation system have the function of calling the data in big data platform, it is flat to grasp big data without front end developer
The working principle of platform, and exploitation drive or write corresponding reading code accordingly to call each number in big data platform
According to library, the consuming of human and material resources is significantly reduced, improves the development efficiency of external operation system.Further, it is looking into
Before asking target database, the permission whether user has inquiry target database is verified, it is big to prevent the user of unauthorized from calling
Data in the database of data platform improve the safety of data.
Fig. 4 is a kind of structural schematic diagram of computer equipment provided in an embodiment of the present invention.The computer equipment includes:
Memory 1001, processor 1002 and it is stored in the calculating that can be run on memory 1001 and on processor 1002
Machine program.
Processor 1002 realizes the data processing method provided in above-described embodiment when executing described program.
Further, computer equipment further include:
Communication interface 1003, for the communication between memory 1001 and processor 1002.
Memory 1001, for storing the computer program that can be run on processor 1002.
Memory 1001 may include high speed RAM memory, it is also possible to further include nonvolatile memory (non-
Volatile memory), a for example, at least magnetic disk storage.
Processor 1002 realizes data processing method described in above-described embodiment when for executing described program.
If memory 1001, processor 1002 and the independent realization of communication interface 1003, communication interface 1003, memory
1001 and processor 1002 can be connected with each other by bus and complete mutual communication.The bus can be industrial standard
Architecture (Industry Standard Architecture, referred to as ISA) bus, external equipment interconnection
(Peripheral Component, referred to as PCI) bus or extended industry-standard architecture (Extended Industry
Standard Architecture, referred to as EISA) bus etc..The bus can be divided into address bus, data/address bus, control
Bus processed etc..Only to be indicated with a thick line in Fig. 4, it is not intended that an only bus or a type of convenient for indicating
Bus.
Optionally, in specific implementation, if memory 1001, processor 1002 and communication interface 1003, are integrated in one
It is realized on block chip, then memory 1001, processor 1002 and communication interface 1003 can be completed mutual by internal interface
Communication.
Processor 1002 may be a central processing unit (Central Processing Unit, referred to as CPU), or
Person is specific integrated circuit (Application Specific Integrated Circuit, referred to as ASIC) or quilt
It is configured to implement one or more integrated circuits of the embodiment of the present invention.
The present embodiment also provides a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that
The program realizes data processing method as described above when being executed by processor.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not
It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office
It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field
Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples
It closes and combines.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the present invention, the meaning of " plurality " is at least two, such as two, three
It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing custom logic function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings
Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the invention can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.Such as, if realized with hardware in another embodiment, following skill well known in the art can be used
Any one of art or their combination are realized: have for data-signal is realized the logic gates of logic function from
Logic circuit is dissipated, the specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile
Journey gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, each functional unit in each embodiment of the present invention can integrate in a processing module
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above
The embodiment of the present invention is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as to limit of the invention
System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of the invention
Type.
Claims (10)
1. a kind of data processing method characterized by comprising
HTTP request and parsing by HTTP interface reception query traffic data, acquisition identification information and target data format
Query condition information；
Target database is determined according to the identification information；
The query condition information of the target data format is converted into the corresponding target query condition of the target database；
It is obtained and the matched query result of target query condition in the target database；
The query result is converted into the business datum of the target data format.
2. the method according to claim 1, wherein the HTTP request further includes user right data,
It is described determine according to the identification information target database after, further includes:
Whether there is the permission for inquiring the target database according to the user right data verification user；
When determining that user has the permission for inquiring the target database, the inquiry item by the target data format is executed
Part information is converted into the step of target database corresponding target query condition.
3. the method according to claim 1, wherein described determine target database according to the identification information,
Include:
Determine the corresponding target data source of the identification information；
Database corresponding with the target data source is determined as target database.
4. the method according to claim 1, wherein the target data format is JSON format.
5. a kind of data processing equipment characterized by comprising
Obtain module, for by HTTP interface receive query traffic data HTTP request and parsing, obtain identification information with
The query condition information of target data format；
Processing module, for determining target database according to the identification information；
Processing module is also used to the query condition information of the target data format being converted into the target database corresponding
Target query condition；
Processing module is also used to obtain and the matched query result of target query condition in the target database；
The processing module is also used to for the query result being converted into the business datum of target data format.
6. device according to claim 5, which is characterized in that the HTTP request further includes user right data, described
Processing module, be also used to it is described target database is determined according to the identification information after, according to the user right data
Whether verifying user has the permission for inquiring the target database；
When determining that user has the permission for inquiring the target database, the inquiry item by the target data format is executed
Part information is converted into the step of target database corresponding target query condition.
7. device according to claim 5, which is characterized in that the processing module is specifically used for: determining the mark letter
Cease corresponding target data source；Database corresponding with the target data source is determined as target database.
8. device according to claim 5, which is characterized in that the target data format is JSON format.
9. a kind of computer equipment characterized by comprising
Memory, processor and storage are on a memory and the computer program that can run on a processor, which is characterized in that institute
State the data processing method realized as described in any in claim 1-4 when processor executes described program.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The data processing method as described in any in claim 1-4 is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910138646.9A CN109992596A (en) | 2019-02-25 | 2019-02-25 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910138646.9A CN109992596A (en) | 2019-02-25 | 2019-02-25 | Data processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109992596A true CN109992596A (en) | 2019-07-09 |
Family
ID=67130338
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910138646.9A Pending CN109992596A (en) | 2019-02-25 | 2019-02-25 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109992596A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113886481A (en) * | 2021-12-06 | 2022-01-04 | 北京宇信科技集团股份有限公司 | Database access method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012114881A (en) * | 2010-11-29 | 2012-06-14 | Mitsubishi Electric Corp | Monitoring recording apparatus |
| US20160283728A1 (en) * | 2015-03-26 | 2016-09-29 | Microsoft Technology Licensing, Llc | Database server and client for query processing on encrypted data |
| CN106844485A (en) * | 2016-12-23 | 2017-06-13 | 航天星图科技（北京）有限公司 | A kind of system and method for enterprise's heterogeneous database intelligent integrated |
| CN107291826A (en) * | 2017-05-26 | 2017-10-24 | 北京金山安全管理系统技术有限公司 | File search processing method and processing device |
| CN108108439A (en) * | 2017-12-21 | 2018-06-01 | 北京奇艺世纪科技有限公司 | A kind of data query method, apparatus and electronic equipment |
| CN108664613A (en) * | 2018-05-11 | 2018-10-16 | 中国平安人寿保险股份有限公司 | Data query method, apparatus, computer equipment and storage medium |
-
2019
- 2019-02-25 CN CN201910138646.9A patent/CN109992596A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012114881A (en) * | 2010-11-29 | 2012-06-14 | Mitsubishi Electric Corp | Monitoring recording apparatus |
| US20160283728A1 (en) * | 2015-03-26 | 2016-09-29 | Microsoft Technology Licensing, Llc | Database server and client for query processing on encrypted data |
| CN106844485A (en) * | 2016-12-23 | 2017-06-13 | 航天星图科技（北京）有限公司 | A kind of system and method for enterprise's heterogeneous database intelligent integrated |
| CN107291826A (en) * | 2017-05-26 | 2017-10-24 | 北京金山安全管理系统技术有限公司 | File search processing method and processing device |
| CN108108439A (en) * | 2017-12-21 | 2018-06-01 | 北京奇艺世纪科技有限公司 | A kind of data query method, apparatus and electronic equipment |
| CN108664613A (en) * | 2018-05-11 | 2018-10-16 | 中国平安人寿保险股份有限公司 | Data query method, apparatus, computer equipment and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113886481A (en) * | 2021-12-06 | 2022-01-04 | 北京宇信科技集团股份有限公司 | Database access method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111049878B (en) | Method, device, electronic device and storage medium for visualizing micro-service call chain | |
| US20060225055A1 (en) | Method, system, and device for indexing and processing of expressions | |
| EP2521066A1 (en) | Fine-grained relational database access-control policy enforcement using reverse queries | |
| CN107948314A (en) | Method for processing business, device and the server of rule-based file | |
| CN110827008A (en) | Block chain link point and transaction method | |
| CN106547766A (en) | A kind of data access method and device | |
| US20110131247A1 (en) | Semantic Management Of Enterprise Resourses | |
| CN109656986A (en) | A kind of householder method that business datum summarizes, device and electronic equipment | |
| CN105574334A (en) | Medical information processing method and system | |
| CN104966190A (en) | Network payment method and apparatus | |
| CN110069739A (en) | The page preloads method and device | |
| EP1179789A2 (en) | Method and system for accessing information on a network | |
| CN112181924A (en) | File conversion method, device, equipment and medium | |
| CN109992596A (en) | Data processing method and device | |
| US20110154184A1 (en) | Event generation for xml schema components during xml processing in a streaming event model | |
| Padmanabhan et al. | Tool-supported verification of product line requirements | |
| CN112035676B (en) | User operation behavior knowledge graph construction method and device | |
| CN107547944A (en) | Interface realizing method and device, set top box | |
| US6442572B2 (en) | Method of and computer system for performing a transaction on a database | |
| CN108363655A (en) | User behavior characteristics analysis method and device | |
| US9342581B2 (en) | System to disclose the internal structure of persistent database objects | |
| US20130086462A1 (en) | Method and System for Retrieving Legal Data for User Interface Form Generation by Merging Syntactic and Semantic Contraints | |
| CN109947715A (en) | Log alarm method and device | |
| CN109408368A (en) | A kind of output method, storage medium and server for testing auxiliary information | |
| CN113221762A (en) | Cost balance decision method, insurance claim settlement decision method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190709 |