CN109828898A - Detection system and detection method - Google Patents

Detection system and detection method Download PDF

Info

Publication number
CN109828898A
CN109828898A CN201711285804.0A CN201711285804A CN109828898A CN 109828898 A CN109828898 A CN 109828898A CN 201711285804 A CN201711285804 A CN 201711285804A CN 109828898 A CN109828898 A CN 109828898A
Authority
CN
China
Prior art keywords
service
request instruction
test signal
module
test
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711285804.0A
Other languages
Chinese (zh)
Inventor
吕世佑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute for Information Industry
Original Assignee
Institute for Information Industry
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute for Information Industry filed Critical Institute for Information Industry
Publication of CN109828898A publication Critical patent/CN109828898A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/004Error avoidance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/22Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
    • G06F11/26Functional testing
    • G06F11/263Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/81Threshold

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Debugging And Monitoring (AREA)
  • Test And Diagnosis Of Digital Computers (AREA)

Abstract

This case provides a kind of detection method, is suitable for a serverless backup framework, detection method includes: obtaining a test signal, and executes at least one movement according to test signal, and send out the request instruction comprising test signal;Judge whether the test signal in request instruction represents and execute a test pattern, the test signal in request instruction represents at least one service for executing test pattern, instructing to testing service device request corresponding requests if judging;One implementing result of the execution sequence and each at least one movement that are collected in when executing at least one movement, and it is execution sequence and implementing result is whole and be a data to be sorted;And a testing result is calculated according to data to be sorted, whether wherein testing result represents will occur a snowball effect.

Description

Detection system and detection method
[technical field]
This case relates to a kind of detection system and detection method.It is suitable for serverless backup framework in particular to one kind Detection system and detection method.
[background technique]
Serverless backup framework do not need management infrastructure can establish and executing application and service, application program is still It can execute on the server, but Servers-all management work is all completed by serverless backup framework.Therefore, user no longer needs Cloth builds, extend and safeguard service device comes executing application, database and stocking system.
However, the distinctive framework of serverless backup and development scheme, are easy that snowball effect occurs in exploitation, and developer is not It is easy to test on the cloud platform of serverless backup framework and except mistake.
Therefore, developer how is provided to be easy to test and except mistake and avoid the serverless backup framework of snowball effect, it has also become It is solved the problems, such as needed for the related personnel of this field.
[summary of the invention]
To solve the above subject, an aspect of this case is to provide a kind of detection system, is suitable for a serverless backup framework, inspection Examining system re-directs module, a data collection module and a categorization module comprising a test pattern module, a service.Test mould Formula module obtains a test signal, and executes at least one movement according to test signal, and send out the request comprising test signal Instruction.Service re-directs module and judges whether the test signal in request instruction represents one test pattern of execution, if judgement is asked It asks the test signal in instruction to represent and executes test pattern, then at least one instructed to testing service device request corresponding requests Service.Data collection module collects execution sequence and each at least one movement of the test pattern module when executing at least one movement An implementing result, and by execution sequence and implementing result it is whole and be a data to be sorted.Categorization module includes a disaggregated model, To calculate a testing result according to data to be sorted, wherein whether testing result represents will occur a snowball effect.
Another aspect of this case is to provide a kind of detection method, is suitable for a serverless backup framework, detection method includes: taking A test signal is obtained, and executes at least one movement, and a request instruction of the submitting comprising test signal according to test signal;Judgement Whether the test signal in request instruction, which represents, executes a test pattern, if judging, the test signal in request instruction represents execution Test pattern, then at least one service instructed to testing service device request corresponding requests;It is collected at least one movement of execution When execution sequence and each at least one movement an implementing result, and by execution sequence and implementing result it is whole and for one it is to be sorted Data;And a testing result is calculated according to the data to be sorted, wherein whether the testing result represents will occur snowball effect It answers.
To sum up, this case provides developer in test program by detection system, can automatically switch to using test clothes The service of business device avoids test program from influencing the operation of normal users, and application machine learning algorithm is to judge whether there is Snowball effect generates, and in the case where snowball effect is by generation can test program out of service immediately, can avoid without service Device framework corrupted, in addition, being also conducive to developer by the data collection carried out during running test program and removing It is wrong.Therefore, the detection system and detection method of this case, which have reached, makes developer be easier to test journey on serverless backup framework The effect of sequence and simultaneously avoidable snowball effect.
[Detailed description of the invention]
For the above and other purpose, feature, advantage and embodiment of this disclosure can be clearer and more comprehensible, appended diagram Be described as follows:
Fig. 1 is a kind of schematic diagram for the detection system being painted according to one embodiment of this case;
Fig. 2, which is a kind of detection system for being painted according to one embodiment of this case, interacts schematic diagram with electronic device;
Fig. 3 is a kind of flow chart for the detection method being painted according to one embodiment of this case;
Fig. 4 is the schematic diagram that multiple movements are executed according to a kind of test pattern module that one embodiment of this case is painted;
Fig. 5 is the flow chart that method is re-directed according to a kind of service that one embodiment of this case is painted;And
Fig. 6 is a kind of schematic diagram for the method for data capture being painted according to one embodiment of this case.
[symbol description]
100: detection system
10: input equipment
20: data processing equipment
22: application programming interface
M1: test pattern module
M2: service re-directs module
M3: data collection module
M4: categorization module
M5: message notification module
NF: formal service unit
NDB, TDB: database
NSR, TSR: storage device
NAPP, TAPP: user application
D1, D2: electronic device
A1~A3: movement
300: detection method
500: service re-directs method
310~347,510~524: step
[specific embodiment]
It is hereafter to elaborate for embodiment cooperation institute's accompanying drawings, but provided embodiment is not intended to limit the invention institute The range covered, and the non-sequence to limit its execution of the description of structure operation, any structure reconfigured by component, institute Generating has equal and other effects device, is all the range that the present invention is covered.In addition, schema is only for the purpose of description, not according to It maps according to full size.To make to be easy to understand, same components will be illustrated in following the description with identical symbology.
About " first " used herein, " second " ... etc., not especially censure the meaning of order or cis-position, also non-use The component described with limiting the present invention just for the sake of difference with same technique term or operation.
Fig. 1~3 is please referred to, Fig. 1 is a kind of schematic diagram for the detection system 100 being painted according to one embodiment of this case.According to Fig. 2 A kind of detection system 100 that one embodiment of this case is painted is real according to this case one with the schematic diagram Fig. 3 that interacts of electronic device D1, D2 Apply a kind of flow chart for detection method 200 that example is painted.In an embodiment, detection system 100 include test pattern module M1, Service re-directs module M2, data collection module M3 and categorization module M4.In an embodiment, detection system 100 is further included Message notification module M5.In an embodiment, detection system 100 further includes input equipment 10, formal service unit NF and test Service unit TF.It include application programming interface 22 and test pattern module in data processing equipment 20 in an embodiment Comprising being stored in database NDB and user application NAPP that device NSR is set in a storage in M1, formal service unit NF, survey It include the database tdb and user application TAPP for being stored in a storage device TSR in examination service unit TF.
In an embodiment, user can will be instructed by input equipment 10 or program is input to application programming interface 22, defeated Enter equipment 10 and application programming interface 22 can realize in a manner of software or hardware respectively, such as can refer to that user connects The electronic device of the network adapter or other receivable signals of mouth or entity.
In an embodiment, data processing equipment 20 can be a server, an electricity, a desk telephone or any executable operation Electronic device.
In an embodiment, test pattern module M1, service re-direct module M2, data collection module M3, categorization module M4 And message notification module M5 together or can be respectively implemented as micro-control unit (microcontroller), microprocessor (microprocessor), digital signal processor (digital signal processor), special application integrated circuit (application specific integrated circuit, ASIC) or a logic circuit.
In an embodiment, storage set device NSR, storage device TSR can be implemented as respectively flash memory, floppy disk, hard disk, CD, Portable disk, tape are familiar with this those skilled in the art and can be thought easily and storage media with the same function.
In an embodiment, user application TAPP and user application NAPP refer to user's application program to be executed, Formal service unit NF is to execute user application NAPP, and testing service device TF is to execute user application TAPP。
In Fig. 2, detection system 100 can receive the event (event) of electronic device D1, D2, and electronic device D1, D2 are, for example, hand Machine, plate, pen electricity, sensor or other devices with transfer function, on the event that electronic device D1, D2 are triggered is, for example, An image is passed to detection system 100, so that detection system 100 detects that data have been updated and have been triggered (trigger), and Then image is subjected to the application such as image contract drawing, image transcoding according to default or user-defined regular (rule), and executes one Movement (action) is, for example, to upload to the image after transcoding in other software or hardware device.Detection method described below 300 each step.
In step 310, test pattern module M1 obtains a test signal, and executes at least one movement according to test signal, and Send out the request instruction comprising test signal.
In an embodiment, user can be input to application programming interface 22 for signal is tested by input equipment 10, apply Test signal is transmitted to test pattern module M1 again by programmatic interface 22.
Referring to Fig. 4, Fig. 4 is that a kind of test pattern module M1 being painted according to one embodiment of this case executes multiple movement A1~A3 Schematic diagram.In an embodiment, test pattern module M1 sequentially executes multiple movement A1~A3, these movements A1~A3 is all It is edited with different program languages, for example, movement A1 is write by " NodeJS " program language, test pattern module M1 is held After A1 is made in action, one first implementing result is generated, the first implementing result substitution is acted into A2, movement A2 is by " Python " program Language is write, and after test pattern module M1 execution acts A2, generates one second implementing result, the second implementing result is substituted into dynamic Make A3, the second implementing result is substituted on the platform of " Docker " and run by movement A3, one third implementing result of generation.However, surveying The program language that examination mode module M1 can be executed is without being limited thereto, and test pattern module M1 can be performed data processing equipment 20 and be propped up The program language held.
In an embodiment, the request instruction service of passing to test signal is re-directed module again by test pattern module M1 M2。
In step 320, service re-directs module M2 and judges whether the test signal in request instruction represents one test of execution Mode, if judging, the test signal in request instruction represents execution test pattern, requests to correspond to a testing service device TF At least one service (step 325) of request instruction.In an embodiment, judge in request instruction when service re-directs module M2 Test signal do not represent execution test pattern, then at least one service instructed to a formal service unit NF request corresponding requests (step 327).
In an embodiment, a service for example, Database Systems access service, storage device setting service or user's application Program TAPP, NAPP can arouse corresponding service by formal service unit NF and/or testing service device TF.
Referring to Fig. 5, Fig. 5 is the flow chart for re-directing method 500 according to a kind of service that one embodiment of this case is painted.Fig. 5 In step 510~524 can be the sub-step of step 325.In Fig. 5, service re-directs module M2 and receives request instruction (step 510) judges whether the test signal in request instruction represents and executes test pattern (step 512), if judgement request refers to When test signal in order represents execution test pattern, service re-directs at least one clothes that module M2 checks corresponding requests instruction It is engaged in needing the service using database tdb or the service of storage device TSR in (step 516), such as inspection request instruction, establish extremely A few service (step 518), is relevant to the service for carrying out test, for example, application program to list, so that service is led again It can rapidly allow user to test subordinate in detection system 100 to module M2, dynamically establish the service of dependence test, then, An initial authentication (step 520) is generated, obtains the permission for operating detection system 100 to indicate that active user meets, and according to first Begin to authenticate and generate a update certification (522), this, which is updated, authenticates and can change acquirement service in the case where not interfering user's operational scenario The guide path of (for example, storage device setting service), followed by foundation updates certification asks to testing service device TF correspondence Ask at least the one of instruction to service (step 524), whereby by request instruction be oriented to testing service device TF (such as request instruction is, Write-in new image file case is written to database TSR).
Method 500 is re-directed by service, when user's test program, needs to access database tdb or storage device TSR When servicing (or resource), user is not necessarily to learn the IP address of database tdb or storage device TSR, only need to obtain initial authentication, and Detection system 100 can automatically generate a update certification, by update certification can automatic guide to testing service device TF (this walk Suddenly it is to re-direct module M2 by service to carry out automatically, is set without by user), obtain the needs in testing service device TF Access database tdb or the service of storage device TSR.
Since testing service device TF and formal service unit NF is two independent environment, it, will not in test program Influence the normal operating of other users.For example, under normal operating, it is that will request that service, which re-directs module M2, shown in Fig. 1 Instruction guide is to formal service unit NF, to obtain service.
In step 514, if service re-directs module M2 and judges that the test signal in request instruction does not represent execution test mould When formula, then request instruction is oriented to tests whereby by least one service instructed to a formal service unit NF request corresponding requests Service unit NF.
Referring again to Fig. 3, in step 330, data collection module M3 collects test pattern module M1 at least one movement of execution One implementing result of execution sequence and each at least one movement A1~A3 when A1~A3 (such as hold by the first implementing result to third Row result), and by execution sequence and implementing result it is whole and be a data to be sorted.
Referring to Fig. 6, Fig. 6 is a kind of schematic diagram for the method for data capture being painted according to one embodiment of this case.In Fig. 6, number According to collection module M3 to collect execution sequence of test pattern module M1 when executing at least one movement A1~A3 and it is each extremely The first implementing result of few movement A1~A3 to third implementing result, these data it is whole and or collection be combined into a data to be sorted, The form of data to be sorted is, for example, a journal file (log file).In this embodiment, execution sequence be sequentially movement A1, Act A2 and movement A3.
Step 330 and step 325 simultaneously or can exchange and execute sequence.
In step 340, categorization module M4 includes a disaggregated model, to calculate a testing result according to data to be sorted, In, whether testing result represents will occur a snowball effect.
In an embodiment, when testing result, which represents, snowball effect will occur, step 345 is executed, when testing result representative will When snowball effect will not occur, step 347 is executed.
In an embodiment, multiple given datas are substituted into a machine learning algorithm by categorization module, to generate in a training stage Disaggregated model, and data to be sorted are substituted into disaggregated model in a forecast period, to judge whether data to be sorted will occur one Snowball effect, generates testing result whereby.
In an embodiment, disaggregated model be can be with the realization of one or more functions, such as (such as using known S type function Sigmoid function and the function to highlight maximum value (such as softmax) are realized, due to using known machine learning algorithm It realizes this step, therefore does not repeat it herein.
In an embodiment, snowball effect refers to that event the more is rolled the more big as snowball, describes that things development scale speed is crazy Mad growth.In the present invention, snowball effect is defined as a storage device and sending test used by representing at least one service and believes Number the electronic device storage device that is included it is identical, for example, at least one service is by new image file case in step 320 The electronics of test signal is issued in the storage device (e.g. position is in the storage device in electronic device D1) and step 310 of write-in When the storage device (such as being also storage device of the position in electronic device D1) that device is included is identical, 100 meeting of detection system Detect that archives are changed, therefore detection system 100 is triggered by this electronic device D1 again, is entered step 310 once more, is caused Generation of the Infinite loop as snowball effect.
In step 345, message notification module M5 transmits a snowball effect signal, and transmits an abort actions signal.
In an embodiment, message notification module M5 will test the container that test program is currently running in system 100 (container) or virtual machine is closed, and the Infinite loop of operation is entered to avoid detection system 100.
In an embodiment, message notification module M5 transmits the electronic device (example of a snowball effect signal to outflow test signal For example electronic device D1).
In step 347, message notification module M5 transmits a normal service signal.In an embodiment, message notification module M5 Transmit the electronic device (for example, electronic device D1) of a normal service signal to outflow test signal.
To sum up, this case provides developer in test program by detection system, can automatically switch to and be filled using testing service The service set avoids test program from influencing the operation of normal users, and application machine learning algorithm is to judge whether there is snowball Effect generates, and in the case where snowball effect is by generation can test program out of service immediately, can avoid serverless backup frame Structure corrupted, in addition, being also conducive to developer except mistake by the data collection carried out during running test program. Therefore, the detection system and detection method of this case reached make developer be easier on serverless backup framework test program and The effect of can avoid snowball effect simultaneously.
Although this case is disclosed above with embodiment, so it is not limited to this case, any to be familiar with this those skilled in the art, is not departing from In the spirit and scope of this case, when can be used for a variety of modifications and variations, therefore the protection scope of this case is special when regarding appended application Subject to sharp range institute defender.

Claims (14)

1. a kind of detection system is suitable for a serverless backup framework, which is characterized in that the detection system includes:
One test pattern module executes at least one movement to obtain a test signal, and according to the test signal, and sends out packet A request instruction containing the test signal;
One service re-directs module, and whether the test signal to judge in the request instruction represents one test mould of execution Formula, if judging, the test signal in the request instruction represents the execution test pattern, to testing service device request pair Should request instruction at least one service;
One data collection module, it is sequentially and each to collect an execution of test pattern module when executing at least one movement This at least one movement an implementing result, and by the execution sequence and the implementing result it is whole and be a data to be sorted;And
One categorization module includes a disaggregated model, to calculate a testing result according to the data to be sorted, the wherein detection knot Whether fruit represents will occur a snowball effect.
2. detection system as described in claim 1, which is characterized in that further include:
One message notification module, when the snowball effect will occur for testing result representative, then in message notification module transmission one Only action signal, when the snowball effect will not occur for testing result representative, then the message notification module transmits a normal service Signal.
3. detection system as described in claim 1, which is characterized in that the test pattern module sequentially executes multiple movements, should Multiple movements are edited with different program languages.
4. detection system as described in claim 1, which is characterized in that judge the request instruction when the service re-directs module In the test signal do not represent and execute the test pattern, then correspond to the request instruction to a formal service unit request should At least one service.
5. detection system as described in claim 1, which is characterized in that judge the request instruction when the service re-directs module In the test signal represent execute the test pattern when, the service re-direct module check correspond to the request instruction this extremely At least one service is established in a few service, generates an initial authentication, and generate one according to the initial authentication and update certification, foundation The update authenticates at least one service that the corresponding request instruction is requested to the testing service device.
6. detection system described in claim 1, which is characterized in that an at least service refers to a Database Systems access service Or one storage device setting service.
7. detection system as described in claim 1, which is characterized in that used by the snowball effect represents at least one service One storage device is identical as the storage device that the electronic device for issuing the test signal is included.
8. a kind of detection method is suitable for a serverless backup framework, which is characterized in that the detection method includes:
A test signal is obtained, and executes at least one movement according to the test signal, and send out one asking comprising the test signal Ask instruction;
Judge whether the test signal in the request instruction represents and execute a test pattern, if judging being somebody's turn to do in the request instruction It tests signal and represents the execution test pattern, then request at least one service of the corresponding request instruction to a testing service device;
The execution sequence that is collected in when executing at least one movement and respectively implementing result at least one movement, and this are held Row sequence and the implementing result it is whole and be a data to be sorted;And
A testing result is calculated according to the data to be sorted, whether wherein the testing result represents will occur a snowball effect.
9. detection method as claimed in claim 8, which is characterized in that further include:
The snowball effect will occur when the testing result represents, then transmit an abort actions signal, when testing result representative will The snowball effect does not occur, then transmits a normal service signal.
10. detection method as claimed in claim 8, which is characterized in that further include:
Multiple movements are sequentially executed, multiple movement is edited with different program languages.
11. detection method as claimed in claim 8, which is characterized in that further include:
The test pattern is executed when judging that the test signal in the request instruction does not represent, then to a formal service unit request At least one service corresponding to the request instruction.
12. detection method as claimed in claim 8, which is characterized in that further include:
When judging that the test signal in the request instruction represents the execution test pattern, being somebody's turn to do for the corresponding request instruction is checked At least one service is established at least one service, generates an initial authentication, and generate one according to the initial authentication and update certification, according to At least one service for corresponding to the request instruction to testing service device request is authenticated according to the update.
13. detection method according to any one of claims 8, which is characterized in that an at least service refers to data base method access clothes Business or storage device setting service.
14. detection method as claimed in claim 8, which is characterized in that the snowball effect represents at least one service and used A storage device it is identical as electronic device storage device for being included of the test signal is issued.
CN201711285804.0A 2017-11-23 2017-12-07 Detection system and detection method Pending CN109828898A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW106140834A TWI650636B (en) 2017-11-23 2017-11-23 Detection system and detection method
TW106140834 2017-11-23

Publications (1)

Publication Number Publication Date
CN109828898A true CN109828898A (en) 2019-05-31

Family

ID=66213681

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711285804.0A Pending CN109828898A (en) 2017-11-23 2017-12-07 Detection system and detection method

Country Status (3)

Country Link
US (1) US10691515B2 (en)
CN (1) CN109828898A (en)
TW (1) TWI650636B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040028029A1 (en) * 2002-08-12 2004-02-12 Vodtel Communications Inc. Non-server type voice packet communication device and method
CN101127726A (en) * 2007-09-27 2008-02-20 中兴通讯股份有限公司 A traffic control method and system based on service priority
CN101432767A (en) * 2004-06-28 2009-05-13 伊普拉斯资产公司 Method for a server-less office architecture
CN104246740A (en) * 2012-06-08 2014-12-24 惠普发展公司,有限责任合伙企业 Test and management for cloud applications
CN105359457A (en) * 2013-05-17 2016-02-24 华为技术有限公司 Multi-tier push hybrid service control architecture for large scale conferencing over information centric network, icn

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5628013A (en) * 1992-09-30 1997-05-06 Apple Computer, Inc. Apparatus and method for allocating processing time in a frame-based computer system
KR20010098904A (en) * 2000-04-26 2001-11-08 윌리엄 비. 켐플러 Multiprocessor object control
US20020019843A1 (en) * 2000-04-26 2002-02-14 Killian Robert T. Multiprocessor object control

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040028029A1 (en) * 2002-08-12 2004-02-12 Vodtel Communications Inc. Non-server type voice packet communication device and method
CN101432767A (en) * 2004-06-28 2009-05-13 伊普拉斯资产公司 Method for a server-less office architecture
CN101127726A (en) * 2007-09-27 2008-02-20 中兴通讯股份有限公司 A traffic control method and system based on service priority
CN104246740A (en) * 2012-06-08 2014-12-24 惠普发展公司,有限责任合伙企业 Test and management for cloud applications
CN105359457A (en) * 2013-05-17 2016-02-24 华为技术有限公司 Multi-tier push hybrid service control architecture for large scale conferencing over information centric network, icn

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
梁贵成等: ""基于P2P网络的反垃圾邮件系统的设计"", 《柳州职业技术学院学报》 *

Also Published As

Publication number Publication date
TWI650636B (en) 2019-02-11
US20190155670A1 (en) 2019-05-23
US10691515B2 (en) 2020-06-23
TW201926039A (en) 2019-07-01

Similar Documents

Publication Publication Date Title
US11372709B2 (en) Automated testing error assessment system
Mao et al. Crowd intelligence enhances automated mobile testing
US10474563B1 (en) System testing from production transactions
CN103220364B (en) A kind of system administration training platform framework based on cloud
US7315807B1 (en) System and methods for storage area network simulation
CN110427323A (en) A kind of application testing method, device, proxy server and system
Nguyen et al. Batc: a benchmark for aggregation techniques in crowdsourcing
CN110147317A (en) Code test method and device, electronic equipment and storage medium
WO2017159620A1 (en) Expandability retention device
US20200050534A1 (en) System error detection
US20190130777A1 (en) Evaluating User Contribution in Collaborative Environments
US10296844B2 (en) Automatic discovery of message ordering invariants in heterogeneous logs
CN107003931A (en) Test checking is separated from test execution
US8713050B2 (en) Testing SQL query writing skills
TWI626538B (en) Infrastructure rule generation
CN109101414B (en) Massive UI test generation method and device based on buried point data
US11232019B1 (en) Machine learning based test coverage in a production environment
CN109828898A (en) Detection system and detection method
US11909754B2 (en) Security assessment system
CN105339974B (en) Analog sensor
CN110362294A (en) Development task executes method, apparatus, electronic equipment and storage medium
Oyebisi et al. Development of a remote operational amplifier Ilab using android-based mobile platform
KR20220040056A (en) System for testing electronic control unit
Rodestock Visualizing and explaining the scaling behavior of self-adaptive microservice systems in kubernetes
Maicus Automated Grading for Advanced Topics Courses

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190531

WD01 Invention patent application deemed withdrawn after publication