Invention content
The purpose of the application is to propose a kind of improved experimental method and device for client, to solve above carry on the back
The technical issues of scape technology segment is mentioned.
In a first aspect, the embodiment of the present application provides a kind of experimental method for client, method includes:Using client
Preset experiment pattern is converted to experimental arrangement by the interface for holding programming language used by program, experimental arrangement it is defeated
Entry format is the data structure of client-side program;Open command is tested in response to receiving, experimental arrangement is cut into client-side program,
It is tested.
In some embodiments, preset experiment pattern is the experiment pattern determined according to input information, input letter
Breath includes:Experimental site, experiment content and scope of experiment.
In some embodiments, preset experiment pattern is converted to experimental arrangement includes:To the category of experiment pattern
Property carry out cutting, the relating attribute tested and dereferenced attribute;Using scheduled experiment text formatting, respectively processing association
Attribute and dereferenced attribute, the relating attribute that obtains that treated and treated dereferenced attribute;Using experiment text formatting point
Relating attribute after other checking treatment and treated dereferenced attribute, the non-pass after relating attribute and verification after being verified
It is attribute;Relating attribute after verification and the dereferenced attribute after verification are loaded onto scheduled experiment module, obtain experiment journey
Sequence.
In some embodiments, the relating attribute of experiment includes following three arbitrary combinations:Meet the page of experimental site
Face or module;Meet the flow or Modification growth function of experiment content;And meet the scene or type of scope of experiment.
In some embodiments, the dereferenced attribute of experiment includes:Indicate the experiment switch that experiment is opened or experiment is closed.
In some embodiments, method further includes:Out code is tested in response to receiving, experimental arrangement is cut out into client
Program stops experiment.
Second aspect, the embodiment of the present application provide a kind of experimental provision for client, and device includes:Experimental arrangement
Conversion module is converted to preset experiment pattern for the interface using programming language used by client-side program
Experimental arrangement, the input format of experimental arrangement are the data structure of client-side program;Experimental arrangement calling module, in response to
Experiment open command is received, experimental arrangement is cut into client-side program, is tested.
In some embodiments, preset experiment pattern is to be determined according to input information in experimental arrangement conversion module
Experiment pattern, input information includes:Experimental site, experiment content and scope of experiment.
In some embodiments, preset experiment pattern is converted into experimental arrangement packet in experimental arrangement conversion module
It includes:Cutting, the relating attribute tested and dereferenced attribute are carried out to the attribute of experiment pattern;Using scheduled experiment text
Format handles relating attribute and dereferenced attribute respectively, the relating attribute that obtains that treated and treated dereferenced attribute;It adopts
With after experiment text formatting difference checking treatment relating attribute and treated dereferenced attribute, the association category after being verified
Property and verification after dereferenced attribute;Relating attribute after verification and the dereferenced attribute after verification are loaded onto scheduled experiment
Module obtains experimental arrangement.
In some embodiments, the relating attribute of experiment includes following three arbitrary combinations:Meet the page of experimental site
Face or module;Meet the flow or Modification growth function of experiment content;And meet the scene or type of scope of experiment.
In some embodiments, the dereferenced attribute of experiment includes:Indicate the experiment switch that experiment is opened or experiment is closed.
In some embodiments, device further includes:Experimental arrangement stops mode transfer block, for referring in response to receiving experiment and closing
It enables, experimental arrangement is cut out into client-side program, stops experiment.
The third aspect, the embodiment of the present application provide a kind of equipment, including:One or more processors;Storage device is used
In the one or more programs of storage;When one or more programs are executed by one or more processors so that at one or more
It manages device and realizes as above any experimental method for client.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, are stored thereon with computer journey
Sequence realizes as above any experimental method for client when the program is executed by processor.
The experimental method and device for client provided in the embodiment of the present application, this is used for the experiment side of client
Preset experiment pattern using the interface of programming language used by client-side program, is converted to experiment journey by method first
Sequence, the input format of experimental arrangement are the data structure of client-side program;Later, open command is tested in response to receiving, it will be real
Program incision client-side program is tested, is tested.With in the prior art from client adjust Product Logic compared with, without change visitor
The Technical Architecture of family end program is only the purpose that can reach verification Product Experience by switching experiment flow, reduces experiment pair
The coupling of client-side program, convenient for the experiment of upgrading experimental code and statistical management client.
Specific implementation mode
The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that in order to
Convenient for description, is illustrated only in attached drawing and invent relevant part with related.
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase
Mutually combination.The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
Fig. 1 shows the experimental method for client or the experimental provision for client that can apply the application
The exemplary system architecture 100 of embodiment.
As shown in Figure 1, system architecture 100 may include terminal device 101,102,103, network 104 and server 105,
106.Network 104 between terminal device 101,102,103 and server 105,106 provide communication link medium.Net
Network 104 may include various connection types, such as wired, wireless communication link or fiber optic cables etc..
User 110 can be interacted by network 104 with server 105,106 with using terminal equipment 101,102,103, to connect
Receive or send message etc..Various telecommunication customer end applications, such as video playing can be installed on terminal device 101,102,103
Class application, the application of search engine class, the application of shopping class, instant messaging tools, mailbox client, social platform software etc..
Terminal device 101,102,103 can be the various electronic equipments for having display screen, including but not limited to intelligent hand
Machine, tablet computer, E-book reader, MP3 player (Moving Picture Experts Group Audio Layer
III, dynamic image expert's compression standard audio level 3), MP4 (Moving Picture Experts Group Audio
Layer IV, dynamic image expert's compression standard audio level 4) player, pocket computer on knee and desktop computer etc.
Deng.
Server 105,106 can be to provide the server of various services, such as provide terminal device 101,102,103
The background server of support.Background server can send experiment open command to terminal, and collection terminal is to experiment process knot
The feedback data of fruit, and feedback data is further analyzed and is handled, so as to subsequently according to analysis and handling result to end
Send instructions under end.
It should be noted that the experimental method for client that embodiment is provided in the application is generally by terminal device
101, it 102,103 executes, correspondingly, the experimental provision for client is generally positioned in terminal device 101,102,103.
It should be understood that the number of the terminal device, network and server in Fig. 1 is only schematical.According to realization need
It wants, can have any number of terminal device, network and server.
Referring to FIG. 2, Fig. 2 shows the flows according to one embodiment of the experimental method for client of the application
200.This includes for experimental method of client:
In step 210, using the interface of programming language used by client-side program, by preset experiment pattern
Be converted to experimental arrangement.
In the present embodiment, client-side program is operate in the software program of client.The client-side program generally use
The specific programming language run on the operating system of client is write, these programming languages with advanced feature provide
The data of environmental externality can be input to environmental interior, so as to procedure identification by simply, efficient interface by these interfaces.
It is tested in client, the idea that will be skewed towards logical thinking before the experiments is needed to be converted to the generation of execution level
Code, but also existing logic cannot be influenced.Therefore, experiment pattern can be preset, path, diminution are clearly tested to define
The coverage of experiment.That is, for any experiment, need to solve the problems, such as in experiment pattern as follows:Think where go up this
Experiment, can be some page or module;Think what does there, can be some flow or function;How experiment model is controlled
It encloses, can be some types or scene.Illustratively, experiment pattern can be:Some page modification stream under some scene
Journey.By using experiment pattern, can by for client-side program it is assumed that template is melted into a reality that can be defined, can perform
It tests.Using the interface of programming language used by client-side program, it converts experiment pattern to experimental arrangement, readily available client
Hold the identification of program.For example, the program on iPhone is on Apple Macintosh operating system, on this operating system is specific
Programming language, such as expand C Object-Oriented Programming Language (Objective-c) or development language (swift), pass through these tool
Experimental arrangement, can smoothly be input to inside client-side program, so as to client by the interface for having the language of advanced feature to provide
Procedure identification.
In some optional realization methods of the present embodiment, preset experiment pattern is to be determined according to input information
Experiment pattern.Input information may include:Experimental site, experiment content and scope of experiment.
In this realization method, input information can be information input by user, or other terminals of reception are defeated
The information entered.Here input information may include:Experimental site, experiment content and scope of experiment.By receiving input information
Experimental site, experiment content and the scope of experiment of middle restriction can be that demand formulates unified standard, and defines from researching and developing to reaching the standard grade
The division of labor responsibility of multiple links, such as process formulation, Row control can also be controlled by strictly controlling experiment execution route
The coverage of experiment reduces risk.
In some optional realization methods of the present embodiment, preset experiment pattern is converted to experimental arrangement can be with
Including:Cutting, the relating attribute tested and dereferenced attribute are carried out to the attribute of experiment pattern;Using scheduled experiment text
This format handles relating attribute and dereferenced attribute respectively, the relating attribute that obtains that treated and treated dereferenced attribute;
Using after experiment text formatting difference checking treatment relating attribute and treated dereferenced attribute, the association after being verified
Dereferenced attribute after attribute and verification;Relating attribute after verification and the dereferenced attribute after verification are loaded onto scheduled reality
Module is tested, experimental arrangement is obtained.
In this realization method, in order to smoothly input experimental arrangement, the association category after verification here to user terminal program
Property and verification after dereferenced attribute as experiment parameter, format should meet the data structure in client-side program.Client
The data structure of program is held, it is multifarious in design, but no matter which kind of data structure client-side program uses, to final reality
Test result influence and it is little.For example, the most popular data structure of industry may be used in client-side program:Dictionary or
JavaScript object exchange format (JSON).Here scheduled experiment text formatting, refers to meeting in client-side program
The text formatting of data structure.By handling relating attribute and dereferenced in experiment pattern according to scheduled experiment text formatting
Attribute, it may be convenient to realize experiment parameter and the communication of experiment pattern and cooperate, and due to used by client-side program
Programming language provides the relevant interface of text-processing, this processing can allow outputting and inputting for text more easy;Passing through will
The result of text-processing is verified, and the experiment parameter of agreement can not be met with automatic fitration text formatting, prevents from joining because of experiment
Several formats not pair does not cause the failure of an experiment.Here the relating attribute of experiment refers to and specifically tests relevant attribute.It is real
The dereferenced attribute tested refers to the attribute unrelated with specific experiment.
In some optional realization methods of the present embodiment, the relating attribute of experiment may include arbitrary group of following three
It closes:Meet the page or module of experimental site;Meet the flow or Modification growth function of experiment content;And meet the field of scope of experiment
Scape or type.
In this realization method, can in being included in experimental site the page or module, be included in experiment content
In flow or Modification growth function and the scene being included in scope of experiment or type this three, one is extracted respectively as experiment
Relating attribute.For example, can be using the page, flow and type as relating attribute;In another example can by the page, Modification growth function and
Scene is as relating attribute.Herein, can also be using this three other combination as relating attribute, the application does not limit this
It is fixed.
In some optional realization methods of the present embodiment, the dereferenced attribute of experiment may include:Instruction experiment is opened
Or the experiment switch that experiment is closed.
In this realization method, the dereferenced attribute of experiment refers to that can be used in each experiment, with specific experiment
Unrelated attribute, such as instruction experiment is opened or the experiment switch of experiment closing.
In a step 220, open command is tested in response to receiving, experimental arrangement is cut into client-side program, is tested.
In this realization method, experiment open command is the external command received for the experimental method of client, is used for
Notice starts towards tangent plane programming technology to execute the logic in experimental arrangement, namely when running client-side program, dynamically
The experimental site that experiment content is cut to client-side program, when detecting that client-side program is run to scope of experiment, to hold
Row experiment content.
In some optional realization methods of the present embodiment, method can also include:In optional step 230, in response to
Experiment out code is received, experimental arrangement is cut out into client-side program, stops experiment.
In this realization method, experiment out code refers to the external command received for the experimental method of client, is used
Stop, using towards tangent plane programming technology, experimental arrangement being cut out client-side program in notice, to stop executing experimental arrangement
In logic, namely be restored to execute client-side program primitive logic.
Below with reference to Fig. 3, illustrate an exemplary application field of the experimental method for client of the embodiment of the present application
Scape.
As shown in figure 3, this is used for the experimental method of client, pass through the experiment dispatcher being preset in client-side program
320 realize.First, the experiment instruction 310 that experiment dispatcher 320 receives is open command, and later, experiment dispatcher 320 will
The experiment parameter 330 obtained according to experiment pattern 331, is loaded onto scheduled experiment module, obtains experimental arrangement, later, in step
In rapid 340, experimental arrangement is initialized, experimental code is cut into client-side program, later, in step 350, execution includes experiment
The client-side program of program, later, in step 360, when detecting that the range that client-side program is run at present do not meet experiment
When range, pause execute experimental arrangement, and client-side program run to when meeting scope of experiment, jump to execute step 340,
Until the experiment instruction 310 that experiment dispatcher 320 receives is out code, the experimental arrangement is closed, code is cut out to visitor
Family end program.
The experimental method for client that the application above application scene provides, by using experiment pattern, for needing
Formulation unified standard is sought, the division of labor responsibility of multiple links from researching and developing to reaching the standard grade, such as process formulation, Row control can be defined,
The coverage of experiment can also be controlled by strictly controlling experiment execution route, risk be reduced, later by the way that mould will be tested
Plate is converted to experimental arrangement, and when receiving experiment open command, calls experimental arrangement to cut client-side program, tested,
Without changing the Technical Architecture of client-side program, only it is the purpose that can reach verification Product Experience by switching experiment flow, subtracts
Coupling of the experiment to client-side program is lacked, convenient for the experiment of upgrading experimental code and statistical management client.
With further reference to Fig. 4, as an implementation of the above method, this application provides a kind of experiment dresses for client
The one embodiment set, this is used for the embodiment of the experimental method of client and the experimental method shown in FIG. 1 for client
Embodiment it is corresponding, as a result, above with respect in Fig. 1 be used for client experimental method describe operation and feature it is equally applicable
In for client experimental provision 400 and module wherein included, details are not described herein.
As shown in figure 4, the experimental provision 400 for being configured to client includes:Experimental arrangement conversion module 410, is used for
Using the interface of programming language used by client-side program, preset experiment pattern is converted into experimental arrangement, is tested
The input format of program is the data structure of client-side program;Experimental arrangement calling module 420, for being opened in response to receiving experiment
Instruction is opened, experimental arrangement is cut into client-side program, is tested.Optionally, device 400 can also stop adjusting including experimental arrangement
Experimental arrangement is cut out client-side program, stops experiment by module 430 for testing out code in response to receiving.
In some optional realization methods of the present embodiment, preset experiment pattern is in experimental arrangement conversion module
According to the experiment pattern that input information determines, input information includes:Experimental site, experiment content and scope of experiment.
In some optional realization methods of the present embodiment, by preset experiment pattern in experimental arrangement conversion module
Being converted to experimental arrangement includes:Cutting, the relating attribute tested and dereferenced attribute are carried out to the attribute of experiment pattern;It adopts
With scheduled experiment text formatting, relating attribute and dereferenced attribute are handled respectively, obtain that treated relating attribute and processing
Dereferenced attribute afterwards;Using after experiment text formatting difference checking treatment relating attribute and treated dereferenced attribute,
The dereferenced attribute after relating attribute and verification after being verified;By the relating attribute after verification and the dereferenced category after verification
Property is loaded onto scheduled experiment module, obtains experimental arrangement.
In some optional realization methods of the present embodiment, the relating attribute of experiment includes following three arbitrary combinations:
Meet the page or module of experimental site;Meet the flow or Modification growth function of experiment content;And meet the scene of scope of experiment
Or type.
In some optional realization methods of the present embodiment, the dereferenced attribute of experiment includes:Instruction experiment unlatching is real
The experiment switch that customs examination is closed.
Present invention also provides a kind of embodiments of equipment, including:One or more processors;Storage device, for depositing
The one or more programs of storage;When one or more programs are executed by one or more processors so that one or more processors
Realize as above any experimental method for client.
Present invention also provides a kind of embodiments of computer readable storage medium, are stored thereon with computer program, should
As above any experimental method for client is realized when program is executed by processor.
Below with reference to Fig. 5, it illustrates the computer systems 500 suitable for the terminal device for realizing the embodiment of the present application
Structural schematic diagram.Terminal device shown in Fig. 5 is only an example, to the function of the embodiment of the present application and should not use model
Shroud carrys out any restrictions.
As shown in figure 5, computer system 500 includes central processing module (CPU) 501, it can be read-only according to being stored in
Program in memory (ROM) 502 or be loaded into the program in random access storage device (RAM) 503 from storage section 508 and
Execute various actions appropriate and processing.In RAM 503, also it is stored with system 500 and operates required various programs and data.
CPU 501, ROM 502 and RAM 503 are connected with each other by bus 504.Input/output (I/O) interface 505 is also connected to always
Line 504.
It is connected to I/O interfaces 505 with lower component:Importation 506 including keyboard, touch screen etc.;Including such as showing
The output par, c 507 of screen and loud speaker etc.;Storage section 508 including hard disk etc.;And the communication including network interface card
Part 509.Communications portion 509 executes communication process via the network of such as internet.Driver 510 is connected to also according to needs
I/O interfaces 505.Detachable media 511, such as disk, CD, magneto-optic disk, semiconductor memory etc., are mounted on as needed
On driver 510, in order to be mounted into storage section 508 as needed from the computer program read thereon.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description
Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium
On computer program, the computer program includes the program code for method shown in execution flow chart.Such
In embodiment, which can be downloaded and installed by communications portion 509 from network, and/or is situated between from detachable
Matter 511 is mounted.When the computer program is executed by central processing module (CPU) 501, executes and limited in the present processes
Above-mentioned function.
It should be noted that computer-readable medium described herein can be computer-readable signal media or meter
Calculation machine readable storage medium storing program for executing either the two arbitrarily combines.Computer readable storage medium for example can be --- but not
Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or arbitrary above combination.Meter
The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to:Electrical connection with one or more conducting wires, just
It takes formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type and may be programmed read-only storage
Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device,
Or above-mentioned any appropriate combination.In this application, can be any include computer readable storage medium or storage journey
The tangible medium of sequence, the program can be commanded the either device use or in connection of execution system, device.And at this
In application, computer-readable signal media may include in a base band or as the data-signal that a carrier wave part is propagated,
Wherein carry computer-readable program code.Diversified forms may be used in the data-signal of this propagation, including but unlimited
In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can
Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for
By instruction execution system, device either device use or program in connection.Include on computer-readable medium
Program code can transmit with any suitable medium, including but not limited to:Wirelessly, electric wire, optical cable, RF etc. or above-mentioned
Any appropriate combination.
Flow chart in attached drawing and block diagram, it is illustrated that according to the system of the various embodiments of the application, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part for a part for one module, program segment, or code of table, the module, program segment, or code includes one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, this is depended on the functions involved.Also it wants
It is noted that the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, Ke Yiyong
The dedicated hardware based system of defined functions or operations is executed to realize, or can be referred to specialized hardware and computer
The combination of order is realized.
Being described in module involved in the embodiment of the present application can be realized by way of software, can also be by hard
The mode of part is realized.Described module can also be arranged in the processor, for example, can be described as:A kind of processor packet
Include experimental arrangement conversion module and experimental arrangement calling module.Wherein, the title of these modules is not constituted under certain conditions
Restriction to the module itself, for example, experimental arrangement conversion module is also described as " using used by client-side program
Preset experiment pattern is converted to the module of experimental arrangement by the interface of programming language ".
As on the other hand, present invention also provides a kind of nonvolatile computer storage media, the non-volatile calculating
Machine storage medium can be nonvolatile computer storage media included in device described in above-described embodiment;Can also be
Individualism, without the nonvolatile computer storage media in supplying terminal.Above-mentioned nonvolatile computer storage media is deposited
One or more program is contained, when one or more of programs are executed by an equipment so that the equipment:Using
Preset experiment pattern is converted to experimental arrangement, experimental arrangement by the interface of programming language used by client-side program
Input format be client-side program data structure;Open command is tested in response to receiving, experimental arrangement is cut into client
Program is tested.
Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.People in the art
Member should be appreciated that invention scope involved in the application, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic
Scheme, while should also cover in the case where not departing from foregoing invention design, it is carried out by above-mentioned technical characteristic or its equivalent feature
Other technical solutions of arbitrary combination and formation.Such as features described above has similar work(with (but not limited to) disclosed herein
Can technical characteristic replaced mutually and the technical solution that is formed.