How to run multiple jmx files as single job?

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

How to run multiple jmx files as single job?

Joe Kramer
Hello,

Looking for best practivce advice,

I have tests for different modules of application in multiple .jmx
files. Each module and corresponding .jmx file has 10+ test cases.
Keeping all tests in single file is not practical.
First, we have multiple developers/testers updating the tests at the
same time and conflict resolution in XML .jmx files is not as easy as
in Java source.
Second, it's difficult to navigate single file file with 100+ test cases.
Third, if you keep them in single file and design test case number
101, you either need to disable 100 previous cases or wait until 100
cases execute to see if case 101 works.

So we keep them grouped in separate files.
And the problem is: you have to set up complex batch file to run all
JMX files in sequence.
And second problem is that test reports are in separate files. You
have to publish every report separately, and browsing is very
frustrating task.

Is there a way to create "master" JMX file that has some kind of
"call" to include other tests? So output is as from single JMX run? I
can't find anything close ion Jmeter site or wiki.

What is the best practice for this situation in general?

Thanks.
Joe.

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

RE: How to run multiple jmx files as single job?

Ian Blavins
G'day

Have a look at INCLUDE controllers.

There are a couple of drawbacks - an INCLUDE'd module can't include another so you can only go one level deep.

And unlike test plans which are uploaded from the controller to any remote JMeter slaves automatically INCLUDE modules aren't. You have to manually upload them.

I use INCLUDE modules to reduce the amount of test plan maintenance. I have all the hard work in the one, general purpose, INCLUDE module and my test plans are very simple. They just call the include module with some variable values set.



Ian Blavins
Software performance specialist
.
TEMENOS
The Banking Software Company
.
PeopleBuilding 2, Maylands Av
Hemel Hempstead   UK   HP2 4NW
.
T:  +44 (0) 1442 431 106
E:  [hidden email]
.
www.temenos.com
.
 Consider the environment. Please don't print this e-mail unless you really need to.


-----Original Message-----
From: Joe Kramer [mailto:[hidden email]]
Sent: Friday, 30 May 2008 2:48 PM
To: JMeter Users List
Subject: How to run multiple jmx files as single job?

Hello,

Looking for best practivce advice,

I have tests for different modules of application in multiple .jmx
files. Each module and corresponding .jmx file has 10+ test cases.
Keeping all tests in single file is not practical.
First, we have multiple developers/testers updating the tests at the
same time and conflict resolution in XML .jmx files is not as easy as
in Java source.
Second, it's difficult to navigate single file file with 100+ test cases.
Third, if you keep them in single file and design test case number
101, you either need to disable 100 previous cases or wait until 100
cases execute to see if case 101 works.

So we keep them grouped in separate files.
And the problem is: you have to set up complex batch file to run all
JMX files in sequence.
And second problem is that test reports are in separate files. You
have to publish every report separately, and browsing is very
frustrating task.

Is there a way to create "master" JMX file that has some kind of
"call" to include other tests? So output is as from single JMX run? I
can't find anything close ion Jmeter site or wiki.

What is the best practice for this situation in general?

Thanks.
Joe.

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: How to run multiple jmx files as single job?

Joe Kramer
Thanks for the tip!
I have two problems with Include controller:

One: is that it require absolute path to included jmx files. meaning
it's not portable between systems. I can't make it work with relative
path. e.g. if included jmx fiels in same directory. Is there a way?
Second: How to make it run included tests in sequence? Test afte test?
Configured to run as one thread it runs them interleaved.
What I get is: it does step1 from file1 then step1 from file2, then
step 2 from file1, etc.

Thanks!

On Fri, May 30, 2008 at 11:51 PM, Ian Blavins <[hidden email]> wrote:

> G'day
>
> Have a look at INCLUDE controllers.
>
> There are a couple of drawbacks - an INCLUDE'd module can't include another so you can only go one level deep.
>
> And unlike test plans which are uploaded from the controller to any remote JMeter slaves automatically INCLUDE modules aren't. You have to manually upload them.
>
> I use INCLUDE modules to reduce the amount of test plan maintenance. I have all the hard work in the one, general purpose, INCLUDE module and my test plans are very simple. They just call the include module with some variable values set.
>
>
>
> Ian Blavins
> Software performance specialist
> .
> TEMENOS
> The Banking Software Company
> .
> PeopleBuilding 2, Maylands Av
> Hemel Hempstead   UK   HP2 4NW
> .
> T:  +44 (0) 1442 431 106
> E:  [hidden email]
> .
> www.temenos.com
> .
>  Consider the environment. Please don't print this e-mail unless you really need to.
>
>
> -----Original Message-----
> From: Joe Kramer [mailto:[hidden email]]
> Sent: Friday, 30 May 2008 2:48 PM
> To: JMeter Users List
> Subject: How to run multiple jmx files as single job?
>
> Hello,
>
> Looking for best practivce advice,
>
> I have tests for different modules of application in multiple .jmx
> files. Each module and corresponding .jmx file has 10+ test cases.
> Keeping all tests in single file is not practical.
> First, we have multiple developers/testers updating the tests at the
> same time and conflict resolution in XML .jmx files is not as easy as
> in Java source.
> Second, it's difficult to navigate single file file with 100+ test cases.
> Third, if you keep them in single file and design test case number
> 101, you either need to disable 100 previous cases or wait until 100
> cases execute to see if case 101 works.
>
> So we keep them grouped in separate files.
> And the problem is: you have to set up complex batch file to run all
> JMX files in sequence.
> And second problem is that test reports are in separate files. You
> have to publish every report separately, and browsing is very
> frustrating task.
>
> Is there a way to create "master" JMX file that has some kind of
> "call" to include other tests? So output is as from single JMX run? I
> can't find anything close ion Jmeter site or wiki.
>
> What is the best practice for this situation in general?
>
> Thanks.
> Joe.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>
>
Reply | Threaded
Open this post in threaded view
|

RE: How to run multiple jmx files as single job?

Ian Blavins
G'day

1. Try using a drive mapping. Map the same drive letter on the different systems to the directory containing the test plans on that system. The paths will be different on each system but the path from the drive letter is the same on all and can be used as a portable path of the include module. If you are using Unix then use a link from the top level or from a location common to all the machines.

2. I'll leave to you. I do this but my solution isn't likely to be useful. (I have a general purpose Java sampler and on each call I pass it the path of the (SOAP) request to send. The rest of the test plan and include module is concerned with invoking the Java sampler the correct parameters to execute step 1 of test 1, step 2 of test 1, ... step 1 of test 2, ... etc.)



Ian Blavins
Software performance specialist
.
TEMENOS
The Banking Software Company
.
PeopleBuilding 2, Maylands Av
Hemel Hempstead   UK   HP2 4NW
.
T:  +44 (0) 1442 431 106
E:  [hidden email]
.
www.temenos.com
.
 Consider the environment. Please don't print this e-mail unless you really need to.


-----Original Message-----
From: Joe Kramer [mailto:[hidden email]]
Sent: Friday, 30 May 2008 3:29 PM
To: JMeter Users List
Subject: Re: How to run multiple jmx files as single job?

Thanks for the tip!
I have two problems with Include controller:

One: is that it require absolute path to included jmx files. meaning
it's not portable between systems. I can't make it work with relative
path. e.g. if included jmx fiels in same directory. Is there a way?
Second: How to make it run included tests in sequence? Test afte test?
Configured to run as one thread it runs them interleaved.
What I get is: it does step1 from file1 then step1 from file2, then
step 2 from file1, etc.

Thanks!

On Fri, May 30, 2008 at 11:51 PM, Ian Blavins <[hidden email]> wrote:

> G'day
>
> Have a look at INCLUDE controllers.
>
> There are a couple of drawbacks - an INCLUDE'd module can't include another so you can only go one level deep.
>
> And unlike test plans which are uploaded from the controller to any remote JMeter slaves automatically INCLUDE modules aren't. You have to manually upload them.
>
> I use INCLUDE modules to reduce the amount of test plan maintenance. I have all the hard work in the one, general purpose, INCLUDE module and my test plans are very simple. They just call the include module with some variable values set.
>
>
>
> Ian Blavins
> Software performance specialist
> .
> TEMENOS
> The Banking Software Company
> .
> PeopleBuilding 2, Maylands Av
> Hemel Hempstead   UK   HP2 4NW
> .
> T:  +44 (0) 1442 431 106
> E:  [hidden email]
> .
> www.temenos.com
> .
>  Consider the environment. Please don't print this e-mail unless you really need to.
>
>
> -----Original Message-----
> From: Joe Kramer [mailto:[hidden email]]
> Sent: Friday, 30 May 2008 2:48 PM
> To: JMeter Users List
> Subject: How to run multiple jmx files as single job?
>
> Hello,
>
> Looking for best practivce advice,
>
> I have tests for different modules of application in multiple .jmx
> files. Each module and corresponding .jmx file has 10+ test cases.
> Keeping all tests in single file is not practical.
> First, we have multiple developers/testers updating the tests at the
> same time and conflict resolution in XML .jmx files is not as easy as
> in Java source.
> Second, it's difficult to navigate single file file with 100+ test cases.
> Third, if you keep them in single file and design test case number
> 101, you either need to disable 100 previous cases or wait until 100
> cases execute to see if case 101 works.
>
> So we keep them grouped in separate files.
> And the problem is: you have to set up complex batch file to run all
> JMX files in sequence.
> And second problem is that test reports are in separate files. You
> have to publish every report separately, and browsing is very
> frustrating task.
>
> Is there a way to create "master" JMX file that has some kind of
> "call" to include other tests? So output is as from single JMX run? I
> can't find anything close ion Jmeter site or wiki.
>
> What is the best practice for this situation in general?
>
> Thanks.
> Joe.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>
>
Reply | Threaded
Open this post in threaded view
|

RE: How to run multiple jmx files as single job?

Steve Kapinos
In reply to this post by Joe Kramer
The path to the files does not have to be absolute - none of mine are.
Make sure the paths are relative to the working directory (where you
loaded jmeter) rather then just relative to where the original jmx file
is loaded from.

I use nant to execute jmeter calling a master jmx file which essentially
is just a logging setup and includes my test elements as separate
threadgroups.

-Steve

-----Original Message-----
From: Joe Kramer [mailto:[hidden email]]
Sent: Friday, May 30, 2008 10:29 AM
To: JMeter Users List
Subject: Re: How to run multiple jmx files as single job?

Thanks for the tip!
I have two problems with Include controller:

One: is that it require absolute path to included jmx files. meaning
it's not portable between systems. I can't make it work with relative
path. e.g. if included jmx fiels in same directory. Is there a way?
Second: How to make it run included tests in sequence? Test afte test?
Configured to run as one thread it runs them interleaved.
What I get is: it does step1 from file1 then step1 from file2, then step
2 from file1, etc.

Thanks!

On Fri, May 30, 2008 at 11:51 PM, Ian Blavins <[hidden email]>
wrote:
> G'day
>
> Have a look at INCLUDE controllers.
>
> There are a couple of drawbacks - an INCLUDE'd module can't include
another so you can only go one level deep.
>
> And unlike test plans which are uploaded from the controller to any
remote JMeter slaves automatically INCLUDE modules aren't. You have to
manually upload them.
>
> I use INCLUDE modules to reduce the amount of test plan maintenance. I
have all the hard work in the one, general purpose, INCLUDE module and
my test plans are very simple. They just call the include module with
some variable values set.

>
>
>
> Ian Blavins
> Software performance specialist
> .
> TEMENOS
> The Banking Software Company
> .
> PeopleBuilding 2, Maylands Av
> Hemel Hempstead   UK   HP2 4NW
> .
> T:  +44 (0) 1442 431 106
> E:  [hidden email]
> .
> www.temenos.com
> .
> P Consider the environment. Please don't print this e-mail unless you
really need to.

>
>
> -----Original Message-----
> From: Joe Kramer [mailto:[hidden email]]
> Sent: Friday, 30 May 2008 2:48 PM
> To: JMeter Users List
> Subject: How to run multiple jmx files as single job?
>
> Hello,
>
> Looking for best practivce advice,
>
> I have tests for different modules of application in multiple .jmx
> files. Each module and corresponding .jmx file has 10+ test cases.
> Keeping all tests in single file is not practical.
> First, we have multiple developers/testers updating the tests at the
> same time and conflict resolution in XML .jmx files is not as easy as
> in Java source.
> Second, it's difficult to navigate single file file with 100+ test
cases.

> Third, if you keep them in single file and design test case number
> 101, you either need to disable 100 previous cases or wait until 100
> cases execute to see if case 101 works.
>
> So we keep them grouped in separate files.
> And the problem is: you have to set up complex batch file to run all
> JMX files in sequence.
> And second problem is that test reports are in separate files. You
> have to publish every report separately, and browsing is very
> frustrating task.
>
> Is there a way to create "master" JMX file that has some kind of
> "call" to include other tests? So output is as from single JMX run? I
> can't find anything close ion Jmeter site or wiki.
>
> What is the best practice for this situation in general?
>
> Thanks.
> Joe.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [hidden email]
> For additional commands, e-mail: [hidden email]
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]