From norm.dressler at emergis.com Wed May 7 09:15:44 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Wed May 7 09:11:40 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? Message-ID: <1210176944.30670.33.camel@godzilla> As the topic says, I'm embarking on the development of test scripts for a SOAP application that uses Apache Tomcat and Axis. Are there any sample test kits or similar available for examples? Thanks Norm Dressler From frank at pushtotest.com Wed May 7 09:55:06 2008 From: frank at pushtotest.com (Frank Cohen) Date: Wed May 7 12:06:43 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: <1210176944.30670.33.camel@godzilla> References: <1210176944.30670.33.camel@godzilla> Message-ID: <35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com> Hi Norm: TestMaker 5.1 includes soapUI and tutorials on building simple test scripts for SOAP applications. Take a look in the docs directory. -Frank On May 7, 2008, at 9:15 AM, Norm Dressler wrote: > As the topic says, I'm embarking on the development of test scripts > for > a SOAP application that uses Apache Tomcat and Axis. > > Are there any sample test kits or similar available for examples? > > Thanks > Norm Dressler > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users From norm.dressler at emergis.com Wed May 7 12:29:19 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Wed May 7 12:25:31 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: <35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com> References: <1210176944.30670.33.camel@godzilla> <35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com> Message-ID: <1210188559.30670.47.camel@godzilla> I've been through a couple of them already - working through it. If I have questions I'll post them as I go. Thanks Norm On Wed, 2008-05-07 at 09:55 -0700, Frank Cohen wrote: > Hi Norm: > > TestMaker 5.1 includes soapUI and tutorials on building simple test > scripts for SOAP applications. Take a look in the docs directory. > > -Frank > > > On May 7, 2008, at 9:15 AM, Norm Dressler wrote: > > > As the topic says, I'm embarking on the development of test scripts > > for > > a SOAP application that uses Apache Tomcat and Axis. > > > > Are there any sample test kits or similar available for examples? > > > > Thanks > > Norm Dressler > > _______________________________________________ > > Users mailing list > > Users@lists.pushtotest.com > > http://lists.pushtotest.com/mailman/listinfo/users > > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users From norm.dressler at emergis.com Fri May 9 06:37:04 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Fri May 9 06:33:32 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: <35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com> References: <1210176944.30670.33.camel@godzilla> <35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com> Message-ID: <1210340224.6620.19.camel@godzilla> On Wed, 2008-05-07 at 09:55 -0700, Frank Cohen wrote: > Hi Norm: > > TestMaker 5.1 includes soapUI and tutorials on building simple test > scripts for SOAP applications. Take a look in the docs directory. > > -Frank > I was running through the tutorials (no problems there yet) but in there it points to the SoupUI Documentation with a link -- the link doesn't exist. Not locally or from the PushToTest web site. Where can I find the SoupUI Documentation? Thanks Norm From norm.dressler at emergis.com Wed May 14 08:50:27 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Wed May 14 08:48:19 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: <1210340224.6620.19.camel@godzilla> References: <1210176944.30670.33.camel@godzilla> <35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com> <1210340224.6620.19.camel@godzilla> Message-ID: <1210780227.6679.6.camel@norm-laptop> > > > > I was running through the tutorials (no problems there yet) but in there > it points to the SoupUI Documentation with a link -- the link doesn't > exist. Not locally or from the PushToTest web site. Where can I find > the SoupUI Documentation? > I'll try this email again -- where can I find the SoupUI documentation? Thanks! Norm From frank at pushtotest.com Thu May 15 09:57:38 2008 From: frank at pushtotest.com (Frank Cohen) Date: Thu May 15 09:54:39 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: <1210780227.6679.6.camel@norm-laptop> References: <1210176944.30670.33.camel@godzilla> <35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com> <1210340224.6620.19.camel@godzilla> <1210780227.6679.6.camel@norm-laptop> Message-ID: Hi Norm: Thanks for pointing out the broken link. We used to ship the soapUI docs with the TestMaker distribution but changed that so we could reduce the size of the download. The soapUI documentation is at: http://www.soapui.org/userguide/index.html We will update the link in TestMaker 5.2. -Frank On May 14, 2008, at 8:50 AM, Norm Dressler wrote: >>> >> >> I was running through the tutorials (no problems there yet) but in >> there >> it points to the SoupUI Documentation with a link -- the link doesn't >> exist. Not locally or from the PushToTest web site. Where can I >> find >> the SoupUI Documentation? >> > > I'll try this email again -- where can I find the SoupUI > documentation? > > Thanks! > Norm > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From norm.dressler at emergis.com Thu May 15 10:26:56 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Thu May 15 10:27:49 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: References: <1210176944.30670.33.camel@godzilla><35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com><1210340224.6620.19.camel@godzilla><1210780227.6679.6.camel@norm-laptop> Message-ID: Thanks Frank. I have my work cut out for me as I need to figure out how to inject dynamic data into a performance test. Norm -----Original Message----- From: users-bounces@lists.pushtotest.com [mailto:users-bounces@lists.pushtotest.com] On Behalf Of Frank Cohen Sent: Thursday, May 15, 2008 2:28 PM To: TestMaker users list Subject: Re: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? Hi Norm: Thanks for pointing out the broken link. We used to ship the soapUI docs with the TestMaker distribution but changed that so we could reduce the size of the download. The soapUI documentation is at: http://www.soapui.org/userguide/index.html We will update the link in TestMaker 5.2. -Frank On May 14, 2008, at 8:50 AM, Norm Dressler wrote: >>> >> >> I was running through the tutorials (no problems there yet) but in >> there >> it points to the SoupUI Documentation with a link -- the link doesn't >> exist. Not locally or from the PushToTest web site. Where can I >> find >> the SoupUI Documentation? >> > > I'll try this email again -- where can I find the SoupUI > documentation? > > Thanks! > Norm > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company _______________________________________________ Users mailing list Users@lists.pushtotest.com http://lists.pushtotest.com/mailman/listinfo/users From frank at pushtotest.com Thu May 15 12:09:22 2008 From: frank at pushtotest.com (Frank Cohen) Date: Thu May 15 12:06:21 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: References: <1210176944.30670.33.camel@godzilla><35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com><1210340224.6620.19.camel@godzilla><1210780227.6679.6.camel@norm-laptop> Message-ID: <72C89F43-6346-4C8A-A1CF-D04FD97E0691@pushtotest.com> Hi Norm: It's not that difficult with PushToTest and soapUI. We even have a new example in TestMaker 5.2 to accomplish a dynamic data-driven test. Look here: http://tinyurl.com/6ys8hc -Frank On May 15, 2008, at 10:26 AM, Norm Dressler wrote: > Thanks Frank. I have my work cut out for me as I need to figure > out how to inject dynamic data into a performance test. > > Norm > > -----Original Message----- > From: users-bounces@lists.pushtotest.com [mailto:users- > bounces@lists.pushtotest.com] On Behalf Of Frank Cohen > Sent: Thursday, May 15, 2008 2:28 PM > To: TestMaker users list > Subject: Re: [ptt-users] Performance Kit or Test kit for Apache > Tomcat/Axis? > > Hi Norm: > > Thanks for pointing out the broken link. We used to ship the soapUI > docs with the TestMaker distribution but changed that so we could > reduce the size of the download. > > The soapUI documentation is at: > http://www.soapui.org/userguide/index.html > > We will update the link in TestMaker 5.2. > > -Frank > > On May 14, 2008, at 8:50 AM, Norm Dressler wrote: > >>>> >>> >>> I was running through the tutorials (no problems there yet) but in >>> there >>> it points to the SoupUI Documentation with a link -- the link >>> doesn't >>> exist. Not locally or from the PushToTest web site. Where can I >>> find >>> the SoupUI Documentation? >>> >> >> I'll try this email again -- where can I find the SoupUI >> documentation? >> >> Thanks! >> Norm >> _______________________________________________ >> Users mailing list >> Users@lists.pushtotest.com >> http://lists.pushtotest.com/mailman/listinfo/users > > > > -- > Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 > PushToTest, the open-source test automation company > > > > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users From norm.dressler at emergis.com Thu May 15 12:19:17 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Thu May 15 12:17:02 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: <72C89F43-6346-4C8A-A1CF-D04FD97E0691@pushtotest.com> References: <1210176944.30670.33.camel@godzilla><35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com><1210340224.6620.19.camel@godzilla><1210780227.6679.6.camel@norm-laptop> <72C89F43-6346-4C8A-A1CF-D04FD97E0691@pushtotest.com> Message-ID: That looks very interesting. I was going through some other documentation that discussed the DPL functionality and it looked to be what I'm looking for. The scenario is a bit different though -- we have a SOAP-based interface that we are testing. There are 5 different message types which are lookups, etc., I want to be able to inject dynamic lookup parameters to the message before it is sent to the SOAP-based interface. Being able to scale that upwards to test the system's performance is key. We have test data already -- it can be in many different forms and it seems that you can map to CSV, which would work. I'm just not entirely certain (yet) how I would map that into the XML. Norm -----Original Message----- From: users-bounces@lists.pushtotest.com [mailto:users-bounces@lists.pushtotest.com] On Behalf Of Frank Cohen Sent: Thursday, May 15, 2008 4:39 PM To: TestMaker users list Subject: Re: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? Hi Norm: It's not that difficult with PushToTest and soapUI. We even have a new example in TestMaker 5.2 to accomplish a dynamic data-driven test. Look here: http://tinyurl.com/6ys8hc -Frank On May 15, 2008, at 10:26 AM, Norm Dressler wrote: > Thanks Frank. I have my work cut out for me as I need to figure > out how to inject dynamic data into a performance test. > > Norm > > -----Original Message----- > From: users-bounces@lists.pushtotest.com [mailto:users- > bounces@lists.pushtotest.com] On Behalf Of Frank Cohen > Sent: Thursday, May 15, 2008 2:28 PM > To: TestMaker users list > Subject: Re: [ptt-users] Performance Kit or Test kit for Apache > Tomcat/Axis? > > Hi Norm: > > Thanks for pointing out the broken link. We used to ship the soapUI > docs with the TestMaker distribution but changed that so we could > reduce the size of the download. > > The soapUI documentation is at: > http://www.soapui.org/userguide/index.html > > We will update the link in TestMaker 5.2. > > -Frank > > On May 14, 2008, at 8:50 AM, Norm Dressler wrote: > >>>> >>> >>> I was running through the tutorials (no problems there yet) but in >>> there >>> it points to the SoupUI Documentation with a link -- the link >>> doesn't >>> exist. Not locally or from the PushToTest web site. Where can I >>> find >>> the SoupUI Documentation? >>> >> >> I'll try this email again -- where can I find the SoupUI >> documentation? >> >> Thanks! >> Norm >> _______________________________________________ >> Users mailing list >> Users@lists.pushtotest.com >> http://lists.pushtotest.com/mailman/listinfo/users > > > > -- > Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 > PushToTest, the open-source test automation company > > > > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users _______________________________________________ Users mailing list Users@lists.pushtotest.com http://lists.pushtotest.com/mailman/listinfo/users From frank at pushtotest.com Thu May 15 12:48:43 2008 From: frank at pushtotest.com (Frank Cohen) Date: Thu May 15 12:45:44 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: References: <1210176944.30670.33.camel@godzilla><35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com><1210340224.6620.19.camel@godzilla><1210780227.6679.6.camel@norm-laptop> <72C89F43-6346-4C8A-A1CF-D04FD97E0691@pushtotest.com> Message-ID: <254842B5-646A-4670-834F-AD89DA45CC8B@pushtotest.com> Hi Norm: In your scenario I would look at writing a custom DPL to do the dynamic lookups at test execution time. A second approach would be to have a DPL provide the data to a Groovy script in soapUI and do the processing in Groovy. -Frank On May 15, 2008, at 12:19 PM, Norm Dressler wrote: > That looks very interesting. I was going through some other > documentation that discussed the DPL functionality and it looked to > be what I'm looking for. > > The scenario is a bit different though -- we have a SOAP-based > interface that we are testing. There are 5 different message types > which are lookups, etc., I want to be able to inject dynamic lookup > parameters to the message before it is sent to the SOAP-based > interface. Being able to scale that > upwards to test the system's performance is key. > > We have test data already -- it can be in many different forms and > it seems that you can map to CSV, which would work. I'm just not > entirely certain (yet) how I would map that into the XML. > > Norm > > -----Original Message----- > From: users-bounces@lists.pushtotest.com [mailto:users- > bounces@lists.pushtotest.com] On Behalf Of Frank Cohen > Sent: Thursday, May 15, 2008 4:39 PM > To: TestMaker users list > Subject: Re: [ptt-users] Performance Kit or Test kit for Apache > Tomcat/Axis? > > Hi Norm: > > It's not that difficult with PushToTest and soapUI. We even have a > new example in TestMaker 5.2 to accomplish a dynamic data-driven test. > > Look here: > http://tinyurl.com/6ys8hc > > -Frank > > > > On May 15, 2008, at 10:26 AM, Norm Dressler wrote: > >> Thanks Frank. I have my work cut out for me as I need to figure >> out how to inject dynamic data into a performance test. >> >> Norm >> >> -----Original Message----- >> From: users-bounces@lists.pushtotest.com [mailto:users- >> bounces@lists.pushtotest.com] On Behalf Of Frank Cohen >> Sent: Thursday, May 15, 2008 2:28 PM >> To: TestMaker users list >> Subject: Re: [ptt-users] Performance Kit or Test kit for Apache >> Tomcat/Axis? >> >> Hi Norm: >> >> Thanks for pointing out the broken link. We used to ship the soapUI >> docs with the TestMaker distribution but changed that so we could >> reduce the size of the download. >> >> The soapUI documentation is at: >> http://www.soapui.org/userguide/index.html >> >> We will update the link in TestMaker 5.2. >> >> -Frank >> >> On May 14, 2008, at 8:50 AM, Norm Dressler wrote: >> >>>>> >>>> >>>> I was running through the tutorials (no problems there yet) but in >>>> there >>>> it points to the SoupUI Documentation with a link -- the link >>>> doesn't >>>> exist. Not locally or from the PushToTest web site. Where can I >>>> find >>>> the SoupUI Documentation? >>>> >>> >>> I'll try this email again -- where can I find the SoupUI >>> documentation? >>> >>> Thanks! >>> Norm >>> _______________________________________________ >>> Users mailing list >>> Users@lists.pushtotest.com >>> http://lists.pushtotest.com/mailman/listinfo/users >> >> >> >> -- >> Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 >> PushToTest, the open-source test automation company >> >> >> >> _______________________________________________ >> Users mailing list >> Users@lists.pushtotest.com >> http://lists.pushtotest.com/mailman/listinfo/users >> _______________________________________________ >> Users mailing list >> Users@lists.pushtotest.com >> http://lists.pushtotest.com/mailman/listinfo/users > > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users From norm.dressler at emergis.com Fri May 16 09:23:18 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Fri May 16 09:20:37 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: <254842B5-646A-4670-834F-AD89DA45CC8B@pushtotest.com> References: <1210176944.30670.33.camel@godzilla> <35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com> <1210340224.6620.19.camel@godzilla><1210780227.6679.6.camel@norm-laptop> <72C89F43-6346-4C8A-A1CF-D04FD97E0691@pushtotest.com> <254842B5-646A-4670-834F-AD89DA45CC8B@pushtotest.com> Message-ID: <1210954998.15701.5.camel@norm-laptop> By using a script to pull dynamic data, will the nodes/processes be able to process several thousand lookups and simulate 200 users? I imagine I would need several test nodes but I'm looking to get enough random data lookups to not only test the SOAP response times but it will also test the application and database response times. Could I just as easily write this in Python as opposed to Groovy? What other scripting languages are supported? I know Perl very well, as an example. Thanks Norm On Thu, 2008-05-15 at 12:48 -0700, Frank Cohen wrote: > Hi Norm: > > In your scenario I would look at writing a custom DPL to do the > dynamic lookups at test execution time. A second approach would be to > have a DPL provide the data to a Groovy script in soapUI and do the > processing in Groovy. > > -Frank > > > > On May 15, 2008, at 12:19 PM, Norm Dressler wrote: > > > That looks very interesting. I was going through some other > > documentation that discussed the DPL functionality and it looked to > > be what I'm looking for. > > > > The scenario is a bit different though -- we have a SOAP-based > > interface that we are testing. There are 5 different message types > > which are lookups, etc., I want to be able to inject dynamic lookup > > parameters to the message before it is sent to the SOAP-based > > interface. Being able to scale that > > upwards to test the system's performance is key. > > > > We have test data already -- it can be in many different forms and > > it seems that you can map to CSV, which would work. I'm just not > > entirely certain (yet) how I would map that into the XML. > > > > Norm > > > > -----Original Message----- > > From: users-bounces@lists.pushtotest.com [mailto:users- > > bounces@lists.pushtotest.com] On Behalf Of Frank Cohen > > Sent: Thursday, May 15, 2008 4:39 PM > > To: TestMaker users list > > Subject: Re: [ptt-users] Performance Kit or Test kit for Apache > > Tomcat/Axis? > > > > Hi Norm: > > > > It's not that difficult with PushToTest and soapUI. We even have a > > new example in TestMaker 5.2 to accomplish a dynamic data-driven test. > > > > Look here: > > http://tinyurl.com/6ys8hc > > > > -Frank > > > > > > > > On May 15, 2008, at 10:26 AM, Norm Dressler wrote: > > > >> Thanks Frank. I have my work cut out for me as I need to figure > >> out how to inject dynamic data into a performance test. > >> > >> Norm > >> > >> -----Original Message----- > >> From: users-bounces@lists.pushtotest.com [mailto:users- > >> bounces@lists.pushtotest.com] On Behalf Of Frank Cohen > >> Sent: Thursday, May 15, 2008 2:28 PM > >> To: TestMaker users list > >> Subject: Re: [ptt-users] Performance Kit or Test kit for Apache > >> Tomcat/Axis? > >> > >> Hi Norm: > >> > >> Thanks for pointing out the broken link. We used to ship the soapUI > >> docs with the TestMaker distribution but changed that so we could > >> reduce the size of the download. > >> > >> The soapUI documentation is at: > >> http://www.soapui.org/userguide/index.html > >> > >> We will update the link in TestMaker 5.2. > >> > >> -Frank > >> > >> On May 14, 2008, at 8:50 AM, Norm Dressler wrote: > >> > >>>>> > >>>> > >>>> I was running through the tutorials (no problems there yet) but in > >>>> there > >>>> it points to the SoupUI Documentation with a link -- the link > >>>> doesn't > >>>> exist. Not locally or from the PushToTest web site. Where can I > >>>> find > >>>> the SoupUI Documentation? > >>>> > >>> > >>> I'll try this email again -- where can I find the SoupUI > >>> documentation? > >>> > >>> Thanks! > >>> Norm > >>> _______________________________________________ > >>> Users mailing list > >>> Users@lists.pushtotest.com > >>> http://lists.pushtotest.com/mailman/listinfo/users > >> > >> > >> > >> -- > >> Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 > >> PushToTest, the open-source test automation company > >> > >> > >> > >> _______________________________________________ > >> Users mailing list > >> Users@lists.pushtotest.com > >> http://lists.pushtotest.com/mailman/listinfo/users > >> _______________________________________________ > >> Users mailing list > >> Users@lists.pushtotest.com > >> http://lists.pushtotest.com/mailman/listinfo/users > > > > _______________________________________________ > > Users mailing list > > Users@lists.pushtotest.com > > http://lists.pushtotest.com/mailman/listinfo/users > > _______________________________________________ > > Users mailing list > > Users@lists.pushtotest.com > > http://lists.pushtotest.com/mailman/listinfo/users > > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users From norm.dressler at emergis.com Tue May 20 05:34:15 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Tue May 20 05:32:28 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: <1210954998.15701.5.camel@norm-laptop> References: <1210176944.30670.33.camel@godzilla> <35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com> <1210340224.6620.19.camel@godzilla><1210780227.6679.6.camel@norm-laptop> <72C89F43-6346-4C8A-A1CF-D04FD97E0691@pushtotest.com> <254842B5-646A-4670-834F-AD89DA45CC8B@pushtotest.com> <1210954998.15701.5.camel@norm-laptop> Message-ID: <1211286855.26105.2.camel@godzilla> Trying again... On Fri, 2008-05-16 at 13:53 -0230, Norm Dressler wrote: > By using a script to pull dynamic data, will the nodes/processes be able > to process several thousand lookups and simulate 200 users? I imagine I > would need several test nodes but I'm looking to get enough random data > lookups to not only test the SOAP response times but it will also test > the application and database response times. > > Could I just as easily write this in Python as opposed to Groovy? What > other scripting languages are supported? I know Perl very well, as an > example. > > Thanks > Norm > > On Thu, 2008-05-15 at 12:48 -0700, Frank Cohen wrote: > > Hi Norm: > > > > In your scenario I would look at writing a custom DPL to do the > > dynamic lookups at test execution time. A second approach would be to > > have a DPL provide the data to a Groovy script in soapUI and do the > > processing in Groovy. > > > > -Frank > > > > > > > > On May 15, 2008, at 12:19 PM, Norm Dressler wrote: > > > > > That looks very interesting. I was going through some other > > > documentation that discussed the DPL functionality and it looked to > > > be what I'm looking for. > > > > > > The scenario is a bit different though -- we have a SOAP-based > > > interface that we are testing. There are 5 different message types > > > which are lookups, etc., I want to be able to inject dynamic lookup > > > parameters to the message before it is sent to the SOAP-based > > > interface. Being able to scale that > > > upwards to test the system's performance is key. > > > > > > We have test data already -- it can be in many different forms and > > > it seems that you can map to CSV, which would work. I'm just not > > > entirely certain (yet) how I would map that into the XML. > > > > > > Norm > > > > > > -----Original Message----- > > > From: users-bounces@lists.pushtotest.com [mailto:users- > > > bounces@lists.pushtotest.com] On Behalf Of Frank Cohen > > > Sent: Thursday, May 15, 2008 4:39 PM > > > To: TestMaker users list > > > Subject: Re: [ptt-users] Performance Kit or Test kit for Apache > > > Tomcat/Axis? > > > > > > Hi Norm: > > > > > > It's not that difficult with PushToTest and soapUI. We even have a > > > new example in TestMaker 5.2 to accomplish a dynamic data-driven test. > > > > > > Look here: > > > http://tinyurl.com/6ys8hc > > > > > > -Frank > > > > > > > > > > > > On May 15, 2008, at 10:26 AM, Norm Dressler wrote: > > > > > >> Thanks Frank. I have my work cut out for me as I need to figure > > >> out how to inject dynamic data into a performance test. > > >> > > >> Norm > > >> > > >> -----Original Message----- > > >> From: users-bounces@lists.pushtotest.com [mailto:users- > > >> bounces@lists.pushtotest.com] On Behalf Of Frank Cohen > > >> Sent: Thursday, May 15, 2008 2:28 PM > > >> To: TestMaker users list > > >> Subject: Re: [ptt-users] Performance Kit or Test kit for Apache > > >> Tomcat/Axis? > > >> > > >> Hi Norm: > > >> > > >> Thanks for pointing out the broken link. We used to ship the soapUI > > >> docs with the TestMaker distribution but changed that so we could > > >> reduce the size of the download. > > >> > > >> The soapUI documentation is at: > > >> http://www.soapui.org/userguide/index.html > > >> > > >> We will update the link in TestMaker 5.2. > > >> > > >> -Frank > > >> > > >> On May 14, 2008, at 8:50 AM, Norm Dressler wrote: > > >> > > >>>>> > > >>>> > > >>>> I was running through the tutorials (no problems there yet) but in > > >>>> there > > >>>> it points to the SoupUI Documentation with a link -- the link > > >>>> doesn't > > >>>> exist. Not locally or from the PushToTest web site. Where can I > > >>>> find > > >>>> the SoupUI Documentation? > > >>>> > > >>> > > >>> I'll try this email again -- where can I find the SoupUI > > >>> documentation? > > >>> > > >>> Thanks! > > >>> Norm > > >>> _______________________________________________ > > >>> Users mailing list > > >>> Users@lists.pushtotest.com > > >>> http://lists.pushtotest.com/mailman/listinfo/users > > >> > > >> > > >> > > >> -- > > >> Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 > > >> PushToTest, the open-source test automation company > > >> > > >> > > >> > > >> _______________________________________________ > > >> Users mailing list > > >> Users@lists.pushtotest.com > > >> http://lists.pushtotest.com/mailman/listinfo/users > > >> _______________________________________________ > > >> Users mailing list > > >> Users@lists.pushtotest.com > > >> http://lists.pushtotest.com/mailman/listinfo/users > > > > > > _______________________________________________ > > > Users mailing list > > > Users@lists.pushtotest.com > > > http://lists.pushtotest.com/mailman/listinfo/users > > > _______________________________________________ > > > Users mailing list > > > Users@lists.pushtotest.com > > > http://lists.pushtotest.com/mailman/listinfo/users > > > > _______________________________________________ > > Users mailing list > > Users@lists.pushtotest.com > > http://lists.pushtotest.com/mailman/listinfo/users > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users From frank at pushtotest.com Fri May 23 11:20:24 2008 From: frank at pushtotest.com (Frank Cohen) Date: Fri May 23 11:19:35 2008 Subject: [ptt-users] Performance Kit or Test kit for Apache Tomcat/Axis? In-Reply-To: <1210954998.15701.5.camel@norm-laptop> References: <1210176944.30670.33.camel@godzilla> <35B0C7E1-CDBB-4E8A-9F5B-BE342D940D9A@pushtotest.com> <1210340224.6620.19.camel@godzilla><1210780227.6679.6.camel@norm-laptop> <72C89F43-6346-4C8A-A1CF-D04FD97E0691@pushtotest.com> <254842B5-646A-4670-834F-AD89DA45CC8B@pushtotest.com> <1210954998.15701.5.camel@norm-laptop> Message-ID: Hi Norm: I'm sorry for the long delay in responding to your question. Pulling dynamic data over a Gigibit ethernet network with modern processors (>3 Ghz) presents no problem to get up to thousands of users. soapUI supports Groovy as its domain specific language (DSL.) PushToTest orchestrates test use cases written in a variety of languages. We use the Java 6 ScriptEngine API. It supports JRuby, Perl, PHP, etc. This enables end-to-end testing. See the following for an example where a test use case runs a soapUI test, then a JUnit TestCase written in Jython. -Frank On May 16, 2008, at 9:23 AM, Norm Dressler wrote: > By using a script to pull dynamic data, will the nodes/processes be > able > to process several thousand lookups and simulate 200 users? I > imagine I > would need several test nodes but I'm looking to get enough random > data > lookups to not only test the SOAP response times but it will also test > the application and database response times. > > Could I just as easily write this in Python as opposed to Groovy? > What > other scripting languages are supported? I know Perl very well, as an > example. > > Thanks > Norm > > On Thu, 2008-05-15 at 12:48 -0700, Frank Cohen wrote: >> Hi Norm: >> >> In your scenario I would look at writing a custom DPL to do the >> dynamic lookups at test execution time. A second approach would be to >> have a DPL provide the data to a Groovy script in soapUI and do the >> processing in Groovy. >> >> -Frank >> >> >> >> On May 15, 2008, at 12:19 PM, Norm Dressler wrote: >> >>> That looks very interesting. I was going through some other >>> documentation that discussed the DPL functionality and it looked to >>> be what I'm looking for. >>> >>> The scenario is a bit different though -- we have a SOAP-based >>> interface that we are testing. There are 5 different message types >>> which are lookups, etc., I want to be able to inject dynamic lookup >>> parameters to the message before it is sent to the SOAP-based >>> interface. Being able to scale that >>> upwards to test the system's performance is key. >>> >>> We have test data already -- it can be in many different forms and >>> it seems that you can map to CSV, which would work. I'm just not >>> entirely certain (yet) how I would map that into the XML. >>> >>> Norm >>> >>> -----Original Message----- >>> From: users-bounces@lists.pushtotest.com [mailto:users- >>> bounces@lists.pushtotest.com] On Behalf Of Frank Cohen >>> Sent: Thursday, May 15, 2008 4:39 PM >>> To: TestMaker users list >>> Subject: Re: [ptt-users] Performance Kit or Test kit for Apache >>> Tomcat/Axis? >>> >>> Hi Norm: >>> >>> It's not that difficult with PushToTest and soapUI. We even have a >>> new example in TestMaker 5.2 to accomplish a dynamic data-driven >>> test. >>> >>> Look here: >>> http://tinyurl.com/6ys8hc >>> >>> -Frank >>> >>> >>> >>> On May 15, 2008, at 10:26 AM, Norm Dressler wrote: >>> >>>> Thanks Frank. I have my work cut out for me as I need to figure >>>> out how to inject dynamic data into a performance test. >>>> >>>> Norm >>>> >>>> -----Original Message----- >>>> From: users-bounces@lists.pushtotest.com [mailto:users- >>>> bounces@lists.pushtotest.com] On Behalf Of Frank Cohen >>>> Sent: Thursday, May 15, 2008 2:28 PM >>>> To: TestMaker users list >>>> Subject: Re: [ptt-users] Performance Kit or Test kit for Apache >>>> Tomcat/Axis? >>>> >>>> Hi Norm: >>>> >>>> Thanks for pointing out the broken link. We used to ship the soapUI >>>> docs with the TestMaker distribution but changed that so we could >>>> reduce the size of the download. >>>> >>>> The soapUI documentation is at: >>>> http://www.soapui.org/userguide/index.html >>>> >>>> We will update the link in TestMaker 5.2. >>>> >>>> -Frank >>>> >>>> On May 14, 2008, at 8:50 AM, Norm Dressler wrote: >>>> >>>>>>> >>>>>> >>>>>> I was running through the tutorials (no problems there yet) >>>>>> but in >>>>>> there >>>>>> it points to the SoupUI Documentation with a link -- the link >>>>>> doesn't >>>>>> exist. Not locally or from the PushToTest web site. Where can I >>>>>> find >>>>>> the SoupUI Documentation? >>>>>> >>>>> >>>>> I'll try this email again -- where can I find the SoupUI >>>>> documentation? >>>>> >>>>> Thanks! >>>>> Norm >>>>> _______________________________________________ >>>>> Users mailing list >>>>> Users@lists.pushtotest.com >>>>> http://lists.pushtotest.com/mailman/listinfo/users >>>> >>>> >>>> >>>> -- >>>> Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 >>>> PushToTest, the open-source test automation company >>>> >>>> >>>> >>>> _______________________________________________ >>>> Users mailing list >>>> Users@lists.pushtotest.com >>>> http://lists.pushtotest.com/mailman/listinfo/users >>>> _______________________________________________ >>>> Users mailing list >>>> Users@lists.pushtotest.com >>>> http://lists.pushtotest.com/mailman/listinfo/users >>> >>> _______________________________________________ >>> Users mailing list >>> Users@lists.pushtotest.com >>> http://lists.pushtotest.com/mailman/listinfo/users >>> _______________________________________________ >>> Users mailing list >>> Users@lists.pushtotest.com >>> http://lists.pushtotest.com/mailman/listinfo/users >> >> _______________________________________________ >> Users mailing list >> Users@lists.pushtotest.com >> http://lists.pushtotest.com/mailman/listinfo/users > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users From tyrone.butter at gmail.com Tue May 27 23:45:20 2008 From: tyrone.butter at gmail.com (Tyrone Butter) Date: Tue May 27 23:39:36 2008 Subject: [ptt-users] IP Aliasing Message-ID: <91635c860805272345t75fd09a4x218f6d7d3548c842@mail.gmail.com> Hi All, Hopefully this isn't too silly a question but I have been investigating using TestMaker for the testing of one of our systems. This system allows for multiple users but makes the restriction that these users all require unique IP addresses. Is there anything in TestMaker that facilitates this? If yes, then how would I go about doing this? Ideally I'd like to be able to record a test then have multiple concurrent users perform the test with the system seeing each user as having a unique IP, I am open to suggestions. Thanks for any assistance, Tyrone -------------- next part -------------- An HTML attachment was scrubbed... URL: http://cake.pushtotest.com/pipermail/users/attachments/20080528/c00c0deb/attachment.htm From norm.dressler at emergis.com Wed May 28 10:48:50 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Wed May 28 10:43:14 2008 Subject: [ptt-users] Help with Xpath Message-ID: <1211996930.28755.1.camel@norm-laptop> My xml snippit looks like this: In the Properties Transfer, if I put //hl7:clientIDPub//hl7:value it injects the value so I know its finding the clientIDPub. I want it to inject the value into extension. How do I define the xpath for that? Thanks for any help. Norm From norm.dressler at emergis.com Wed May 28 10:50:30 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Wed May 28 10:44:52 2008 Subject: [ptt-users] IP Aliasing In-Reply-To: <91635c860805272345t75fd09a4x218f6d7d3548c842@mail.gmail.com> References: <91635c860805272345t75fd09a4x218f6d7d3548c842@mail.gmail.com> Message-ID: <1211997030.28755.4.camel@norm-laptop> Not sure if this is the right answer but you can run agents on multiple machines if that is what you mean - that will allow you to run the tests from multiple IP's. Now if you are talking a large quantity of 'users' with unique IP's then I'm not sure. Norm On Wed, 2008-05-28 at 16:45 +1000, Tyrone Butter wrote: > Hi All, > > Hopefully this isn't too silly a question but I have been > investigating using TestMaker for the testing of one of our systems. > This system allows for multiple users but makes the restriction that > these users all require unique IP addresses. Is there anything in > TestMaker that facilitates this? If yes, then how would I go about > doing this? Ideally I'd like to be able to record a test then have > multiple concurrent users perform the test with the system seeing each > user as having a unique IP, I am open to suggestions. > > Thanks for any assistance, > > Tyrone > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users From frank at pushtotest.com Wed May 28 11:24:36 2008 From: frank at pushtotest.com (Frank Cohen) Date: Wed May 28 11:19:01 2008 Subject: [ptt-users] IP Aliasing In-Reply-To: <91635c860805272345t75fd09a4x218f6d7d3548c842@mail.gmail.com> References: <91635c860805272345t75fd09a4x218f6d7d3548c842@mail.gmail.com> Message-ID: Hi Tyrone: Some ideas come to mind: TestMaker is a distributed environment. TestNodes operate on remote machines, and each machine has its own network interface and address. This works out of the box. The other ideas require changes to TestMaker: TestMaker is a 100% Java application. There are ways to set the source IP address for outgoing datagrams using IP multihoming. There are also ways to spoof the outgoing IP address. But these are guarded in the same way that characters in Harry Potter avoid saying he-who-will-not-be-named. We've had requests to let simulated users (CRs) running in a TestMaker load and performance test each use a different IP address. We have an engineer available to add this capability to TestMaker. This would require 2-3 days of consulting time. -Frank On May 27, 2008, at 11:45 PM, Tyrone Butter wrote: > Hi All, > > Hopefully this isn't too silly a question but I have been > investigating using TestMaker for the testing of one of our systems. > This system allows for multiple users but makes the restriction that > these users all require unique IP addresses. Is there anything in > TestMaker that facilitates this? If yes, then how would I go about > doing this? Ideally I'd like to be able to record a test then have > multiple concurrent users perform the test with the system seeing > each user as having a unique IP, I am open to suggestions. > > Thanks for any assistance, > > Tyrone > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From norm.dressler at emergis.com Wed May 28 12:09:26 2008 From: norm.dressler at emergis.com (Norm Dressler) Date: Wed May 28 12:03:52 2008 Subject: [ptt-users] Re: Help with Xpath In-Reply-To: <1211996930.28755.1.camel@norm-laptop> References: <1211996930.28755.1.camel@norm-laptop> Message-ID: <1212001766.28755.9.camel@norm-laptop> I figured out the xpath. syntax is everything :) Now if only I can figure out the response xpath correctly -- its not quite the same and returning null. Header is like this: ... <--------- ... To do a property transfer for typeCode in the response, what would the xpath be? Norm On Wed, 2008-05-28 at 15:18 -0230, Norm Dressler wrote: > My xml snippit looks like this: > > displayable="true"> > > > In the Properties Transfer, if I put //hl7:clientIDPub//hl7:value it > injects the value so I know its finding the clientIDPub. I want it to > inject the value into extension. How do I define the xpath for that? > > Thanks for any help. > > Norm From tyrone.butter at gmail.com Wed May 28 15:36:53 2008 From: tyrone.butter at gmail.com (Tyrone Butter) Date: Wed May 28 15:31:21 2008 Subject: [ptt-users] IP Aliasing In-Reply-To: References: <91635c860805272345t75fd09a4x218f6d7d3548c842@mail.gmail.com> Message-ID: <91635c860805281536r78f0fc9enb9d170af19843108@mail.gmail.com> I appreciate the answers. We had already looked at setting up multiple virtual machines and running agents on each of those which as has been suggested, would work. Unfortunately that would not give us enough machines to test the system on the scale it could possibly require. The idea of IP spoofing (if that is the write terminology) sounds more along the lines of what would work for us. It seems a lot of the major expensive testing tools have some form of IP aliasing, but they have the quite obvious drawback of being very expensive. If this facility could be added to TestMaker then that would be off interest. If you could perhaps email me some sort of an idea of how the process of requesting this change would work so we can adjudicate whether that would be an appropriate option. Thanks for the replies. On Thu, May 29, 2008 at 4:24 AM, Frank Cohen wrote: > Hi Tyrone: > > Some ideas come to mind: > > TestMaker is a distributed environment. TestNodes operate on remote > machines, and each machine has its own network interface and address. This > works out of the box. > > The other ideas require changes to TestMaker: > > TestMaker is a 100% Java application. There are ways to set the source IP > address for outgoing datagrams using IP multihoming. > > There are also ways to spoof the outgoing IP address. But these are guarded > in the same way that characters in Harry Potter avoid saying > he-who-will-not-be-named. > > We've had requests to let simulated users (CRs) running in a TestMaker load > and performance test each use a different IP address. We have an engineer > available to add this capability to TestMaker. This would require 2-3 days > of consulting time. > > -Frank > > > > On May 27, 2008, at 11:45 PM, Tyrone Butter wrote: > > Hi All, >> >> Hopefully this isn't too silly a question but I have been investigating >> using TestMaker for the testing of one of our systems. This system allows >> for multiple users but makes the restriction that these users all require >> unique IP addresses. Is there anything in TestMaker that facilitates this? >> If yes, then how would I go about doing this? Ideally I'd like to be able to >> record a test then have multiple concurrent users perform the test with the >> system seeing each user as having a unique IP, I am open to suggestions. >> >> Thanks for any assistance, >> >> Tyrone >> _______________________________________________ >> Users mailing list >> Users@lists.pushtotest.com >> http://lists.pushtotest.com/mailman/listinfo/users >> > > > > -- > Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 > PushToTest, the open-source test automation company > > > > > _______________________________________________ > Users mailing list > Users@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/users > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://cake.pushtotest.com/pipermail/users/attachments/20080529/f266c7da/attachment.htm