From frank at pushtotest.com Fri May 2 06:45:04 2008 From: frank at pushtotest.com (Frank Cohen) Date: Fri May 2 06:38:52 2008 Subject: [Dev] Closed ticket 233 - Sleeptime problem Message-ID: FYI. I confirmed ticket 223, the sleeptime problem, is fixed. Good job everyone. -Frank -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From frank at pushtotest.com Sat May 3 09:48:29 2008 From: frank at pushtotest.com (Frank Cohen) Date: Sat May 3 09:42:32 2008 Subject: [Dev] Chart problem: Periods problem Message-ID: <057495BF-2D0E-439E-A9DE-1F894E74A6B6@pushtotest.com> Hi William and Luis Carlos: I tried adding a new chart to the TestScenario below and get: Recorder: java.lang.NumberFormatException: null java.lang.NumberFormatException: null at java.lang.Integer.parseInt(Integer.java:415) at java.lang.Integer.parseInt(Integer.java:497) at com.pushtotest.testmaker.XSTest.tally.PeriodsDataProvider.generateOption s(PeriodsDataProvider.java:168) at com.pushtotest.testmaker.XSTest.tally.GUI.checkAndUpdateAUX (GUI.java:1039) at com.pushtotest.testmaker.XSTest.tally.GUI.access$1600(GUI.java:92) at com.pushtotest.testmaker.XSTest.tally.GUI$checkandupdate.run (GUI.java:992) The chart I am adding is: Y=Duration Average X=Periods Series=Steps I get the exception when I save. I suspect this is one of my code changes to enable the Periods alert box to appear centered in the Chart Settings panel. -Frank -- Sleep Test . NET CPU MEM Usecase Target Node Data Index -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From frank at pushtotest.com Mon May 5 14:44:51 2008 From: frank at pushtotest.com (Frank Cohen) Date: Mon May 5 14:39:26 2008 Subject: [Dev] Results Analysis remaining issues (Ticket 188) Message-ID: Hi William and Luis Carlos: Please let me know where things stand on the following Results Engine issues (Ticket 188): Create a new chart, run a load test scenario, click the magnify icon on the chart, make some changes, choose save. At this point TM should ask the user if they want TM to rerun the results. For a chart setting that generates tabbed charts, the vertical scale needs to be the same for all of the tabs. When a chart setting includes Steps and the TestScenario has step="false" or has no step attribute, the user needs to get a warning message. CRL = Users. Please change this. The drop-down menu for saving a chart definition to the current TestScenario or TestMaker was a bad idea. Please change this to buttons. When I edit a chart definition and change its name then clicking Save creates a new chart definition. I don't see the progress/abort controls while TM updates a chart. Does this work? When I edit a chart definition and click the save button, if the chart uses Periods, the chart updates and the contents are always empty. I set up a chart with Duration Average -> Node and clicked Usecase and CRL. Question 1: should the checkboxes actually be radio buttons (meaning you can only select one?) Question 2: What should this report contain? I click the + icon from the controller panel, enter a chart name, Duration Average, Periods, click Steps, select Stacked Bars, click save, then click Magnify icon. I see the Graph Type is set to Bars. I can't get it to register for Stacked Bars. -Frank -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From frank at pushtotest.com Mon May 5 21:45:39 2008 From: frank at pushtotest.com (Frank Cohen) Date: Mon May 5 21:40:22 2008 Subject: [Dev] Results Analysis remaining issues (Ticket 188) References: <85A61B0FDDD4834EA295605C349BABAAE3D66E@dc1avantica.AVANTICA.AVANTICATEC.NET> Message-ID: <8A2B298D-D5C9-43BE-A7BF-A7872FF2C02F@pushtotest.com> Hi Everyone: See Luis Carlos' status update. We're going to work through these from the top of the list down. Feel free to jump in. -Frank Begin forwarded message: > From: Luis Carlos Lara L?pez > Date: May 5, 2008 6:02:34 PM PDT > To: "Frank Cohen" , William Mart?nez Pomares > , "Luigi Martin Salazar Sosa" > > Subject: Status: RE: [Dev] Results Analysis remaining issues > (Ticket 188) > > Create a new chart, run a load test scenario, click the magnify > icon on the chart, make some changes, choose save. At this point TM > should ask the user if they want TM to rerun the results. > unfinished > > For a chart setting that generates tabbed charts, the vertical > scale needs to be the same for all of the tabs. > unfinished > > When a chart setting includes Steps and the TestScenario has > step="false" or has no step attribute, the user needs to get a > warning unfinished > Not yet > > CRL = Users. Please change this. > Done > > The drop-down menu for saving a chart definition to the current > TestScenario or TestMaker was a bad idea. Please change this to > buttons. > unfinished > > When I edit a chart definition and change its name then clicking > Save creates a new chart definition. > unfinished > > > I don't see the progress/abort controls while TM updates a chart. > Does this work? > It is working. IN most of the test the processing takes to small > amount of time, you won't see it. > > > I set up a chart with Duration Average -> Node and clicked Usecase > and CRL. > Question 1: should the checkboxes actually be radio buttons > (meaning you can only select one?) > Yep, there is an error there. The user can only select a type. > We are not using radiobuttons. The current technique is that when > there are series combination that don't work, the system will make > uselectable the series that doesn't make sense > e.g. If you select the > - Y Duration Average > - X Node > - Series CRL. > Then the system will make USECASE, DATA INDEX uselectable. > > > Question 2: What should this report contain? > This report is known as the fastest testnetwork node. It is a > comparison of nodes average transaction duration (excluding the > target) in the usescases. > > I click the + icon from the controller panel, enter a chart name, > Duration Average, Periods, click Steps, select Stacked Bars, click > save, then click Magnify icon. I see the Graph Type is set to Bars. > I can't get it to register for Stacked Bars. > unfinished > > > LC > > -----Original Message----- > From: dev-bounces@lists.pushtotest.com [mailto:dev- > bounces@lists.pushtotest.com] On Behalf Of Frank Cohen > Sent: Monday, May 05, 2008 3:45 PM > To: PushToTest TestMaker Developers List > Subject: [Dev] Results Analysis remaining issues (Ticket 188) > > Hi William and Luis Carlos: > > Please let me know where things stand on the following Results > Engine issues (Ticket 188): > > Create a new chart, run a load test scenario, click the magnify > icon on the chart, make some changes, choose save. At this point TM > should ask the user if they want TM to rerun the results. > > For a chart setting that generates tabbed charts, the vertical > scale needs to be the same for all of the tabs. > > When a chart setting includes Steps and the TestScenario has > step="false" or has no step attribute, the user needs to get a > warning message. > > CRL = Users. Please change this. > > The drop-down menu for saving a chart definition to the current > TestScenario or TestMaker was a bad idea. Please change this to > buttons. > > When I edit a chart definition and change its name then clicking > Save creates a new chart definition. > > I don't see the progress/abort controls while TM updates a chart. > Does this work? > > When I edit a chart definition and click the save button, if the > chart uses Periods, the chart updates and the contents are always > empty. > > I set up a chart with Duration Average -> Node and clicked Usecase > and CRL. Question 1: should the checkboxes actually be radio > buttons (meaning you can only select one?) Question 2: What should > this report contain? > > I click the + icon from the controller panel, enter a chart name, > Duration Average, Periods, click Steps, select Stacked Bars, click > save, then click Magnify icon. I see the Graph Type is set to Bars. > I can't get it to register for Stacked Bars. > > -Frank > > -- > Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 > PushToTest, the open-source test automation company > > > > _______________________________________________ > Dev mailing list > Dev@lists.pushtotest.com > http://lists.pushtotest.com/mailman/listinfo/dev -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From frank at pushtotest.com Tue May 6 07:03:58 2008 From: frank at pushtotest.com (Frank Cohen) Date: Tue May 6 06:58:46 2008 Subject: [Dev] EndToEnd test issues Message-ID: <043BAB48-5250-403C-9E1A-10E33AA26C7D@pushtotest.com> Hi William and Max: I run the EndToEnd example test and see the following in the output panel. INFO - Trying to stop the monitor INFO - Trying to stop the monitor TestMaker class Running a use case 0 Message size 1 SOAPUIPRO not detected. Working with standard SOAPUI Trying ./localhost/soapUI_EndToEnd.xml Configuring log4j from [jar:file:/Applications/ PushToTest_TestMaker52a2/TestNetwork/TestNode/webapps/TestNetwork/WEB- INF/lib/soapui-2.0.2.jar!/soapui-log4j.xml] 07:00:33,931 WARN [DefaultSoapUICore] Missing folder [/Applications/ PushToTest_TestMaker52a2/TestNetwork/TestNode/ext] for external libraries 07:00:33,931 INFO [DefaultSoapUICore] Creating new settings at [/ Applications/PushToTest_TestMaker52a2/TestNetwork/TestNode/soapui- settings.xml] 07:00:34,959 INFO [WsdlProject] Loaded project from [file:/ Applications/PushToTest_TestMaker52a2/TestNetwork/TestNode/./ localhost/soapUI_EndToEnd.xml] Trying soapUI test suite testsuite Using soapUI testcase com.eviware.soapui.impl.wsdl.testcase.WsdlTestCase@3ea433 07:01:23,448 INFO [HttpClientSupport$Helper] Initializing SSL DATA {input=newDataValue, output=Data393.7151850831241} Shock Test registered a time of: 13676 Two things are strange: 1) "SOAPUIPRO not detected." looks like a debug message and should be suppressed. It should say "soapUI Pro detected." if it is there. 2) The "Shock Test registered..." looks like a debug message that should be supressed. -Frank -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From mvillalobos at AVANTICATEC.NET Tue May 6 10:09:32 2008 From: mvillalobos at AVANTICATEC.NET (Max Enrique Villalobos Blanco) Date: Tue May 6 10:12:44 2008 Subject: [Dev] EndToEnd test issues In-Reply-To: <043BAB48-5250-403C-9E1A-10E33AA26C7D@pushtotest.com> Message-ID: <85A61B0FDDD4834EA295605C349BABAAE3D783@dc1avantica.AVANTICA.AVANTICATEC.NET> Frank, hello. "SOAPUIPRO not detected message" was already supressed and "SoapUI Pro detected" was added instead. The message that says something about the time that the shock test registered is the actual time that the Schock Test lasted. Maybe the number isn't clear because it is expressed in milliseconds, but now it was changed to be expressed in seconds so it is more understandable. From frank at pushtotest.com Sun May 18 10:09:54 2008 From: frank at pushtotest.com (Frank Cohen) Date: Sun May 18 10:07:40 2008 Subject: [Dev] Functional Test Controller Panel Message-ID: <811D6BC3-49E2-44D4-B487-753E7BEC5220@pushtotest.com> Hi William, Luis Carlos, Max: I added a new enhancement for TM 5.2 at: http://bugs.pushtotest.com/ticket/234 This adds a new Controller Panel user interface for Functional Tests. Please let me know your thoughts on how to accomplish this. Thanks. -Frank From frank at pushtotest.com Sun May 18 13:17:54 2008 From: frank at pushtotest.com (Frank Cohen) Date: Sun May 18 13:15:42 2008 Subject: [Dev] HTML results report broken in TM 5.2 beta Message-ID: <80992AB0-FF76-4C06-9CE8-FB036E754BCF@pushtotest.com> Hi William: TM 5.2 creates a broken HTML report in the Results directory. Would you please look into it. Thanks. -Frank -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From frank at pushtotest.com Sun May 18 13:19:16 2008 From: frank at pushtotest.com (Frank Cohen) Date: Sun May 18 13:17:03 2008 Subject: [Dev] Ticket 188 Additional Issues Message-ID: <9A3ED2F5-BDB4-43F5-966D-01F09EFF9FB0@pushtotest.com> Hi William and Luis Carlos: While running TestMaker 5.2 beta 2 I run the EndToEndTest/ LoadTest.xml. I add to it a Chart named Resources with the following params: NET CPU MEM TestMaker does not create the Chart. I see the following in the output panel: TestNode localhost snapshot: Test use cases completed: 149. Success: 149. Failures: 0. TestNode localhost snapshot: Test use cases completed: 191. Success: 191. Failures: 0. Test Summary TestNode localhost final results: Tests completed: 191. Success: 191. Failures: 0. - Getting Result Files - Getting ./soapui_tg4w/Results/2008_05_18_12-31-36_PDT_Sun/docs/ localhost-uc0crl3sz0.xml from localhost - Fetching Monitor Information - DefaultValidationEventHandler: [FATAL_ERROR]: Unexpected end of element {}:CPU Location: line 3 of file:/Applications/ PushToTest_TestMaker52b1/./soapui_tg4w/Results/ 2008_05_18_12-31-36_PDT_Sun/docs/localhost-3.xml Error: The file ./soapui_tg4w/Results/2008_05_18_12-31-36_PDT_Sun/ docs/localhost-3.xml is nor a TX not a SD file No graphs to save. - Test Complete! - - Test Scenario Error - Error reading the TestScenario: Unexpected end of element {www.pushtotest.com/tm5}:usecase Attached is the results directory in a Zip archive. -Frank -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company -------------- next part -------------- A non-text attachment was scrubbed... Name: 2008_05_18_09-47-53_PDT_Sun.zip Type: application/zip Size: 22283 bytes Desc: not available Url : http://cake.pushtotest.com/pipermail/dev/attachments/20080518/3ab10902/2008_05_18_09-47-53_PDT_Sun-0001.zip -------------- next part -------------- From frank at pushtotest.com Mon May 26 08:12:19 2008 From: frank at pushtotest.com (Frank Cohen) Date: Mon May 26 11:41:21 2008 Subject: [Dev] 218 closed, 234 work in progress? Message-ID: Hi William: I closed ticket 218 (Java_home). What's the status of 234 (Functional Test Controller Panel)? -Frank -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From frank at pushtotest.com Mon May 26 08:38:54 2008 From: frank at pushtotest.com (Frank Cohen) Date: Mon May 26 11:41:25 2008 Subject: [Dev] Chart problem Message-ID: <6ED4904D-D66F-46CD-8858-70F7910C8E5D@pushtotest.com> Hi William and Luis Carlos: I ran the example_agents/EndToEndTest/LoadTest.xml scenario with CRs at 2, 4, 6, 8. The scenario completed normally and showed the real- time scalability chart. I added the following chart definition: NET CPU MEM TestMaker asked if it should rerun the charts. I clicked yes and see the following in the output panel: - Test Complete! - - Test Scenario Error - Error reading the TestScenario: Unexpected end of element {www.pushtotest.com/tm5 }:usecase - Test Scenario Error - Error loading scenario: Unexpected end of element {www.pushtotest.com/tm5 }:usecase -Frank -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From frank at pushtotest.com Mon May 26 08:43:59 2008 From: frank at pushtotest.com (Frank Cohen) Date: Mon May 26 11:41:26 2008 Subject: [Dev] Re: Chart problem In-Reply-To: <6ED4904D-D66F-46CD-8858-70F7910C8E5D@pushtotest.com> References: <6ED4904D-D66F-46CD-8858-70F7910C8E5D@pushtotest.com> Message-ID: <2A04781E-5022-4A70-A6C9-C573A70B470B@pushtotest.com> I just noticed that the TestScenario is corrupted: SOAPUI + TG4W ./soapui_tg4w NET CPU On May 26, 2008, at 8:38 AM, Frank Cohen wrote: > Hi William and Luis Carlos: > > I ran the example_agents/EndToEndTest/LoadTest.xml scenario with CRs > at 2, 4, 6, 8. The scenario completed normally and showed the real- > time scalability chart. > > I added the following chart definition: > > > > > > > > > NET > CPU > MEM > > > > > TestMaker asked if it should rerun the charts. I clicked yes and see > the following in the output panel: > > - Test Complete! - > - Test Scenario Error - > Error reading the TestScenario: Unexpected end of element {www.pushtotest.com/tm5 > }:usecase > - Test Scenario Error - > Error loading scenario: Unexpected end of element {www.pushtotest.com/tm5 > }:usecase > > -Frank > > -- > Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 > PushToTest, the open-source test automation company > > > -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From frank at pushtotest.com Mon May 26 11:51:07 2008 From: frank at pushtotest.com (Frank Cohen) Date: Mon May 26 11:45:02 2008 Subject: [Dev] Chart corrupting TestScenario Message-ID: Hi William and Luis Carlos: I ran the example_agents/EndToEndTest/LoadTest.xml scenario with CRs at 2, 4, 6, 8. The scenario completed normally and showed the real- time scalability chart. I added the following chart definition: NET CPU MEM TestMaker asked if it should rerun the charts. I clicked yes and see the following in the output panel: - Test Complete! - - Test Scenario Error - Error reading the TestScenario: Unexpected end of element {www.pushtotest.com/tm5 }:usecase - Test Scenario Error - Error loading scenario: Unexpected end of element {www.pushtotest.com/tm5 }:usecase I noticed that the TestScenario is corrupted: SOAPUI + TG4W ./soapui_tg4w NET CPU This happens consistently. -Frank -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From frank at pushtotest.com Mon May 26 11:51:41 2008 From: frank at pushtotest.com (Frank Cohen) Date: Mon May 26 11:45:36 2008 Subject: [Dev] 218 closed, 234 work in progress? Message-ID: <97C8379E-27A6-4742-B1F7-92184CE5F209@pushtotest.com> Hi William: I closed ticket 218 (Java_home). What's the status of 234 (Functional Test Controller Panel)? -Frank -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company From frank at pushtotest.com Wed May 28 08:48:29 2008 From: frank at pushtotest.com (Frank Cohen) Date: Wed May 28 08:42:53 2008 Subject: [Dev] Reduce transaction log file size Message-ID: <867074A1-74B0-4C8E-B8D0-C5A485643A8E@pushtotest.com> I opened ticket 241 to track an enhancement that reduces the transaction log file size. http://bugs.pushtotest.com/ticket/241 -Frank -- Frank Cohen, http://www.PushToTest.com, phone 408 871 0122 PushToTest, the open-source test automation company