From fcohen at pushtotest.com Mon Jan 7 20:19:29 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Mon Jan 7 20:56:11 2008 Subject: [Dev] TestMaker 5.1 feedback? Message-ID: <6E0203DB-CBDA-4E05-9967-69C8C7A362E3@pushtotest.com> Dear TestMaker Developers: TestMaker 5.1 is up and the user feedback has been good. Is there any feedback from the developers? Thanks. -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Mon Jan 7 21:16:52 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Mon Jan 7 21:53:37 2008 Subject: [Dev] Open-source collaborative document editing project? Message-ID: <637C8E59-027E-49C1-A73E-78441AA22081@pushtotest.com> Dear TestMaker Developers: I am searching for an open-source collaborative document editing project for the PushToTest Web (pttweb) project. Pttweb is a repository, scheduler, and Web interface for building and operating tests. Multiple users will be able to view and edit TestScenario documents through their browser. I would like to incorporate collaborative features so multiple users could work on a TestScenario document at the same time. If you know of such an open-source project, then please let me know. Thanks. -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From olivier.dony at denali.be Tue Jan 8 01:29:59 2008 From: olivier.dony at denali.be (Olivier Dony) Date: Tue Jan 8 02:06:35 2008 Subject: [Dev] Open-source collaborative document editing project? In-Reply-To: <637C8E59-027E-49C1-A73E-78441AA22081@pushtotest.com> References: <637C8E59-027E-49C1-A73E-78441AA22081@pushtotest.com> Message-ID: <3A915172-3EFF-44BF-B70B-B5A5FB9EE9E6@denali.be> Hi Frank, If you haven't done so yet, you might want to have a look at : - http://en.wikipedia.org/wiki/Collaborative_real-time_editor - http://en.wikipedia.org/wiki/List_of_collaborative_software -- Olivier Dony Denali s.a., "Bridging the gap between Business and IT" Rue de Clairvaux 8, B-1348 Louvain-la-Neuve, Belgium Office: +32 10 43 99 51 Fax: +32 10 43 99 52 www.denali.be Legal Notice: This message may contain confidential and/or privileged information. If you are not the addressee or authorized to receive this for the addressee, you must not use, copy, disclose or take any action based on this message or any information herein. If you have received this message by mistake, please advise the sender immediately by return e-mail and delete this message from your system. Thank you for your cooperation. On Jan 8, 2008, at 6:16 AM, Frank Cohen wrote: > Dear TestMaker Developers: > > I am searching for an open-source collaborative document editing > project for the PushToTest Web (pttweb) project. Pttweb is a > repository, scheduler, and Web interface for building and operating > tests. Multiple users will be able to view and edit TestScenario > documents through their browser. I would like to incorporate > collaborative features so multiple users could work on a > TestScenario document at the same time. > > If you know of such an open-source project, then please let me know. > > Thanks. > > -Frank > > -- > Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 > TestMaker open-source test automation > From fcohen at pushtotest.com Fri Jan 11 20:58:41 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Fri Jan 11 21:36:14 2008 Subject: [Dev] Enhanced Results Analysis (Ticket 188) in cvs Message-ID: <151B335F-6D14-469F-8158-CB9C5949D855@pushtotest.com> Hi Luis Carlos: I checked-in the Java code to the Enhanced Results Analysis application to cvs.pushtotest.com/var/cvsroot under Tally2. This is the code for a freestanding Java application. Once we finish the basic functionality then we will integratd the code into TestMaker. Details on the design are at: http://bugs.pushtotest.com/ticket/188 -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Thu Jan 17 17:24:50 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Thu Jan 17 18:04:04 2008 Subject: [Dev] Re: Step logging In-Reply-To: <85A61B0FDDD4834EA295605C349BABAA8B6612@dc1avantica.AVANTICA.AVANTICATEC.NET> References: <85A61B0FDDD4834EA295605C349BABAA8B6612@dc1avantica.AVANTICA.AVANTICATEC.NET> Message-ID: <6767DC5F-819C-4ADE-BF81-13AE2B0EA521@pushtotest.com> Hi Luis Carlos: Thanks for pointing that out to me. I tried and it works as expected. HOWEVER, who in their right mind designing this? step="true" belongs in the section of the TestScenario! Oh, yes, it was me, I forgot. I will open a ticket on this. The syntax in the TestScenario should be: Thanks. -Frank On Jan 17, 2008, at 6:46 AM, Luis Carlos Lara L?pez wrote: > Tag in the options, in the scenario. > There is an example in folder example_agents/stepsExample/ > > > > > Greetings, LC > > -----Original Message----- > From: Frank Cohen [mailto:frank@pushtotest.com] > Sent: Wednesday, January 16, 2008 8:37 PM > To: William Mart?nez Pomares; Luis Carlos Lara L?pez > Subject: Step logging > > Hi William and Luis Carlos: > > I am running a simple TestScenario that has a single UseCase with 3 > elements. The transaction results log does not include the > values. I forget what I need to do in the TestScenario to > have TM log the values. What is it? > > -Frank > > > > -- > Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 > 0122 TestMaker open-source test automation > > > > -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Sat Jan 19 14:47:42 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Sat Jan 19 15:27:09 2008 Subject: [Dev] UI Design for Enhanced Results Analysis (Ticket 188) Message-ID: <25EC94E5-6422-4876-8038-37E518FCDC98@pushtotest.com> Dear PushToTest Developers: We're making outstanding progress on building the Enhanced Results Analysis engine for PushToTest TestMaker. The internal work is almost done. I put together a user interface design for your review, feedback, and comments. Please download it in Adobe Acrobat format at: http://downloads.pushtotest.com/tm5/Results_UI_Design.pdf Thanks, in advance! -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Sun Jan 20 12:55:08 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Sun Jan 20 13:34:50 2008 Subject: [Dev] Repository specification ticket opened Message-ID: Hi PushToTest Devs: I opened ticket 205 (http://bugs.pushtotest.com/ticket/205) to keep track of a PushToTest TestMaker enhancement that will become part of PushToTest Version 5.5 or 6.0. The Repository stores TestScenarios, TestPlans, unit tests, operational data, results, and logged data. I am writing a Design Document for the Repository. Please let me know your interest is participating in this enhancement and I'll send you my draft design document. Thanks. -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Tue Jan 22 08:15:10 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Tue Jan 22 08:55:18 2008 Subject: [Dev] Jackrabbit and repository Message-ID: Dear PushToTest Dev-heads: Every once in a while a confluence of ideas happens around open- source test automation. The confluence of this week is: - Apache's announcement of Jackrabbit 1.4 - Zephyr's announcement that their private beta of a new collaborative test automation platform uses Jackrabbit - Jimmy Foulkes (one of our architects) push for PTTWeb to use JSR 170 and specifically Jackrabbit as our new repository for the upcoming PushToTest collaborative test automation platform. All of these happened this week! PushToTest is being used by hundreds of thousands of developers now. We often hear users and customers asking for a collaborative test environment that features a repository of tests and a scheduler. We are working on these under the codename PTTWeb. The first piece of the project is the repository. This is perhaps the most important module of PTTWeb because it provides all the storage functionality required by the other modules. Will serve as the storage repository for test scenarios, resources and scripts as well as test results. In general this will include the storage of the following areas: Test resources: test related artifacts using a file system metaphor Test results: all test data results associated to the executed jobs from the different test nodes Security: all information related to security access like users, roles, permissions, etc. Scheduling: job and its execution scheduling information In order to avoid spending time on writing code to provide this functionality it is necessary to find an Open Source product/project that provides this service. The Java Community process has a specification for Content Repositories under the JSR 170. There are several Open Source implementations of this JSR. One possible implementation is the Apache Jackrabbit project that fulfills this JSR as well as adding several more features of its own. Jackrabbit is in use by several important projects like JBoss portal, Magnolia Content management system, jLibrary, Sun's OpenPortal Project. Most providers for this JSR can provide RDMS implementation for the underlying data store. A MySql database could provide the actual storage capabilities for the repository although a file system based repository is much faster. The idea is that the repository should emulate a typical hierarchical file system with similar access permission typical of a file system. Attention will be placed in the design to the appropriate structure of this repository and to allow the definition of the required metadata associated with the possible resources to be kept there. A general search function will be provided on this repository. For those resources of text type the actual contents of the resource can be searched, otherwise the search will be performed on the actual names, attributes and repository structure for the repository. The design document for PTTWeb is available for your review, feedback and ideas at http://downloads.pushtotest.com/tm5/PTTWeb- DesignProposal.pdf. -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Wed Jan 23 10:38:52 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Wed Jan 23 11:19:23 2008 Subject: [Dev] Engineering status Message-ID: Dear PushToTest developers: We're making very good progress on the bugs and enhancements list for PushToTest TestMaker. Here is a summary of today's status: 1) Enhanced Results Analysis (http://bugs.pushtotest.com/ticket/188) Luis Carlos reports the system is working with 9 engines completed. Secondary axis has 2 new engines for second axis (periodic timing, resources per period of time.) Luis Carlos clocked the tally performance at 1 mbyte per second. The current design using JFreeChart introduces a problem for the transaction distribution style charts when there are many points to plot. For instance, a 150 Mbytes transaction log took 5 seconds for the tally to process and JFreeChart did not show data. Luis Carlos will build an new engine that asks the user "How many points do you want to plot?" and the engine will calculate which points to include from the overall transaction log. Luis Carlos will get started with the GUI implementation today. We discussed the design document and came to two conclusions about the list in the chart setting dialog: a) The magnifying glass actions will be the same as clicking a stored chart definition, b) Remove the + icon from the list. Luis Carlos will document these changes by email. 2) Frank provided Max and Luis Carlos with cvs and bugs accounts. 3) Max added the telnet handler (http://bugs.pushtotest.com/ticket/ 181), tested it and committed the code to cvs. 4) Max finished the sequence/mustrun enhancement (http:// bugs.pushtotest.com/ticket/193). 5) Max will next work on the new TestGen4Web -> Jython transformer utility (http://bugs.pushtotest.com/ticket/196). 6) William will work on a design for soapUI support of DPL provided data (http://bugs.pushtotest.com/ticket/206). The enhancement will pass userid/proxy info, pass properties file info, pass dpl data to the soapUI runner in TestMaker 5.2. 7) Frank to circulate the Eclipse Plug-in Design document to the community for feedback. Lastly, my expectations for our engineering schedule: This week: finish 188 UI, finish 196 TestGen4Web transformer, finish the soapUI DPL design Next week: Test 188 and fix any bugs, Eclipse plug-in finished, Design the repository and scheduler design (http:// bugs.pushtotest.com/ticket/205) Week after: Start coding the repository (http://bugs.pushtotest.com/ ticket/205) and scheduler. -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Wed Jan 23 22:21:52 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Wed Jan 23 23:02:21 2008 Subject: [Dev] Eclipse Plug-in Design Document feedback wanted Message-ID: <5E8C271D-79D5-4F37-810A-62D396CDBCD8@pushtotest.com> Dear PushToTest Developers: William Martinez drafted a good first design of a PushToTest Eclipse Plugin. You will find the document at: http://downloads.pushtotest.com/tm5/PushToTest_EclipsePlugin_Design.pdf We are seeking your feedback on the design, our assumptions, and how this new plug-in would make you more valuable. -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Mon Jan 28 17:17:38 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Mon Jan 28 17:59:18 2008 Subject: [Dev] TestGen4Web runner and transformer improvements Message-ID: Dear PushToTest Developers: I updated ticket 196 (http://bugs.pushtotest.com/ticket/196) to include the final requirements. This enhancement improves the TestGen4Web test runner and adds a new transformation utility to transform TestGen4Web test files into Java or Jython classes. -Frank -- I changed the TM 5.1 script runner to use the com.spike.tg4w.htmlunit.HtmlUnitInterpreter?. This is a class in tm5/ testgen4web-branch. HtmlUnitInterpreter? does a much more thorough job of interpreting the Tg4w files and running the tests. ticket 196 notes that TestGen?4Web includes the com.spike.tg4w.htmlunit. StandaloneTestGenerator? class to translate TestGen?4Web XML files into Java. To accomplish this: 1. The transform utility uses a Velocity macro file that generates a java class, by running through the XML and adding one call to the HTMLUnit per step in the session. 2. We will require to redo that macro file (VM file) to generate the calls into Jython. 3. And make the intepreter to use that new macro instead of the included one. 4. The we will need to test the generated Jython. This ticket changes the current com.pushtotest.testmaker.XSTest.client.TestGen?4Web's toJython method to call StandaloneTestGenerator? with a modification to output Jython scripts instead of Java scripts. Additionally, this ticket changes the Tools menu -> Import TestGen? 4Web command to have submenus for Java and Jython. -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Wed Jan 30 14:19:49 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Wed Jan 30 15:02:06 2008 Subject: [Dev] Auto scroll added to TestMaker 5.1 Message-ID: <021437BF-81D4-4078-87ED-A7605C3613A4@pushtotest.com> Dear PushToTest Developers: I applied a patch from Dominique de Waleffe to autoscroll the output panels. Thanks for the contribution Dominique! This fixes: http://bugs.pushtotest.com/ticket/199 -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Wed Jan 30 17:42:20 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Wed Jan 30 18:24:38 2008 Subject: [Dev] Ticket 197 CVSDPL -> Jython patch Message-ID: <5BFF736F-2717-4993-A57F-0D51F862E3D2@pushtotest.com> Dear PushToTest developers: We implemented a patch provided by Gary to make the CVSDPL works with Jython scripts. This is now fixed. Original issue at: http://bugs.pushtotest.com/ticket/197 Thanks Gary! -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation From fcohen at pushtotest.com Thu Jan 31 08:48:37 2008 From: fcohen at pushtotest.com (Frank Cohen) Date: Thu Jan 31 09:31:11 2008 Subject: [Dev] PushToTest 5.1 Final Call Message-ID: <0BD54182-7210-4742-9EB1-EAA17498502D@pushtotest.com> Dear PushToTest Developers: This is a final call for bug fixes and enhancements for the PushToTest Version 5.1 release. The team is working towards building Release Candidate 2 on Friday January 31, 2008. We then plan to release Version 5.1 next week. The remaining issues for 5.1 RC 2 are: 1) Load tests fail with a soapUI runner exception even when the test uses Java and not soapUI. Max is looking into this now. 2) TestGen4Web transformation to Jython requires some minor UI work, testing, and documentation. http://bugs.pushtotest.com/ticket/196 (Max) 3) TestScenario syntax for enabling step recording in the transaction logs. http://bugs.pushtotest.com/ticket/204 (Max) 4) PTTMonitor deployed to an application server as an EAR needs a way to take down the monitor thought the Web GUI. William is working on this. To view a list of fixes/enhancements to all versions of PushToTest at: http://bugs.pushtotest.com/query? groupdesc=1&group=version&order=priority To view a list of open tickets ordered by priority at: http://bugs.pushtotest.com/report/1 -Frank -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation -- Frank Cohen, PushToTest, http://www.PushToTest.com, phone 408 871 0122 TestMaker open-source test automation