Web and Load Testing using Microsoft Visual Studio Team System 2008 Test Edition

At DeCare Systems Ireland (DSI) our software test team is benefitting from the newly released [tag]Microsoft Visual Studio Team System (VSTS) 2008 Test Edition[/tag] which they are using in conjunction with the [tag]Visual Studio Team System 2008 Test Load Agent[/tag] software to web test and load test their [tag].NET[/tag] and [tag]Java[/tag] web-based applications.

The test team, Peter, Mark and Ciara are currently using Microsoft Visual Studio Team Edition 2008 Test Edition on two new client projects which are running on totally different technology platforms. Our large [tag]Spring[/tag] powered Java application which we have been working on for over a year is a web-based Insurance Group and Enrolment Administration project running using the [tag]Struts[/tag], [tag]DOJO[/tag], Spring, [tag]Hibernate[/tag] and [tag]Oracle[/tag] technology stack on [tag]HP/UX[/tag]. Our [tag]Web 2.0 .NET[/tag] application is running on standard Wintel plan and implements a highly interactive interface architecture. The test technology for both projects is the same, Microsoft Visual Studio Team System (VSTS) 2008 Test Edition.

Peter, the test lead explains why his test team is using VSTS 2008 Test Edition, “we were impressed at how easy it was to create, customize and compile a suite of data bound web-tests that could then be incorporated into a mix and used as load testing scenarios. We found that that the web test cases were easy to create and run and that it was quite easy to bind [tag]CSV[/tag] and [tag]XML[/tag] files to these web-tests. As our web based Insurance applications are heavily data driven this ability to quite easily bind a web-test to dynamic data is a major plus for us and it means that we can now functionally test our web applications more thoroughly with a more complete range of data than ever before.”

Peter has also created a comprehensive suite of [tag]load testing scenarios[/tag] which he and his team are using to load test their pre-production application, he explains how he did this. “To generate the initial load test scenarios I used the Load Test Wizard and added a mix of web-tests, a browser mix, a network mix and a load pattern. I then tweaked the settings after the scenarios were created. These load tests allow us to mix several web-tests together and simulate a real user load on our sites. I particularly like the ‘Load Test Summary Report’ that is generated after the load test run has complete, it gives us a cursory glance at how our site is functioning under load and provides the key results in a compact and easy to read format.” Monitoring the load tests in the background was [tag]Quest Software’s PerformaSure (PAS) Application Performance Management[/tag] which provided vital application performance data to both the test and development teams and allowed for rapid diagnosis of any performance related issues.

Mark, a software tester at DSI feels that the VSTS 2008 Web Test recorder is now more complete and compatible with our applications because it captures [tag]AJAX[/tag] requests and records JavaScript pop-ups, which was not possible with [tag]VSTS 2005[/tag]. “This is a real bonus for us as many of our web-based applications use an AJAX application layer and this enhancement is one that we at DSI find most useful. We no longer have to rely on [tag]Fiddler[/tag] to record Web Test requests its all done in one place now from within [tag]VSTS 2008”[/tag]. Another web test feature that Mark likes is the improved UI. “There are additional UI enhancements which now make it easier to view results and find errors after the web-tests have been run. There are now toolbar buttons for navigating through requests and it’s easier now to locate errors by using the buttons to jump to requests that have failed”.

Ciara another of the testers at DSI installed and ran the Visual Studio Team System 2008 Test Load Agent software so that they could run their load tests in a distributed environment. She used the load agent product to achieve scalable load generation. She installed a single controller and a number of agents which she refers to as ‘a rig’. She explains, “an agent is the part of the rig that is used to run tests and generate simulated load. The controller is the part of the rig that is used to coordinate the agents and collect the test results. The rig can be administered from within Visual Studio”. All in all the DSI test team have managed to author, create, execute and manage an impressive suite of dynamic web-tests and load tests all from within Visual Studio. The tool has certainly assisted the test team at DSI to diagnose performance issues in their pre-production environment in a very short space of time.

Overall, the DSI test team was impressed with the functionality that VSTS 2008 Test Edition offered them. They feel that finally they have in their midst a tool that they can use to their benefit to web-test and load test their current pre-production web-based Java applications, all in one, without writing any code. The DSI test team has come to the conclusion that the VSTS 2008 Test Edition more closely suits their needs than some of the other functional and load testing tools that they have used in the past. Peter and his team have come to the following conclusions:

• With VSTS 2008 Test Edition the DSI test team has managed to create a suite of web-tests and load Tests in VSTS 2008 and have run these tests with relative ease. In the past they have used other load testing tools, for example, [tag]The Grinder[/tag] and [tag]JMeter[/tag] but these required some level of proficiency in coding and were far less easy to configure and run tests in.
• The test team was able to use [tag]Microsoft Team Foundation Server 2005[/tag] a single repository for storing all test scripts.
• In the case of the .NET projects, issue reporting was also centralized within Microsoft Team Foundation Server 2005, allowing the developers easy access to any issues the test team uncovered.
• The [tag]MSDN[/tag] forums contain a wealth of information on Web and Load Testing within Visual Studio, the tool is well supported and the support is relevant and up to date.
• There is real advantage in using a common tool between the development and test departments and between groups using different technologies, essentially it means that we have one common shared tool which we use on a company-wide basis to functionally test and load test our web applications. It means that we can have a consistent approach to our testing and that there is a greater amount of knowledge sharing across the company.

  1. #1 by ftorres on January 19, 2008 - 5:19 pm

    For developing functional web testing from Visual Studio 2005 or 2005 and C# or VB.NET, we have created InCisif.net.

    We also integrate with the Visual Studio 2008 test framework or NUnit.

    Check out our ScreenCasts.

  2. #2 by fred on June 3, 2008 - 4:01 am

    Hi,

    I want to use free tool, do you think that JMeter would be able to get the job done on testing ASP.NET with AJAX(because it is getting the HTTP Request-Response)? I was thinking that it could since everything in web relies on HTTP Get-Post (Request-Response) right? In my initial test, this seems to be okay.

    Could you confirm this with me?

  3. #3 by Anand Tripathi on June 3, 2008 - 6:26 am

    I need a tutorial on how we can integrate with the Visual Studio 2008 test framework or NUnit and execute test cases from there.Can anybody help?

  4. #4 by Peter on June 3, 2008 - 8:39 am

    Fred,

    There are many free tools that you could use, I am not overly familiar with JMeter
    but I think you could use this. You may encounter issues with authentication, if you have authentication and may also run into some cookie issues if record a script on one pc
    and then try to run the script on another.

    You could also try to use a tool called ‘the grinder’ this is a freeware load testing tool.

    Hope this helps.

  5. #6 by Santosh Pandit on September 11, 2008 - 5:50 am

    Please find this URL:

    http://www.sqe.com/ControlImages/sqe/Image/BrochurePDF/visual studio 08-springPDF_FINAL.pdf

  6. #7 by Reslie on September 28, 2008 - 4:29 pm

    Hi!

    I just like to know is Visual Studio 2008 Web UI Testing part of the Microsoft UI Automation Library?

    Thanks!

  7. #8 by Peter on September 29, 2008 - 8:55 am

    Hi Reslie,

    I don’t believe it is but I do recommend that you post this question on the relevant MSDN forum as well.

    Peter

  8. #9 by Reslie on October 7, 2008 - 9:47 am

    Hi Peter!

    What about VSTS 2008 Web Test, is this tool applicable to be used during UAT? Also, can it be used during UI unit testing? Or in what particular testing stage it is more appropriate to use?

    I am developing a case study about this new tool. I would highly appreciate your response to these concerns.

    Thanks!

  9. #10 by Peter on October 7, 2008 - 10:15 am

    Hi Reslie,

    VSTS 2008 Web Tests are written to test the functionality of the application
    under test, they are not concerned with the user interface (UI) at all, It does
    not concenr itsef with the appearance of the pages.In order to carry out user interface
    testing you would need to use another tool. The testing approach is to examine
    HTTP data flowing over the wire and provide various rules for validating this data.
    (web tests to test your server at the http layer)

    At Decare Systems Ireland we use the web tests to verify functionailty
    as part of our regression test pass. This allows us to verify that existing
    functionality continues to function as new functionality is being delivered.

    I would say that the web test scripts should be run at either the development test stage
    or at the QA stage before user acceptance testing happens. In fact I would recommend
    running these tests as early as possible in the cycle so that potential issues
    can be un-covered and fixed long before your application gets to UAT.
    The earlier you uncover issues the easier it is to have them fixed and the less
    overhead that is incurred. I don’t think these tests are that suitable for UAT testing
    as such given that UAT is usually performed by end users whose main focus is on using the
    application from a front-end point of view.

    I hope this answers your questions,

    Regards,

    Peter

  10. #11 by Reslie on October 9, 2008 - 2:48 am

    Thanks Peter for your reply. Based on your answers I was able to verify that my assumptions are correct that this tool is more appropriate to use during performance testing.

    Anyway, I get a chance to make use of the tool through the walkthrough provided by MSDN, I just have some more questions though:
    1. If for instance I have already used the tool to record the primary use cast (test scenario) for an old build, can I use the same recording to check a new build and just add to it the recording of the new functionalities?
    2. Does it mean that the effect of using this tool is that it incrementally decreases testing effort while you are repeatedly testing your primary use case against your builds?

    Please bare with me becuase I would probably send you some more queries regarding this tool.

    Thank you very much!

  11. #12 by Peter on October 9, 2008 - 8:30 am

    Hi Reslie,

    Yes the tool can be used during performance testing and that’s what the Load Test part of the tool do for you.
    The web tests though are used as part of the load test
    to make up the scenarios but can also be used effectively
    as regression tests on builds.

    In answer to your additional questions:

    1. If for instance I have already used the tool to record the primary use cast (test scenario) for an old build, can I use the same recording to check a new build and just add to it the recording of the new functionalities?

    >> Yes, if I understand your question correctly,
    you can run the tests you have already recorded and add
    new tests as needed, that’s how the web tests are used
    really you use them to verify that the existing functionality works before you go on to test the new functionality.Be aware that if any of the existing code changes it may affect the tests and may break them, this is both good and bad, good because it highlights that something in the original code has changed and hence
    would need testing and I suppose bad because there is a maintenance effort in maintaining the existing scripts.

    2. Does it mean that the effect of using this tool is that it incrementally decreases testing effort while you are repeatedly testing your primary use case against your builds?

    Yes it certainly decreases the testing effort when it comes ot verifying existing functionality. Instead of having to manually verify the (old) functionality you now have a tool that does that for you. (be sure to add validation rules
    so that the test actually validates that you are were you expect to be).

    As I have said in 1. above there is a maintenance effort to the scripts though, but I found that this effort is less than the effort it would take to re-test all functionaluty.

    I hope this answers your questions,

    Peter.

  12. #13 by Reslie on October 16, 2008 - 4:49 am

    Hi Peter!

    You have mentioned that there is a need to maintain scripts and put validation rules in the web tests to make it more effective. Can you provide me links on where I could find how I can do those. If possible sites/sources that can be easily understood since this is the first time for me to use the tool.

    Thanks!

  13. #14 by Peter on October 16, 2008 - 8:39 am

    Hi Reslie,

    There is a lot of information available on the web regarding web testing and how to add validation to web tests.

    The MSDN Forums also have a secion on web and load testing that has information on same.

    Here are my recommendations:-
    Try this link, its an index page to to other good links:-
    http://blogs.msdn.com/edglas/pages/content-index-for-web-tests-and-load-tests.aspx

    also try the MSDN forum on web and load tests:-
    http://social.msdn.microsoft.com/forums/en-US/vstswebtest/threads/

    and:-
    http://wehatemanualtesting.spaces.live.com/

    Hope this helps

  14. #15 by Reslie on October 30, 2008 - 3:01 am

    Hi Peter,

    I encounter a problem such as this: Request failed: Context parameter ‘$HIDDEN1.ctl00$ContentHolder$grdBulkUpdateDLSI$ctl30$dirtyFlag’ not found in test context

    How will I go about this? I have repeated the recording that it still produces same error message.

    Thanks!

  15. #16 by Peter on October 30, 2008 - 9:45 am

    Hi Reslie,

    You need to manually pick up certain parameters from the requests yourself. In this case the value for a hidden field is not being filled so you will have to take a look at the request that has the correct value for this field, capture it and pass that value onto the hidden field.

    I think you need to start taking a look at the help on customising tests, the help explains why you get these sorts of issues and the best way around these issues.

    Peter

  16. #17 by Reslie on November 2, 2008 - 2:51 am

    Hi again Peter!

    At the end of every recording, a prompt appears that says whether you want to convert/capture dynamic parameters into the web test, how important is it? When will you need to say Ok and when you should cancel?

    Thanks again for constantly attending to my queries

    Regards.

  17. #18 by Peter on November 3, 2008 - 9:42 am

    Hi Reslie,

    I think you should always click ‘ok’, because if Visual Studio detects dynamic parameters it will attempt to handle these for you and that’s a good thing. It saves you having to do so later. Often, I have found anyway, It will not detect dynamic parameters.

  18. #19 by sudhakar kaleru on November 6, 2008 - 9:20 am

    Hi,
    I have one doubt i.e.. to create load test, why web test is required? what is the use of web test ? is functional testing required for load test? can’t we create load test with out load test? what infromation ssystem will get from web test to run load test?

    please respond immediatly

    thanks

    Sudhakar

  19. #20 by Peter on November 6, 2008 - 10:15 am

    Hi Sudhakar,

    You have to create web tests first because the web tests are the scenarios that make up the load tests. You combine the web tests into scenarios that make up the Load Test.

    So the steps would be :-
    1. Create web tests
    2. Combine a set of web tests together into a scenario which will form your load test.
    3. Run your load test.

    Web tests are esentially functional regression scripts, the advantage of using these as tests for your load test scenarios is that you don’t have to create separate load test scenarios, the web tests make up the load tests.

    You cannot create load tests without web tests, but you could just create some web tests and then use them straight away in a load test scenario.

    I’m not sure what you mean when you ask:- what infromation ssystem will get from web test to run load test?

    Basically you record web tests against the http requests of your application and once recorded you make the test script dynamic, there is a lot of help in the MSDN forum to assist you in creating web and load tests.

    Regards,

    Peter

  20. #21 by Reslie on November 6, 2008 - 5:21 pm

    Hi Peter!

    How am I going to resolve an HTTP404 error that appears when I try to run some modules in the same test project for testing a new system build? Because what we do right now is peforming tests to daily builds using the web test project that we have created. We created separated vhds for every new build. Sometimes we encounter a problem wherein a certain web test module would perfectly run in one vhd and fails producing an HTTP404 when transfered and ran to another vhd.

    Thanks!

  21. #22 by Peter on November 6, 2008 - 5:31 pm

    Reslie,
    I think your HTTP404 errors might be because the request has dependent requests (css files, images etc..) that it cannot locate on the requests that are throwing the 404 errors just set the Property ‘Parse Dependent Requests’ to false and then re-run your tests, this time your dependent requests will be ignore and you should now not get the 404 errors.

    Rgds,

    Peter

  22. #23 by chintan sanghvi on December 18, 2008 - 2:24 am

    We are using Codeplex tool (WCF test) to generate proxy and than unit test to input the same to VSTS for Load test.Can you let us know how to do Parameterization in load test.
    We are using smart client application which is desktop application and internally it is calling WCF service for processing.

  23. #24 by Pawan on December 19, 2008 - 7:50 am

    I am trying to create a Webtest for one of the intranet sites. The Site uses SKELTA BPM and Sharepoint Services. When I playback one of the webtests I do not get back any HTML data for the page. All I can see in the RESPONSE TAB is some js files and the scripts. Where and Why is the HTML data getting lost…

    Thanks in advance
    Pawan

  24. #25 by Peter on December 19, 2008 - 9:29 am

    Hi Pawan,

    I just saw your query this morning. I guess it would be impossible for me to tell why your web tests are not running without more information.

    I have a few ideas:

    1. Verify if the web tests are being recorded correctly (i.e. requests)
    2. Make sure that your test is logging in correctly and any session id’s are being passed down through each request
    3. Look through the responses to see if there are any errors.
    4. You could use the fiddler tool to view requests and responses that your expecting (www.fiddlertool.com) this is a handy web debugging tool. This will tell you if your responses are being returned.

    It sounds to me like your requests may not be running because their session id is not being passed down correctly at run-time, but that’s only a guess based on the informtion you have given me.

    Good luck and hope that helps.

  25. #26 by Peter on December 19, 2008 - 9:32 am

    Hi Chintan,

    I only saw your question this morning. The parameterization is usuaally done in the web tests. After the web tests have been recorded then I usually parameterize the web tests and provide dynamic data at that stage. Parameterization is not done at the load test stage.

    Hope this helps.

    Rgds,

    Peter

  26. #27 by Reslie on December 19, 2008 - 4:26 pm

    Hi Peter!

    Thanks for all your help regarding my queries about Web Test. After I presented the possible benefits from using Web Test of VSTS 2008, my organization has tasked me to compare it to Rational Clear Case so that we can decide on what tool to leverage. Do you have any idea on Rational Clear Case and do you think Web Test is not at par as this tool particularly on testing Web Apps?

    Thanks!

  27. #28 by Peter on December 19, 2008 - 4:30 pm

    Hi Reslie,

    Unfortunately I have not used Rational Clear Case myself. But I’d be interested in your findings once you have compared both products.

    Best Regards,

    Peter

  28. #29 by Reslie on January 14, 2009 - 6:37 am

    Hi Peter!

    Based on experience, what are the features of Web Test that made it very useful in testing Web Applications (developed using Microsoft Products)? Why did you not consider using other Testing tools like that of IBM Products?

    Your inputs on these queries would be very useful in my current study. Also, would you know contact details of the developers of VSTS 2008? I also want to get their inputs regarding this.

    Thanks.

  29. #30 by Peter on January 14, 2009 - 9:27 am

    Hello Reslie,

    We chose the product that was most suitable to our needs and to the software that we were developing, its a subjective choice really.I also don’t know any of the developers of VSTS 2008. I’m afraid I don’t have the time or the scope to expand further on this topic.

  30. #31 by John on January 29, 2009 - 3:51 am

    Is it possible to load test aith VSTS other types of .NET applications besides the web based ones?
    Have you ever done that?

  31. #32 by Peter on January 29, 2009 - 3:59 am

    Hi John,

    VSTS is a HTTP-based web testing solution so No I don’t believe you can. I certainly have’nt utilised it for any other type of testing.

    Peter

  32. #33 by Viky on March 12, 2009 - 11:12 am

    Hi,

    My question is how can i use the VSTS 2008 load testing feature to analyse that my web application is able to handle 50 users at a time. Please clarify my doubt.

    Thanks,
    Viky

  33. #34 by Joe on June 12, 2009 - 6:27 pm

    PDF’s are not being captured during web test recording with Visual Studio Team System 2008. Please help.

  34. #35 by Digvijay on July 8, 2009 - 7:10 am

    can we change the browser on which web test is performed,,
    some pages of my companies are not working on IE but working on FirFox..
    help is really appriciated..

  35. #36 by Peter on July 8, 2009 - 9:04 am

    No, only IE is supported

  36. #37 by Xavi on September 23, 2009 - 9:30 am

    Hi Everyone,

    I have a problem and I didn’t achieve understanding it. I created an Webtest project and later a web test file. It showed me a IE with the recording on. I put the Url of my application but the IE is always connecting and never showed me the page.

    Any help?

  37. #38 by Peter on September 23, 2009 - 9:37 am

    Hi Xavi,

    I’m not sure I fully understand your issue, when you go to record a web test the IE browser is automatically displayed and when you goto your application then the requests should be recorded by the web test in that browser session.

    Regards,

    Peter

  38. #39 by Valeria on September 28, 2009 - 7:00 pm

    Hi Peter,
    we have to make performance test on a web java application, which is running on a Red Hat Enterprise Linux 4 server, using a DB Oracle 10g R2.
    is possible use Visual Studio 2008 Test Load Agent to do the tests?

  39. #40 by Peter on September 29, 2009 - 8:07 am

    Hi Valeria,

    If its a browser based application then I believe it should be possible.

    Peter

  40. #41 by praveen on September 30, 2009 - 4:21 am

    In VSTS 2008 i am doing load test here i am connecting with two agents and one controller in summary report iam getting only one agent. i connected two agents in load settings . pls let me how i can proceed to get my two agents in load summary reprot

  41. #42 by Peter on September 30, 2009 - 9:00 am

    Hi Praveen,

    Are you sure that the test is running using controller and not running locally?

  42. #43 by Fabio on October 1, 2009 - 10:18 am

    Hi Peter

    I’m testing a web application using vs2005 web testing tool after installing it on my local computer. The test failed cause 2 dependent requests failed and got 404 Not Found:
    http://localhost/Portal/App_Themes/%3C%25
    http://localhost/Portal/~/App_Scripts/Script.js
    Now, I have read your answer to Reslie, to set the parse dependent requests option into false.
    Please, could you explain more about the case, and does setting the parse option into false affect the build test result?

  43. #44 by Peter on October 1, 2009 - 10:58 am

    Hi Fabio,

    The MSDN forum has many posts about this I would take a look at forum to see if some of these posts address your question. However here are my thoughts, I have also included some links below. Hope this helps.

    Parse Dependent Requests property :-

    By default, when a Web test is executed, HTML responses received from the Web server are parsed and any dependent requests, such as images or style sheets, are automatically submitted. This is usually desirable because it places the most realistic load on the server.

    However, if the goal of your load test is to place the maximum load on your application server as opposed to your Web server, you might wish to disable this behavior by setting the ParseDependentRequests properties on all of your Web test requests to false. If you do this, only the top level request is fetched, but not the images, style sheets, and so forth.

    You can also selectively block certain dependent requests.

    Set Parse Dependent Requests to false.
    Manually add the dependent links back onto the page by right-clicking on the request and selecting Add Dependent Request.

    Here is a link to a forum of questions and answers on this topic:-
    http://social.msdn.microsoft.com/Search/en-US?query=parse%20dependent%20requests&refinement=112&rn=Visual%20Studio%20Team%20System%20-%20Web%20and%20Load%20Testing%20Forum&rq=meta:Search.MSForums.ForumID(3852290f-4656-4bf6-8675-a8ad9f591d81)&ac=8

  44. #45 by Fabio on October 1, 2009 - 11:27 am

    Hi Peter
    Thanks a lot for your answer, I have another case, and would like to discuss it with you, I will go through it step by step to help you understanding my question:
    The application that I test is an ASP.net application, and in my browser I get aspx pages.In these aspx pages I have postback links controlled by ajax, so, when I start recording, that main pages that I request are recorded, but when I click on the postback links, the page stays and control changes as Ajax is applied here, and nothing except that main page is recorded in my test.
    My question is, how to record that postback operation, so that the webtest does it for me automatically.
    Hope you got my Idea..

  45. #46 by Peter on October 1, 2009 - 11:51 am

    Hi Fabio,

    I’m not familiar with ASP but I don’t think you need to worry about the postbacks because when you run the test it should handle these
    for you.. what happens when you run the test..does it run okay?

    Peter

  46. #47 by Fabio on October 1, 2009 - 12:05 pm

    Hi Peter,

    Everything works fine.
    I will point the exact case:
    First I login to the application, then I click “Items” and I move to a new page “Items List”. Everything is recorded so far. Now I have a link in this new page : “Add new item”, and when I click it, the control of adding new item comes up (Using Ajax Controls), but this last step is not recorded. Any ideas?

  47. #48 by Peter on October 1, 2009 - 1:07 pm

    Hi Fabio,

    I think the problem is that you are using VS 2005 but you should be using VS 2008 test edition. The 2005 version of the product does not record Ajax requests and that is why you are having an issue. Can you get VS 2008 test edition and then re-record. Everythign should work fine then.

    Regards,

    Peter

  48. #49 by Peter on October 1, 2009 - 4:08 pm

    Fabio,

    If you can’t get VS2008 test edition then you could capture the Ajax requests using the fiddler tool and then manually add these to your web test. That should work too.

    Peter

  49. #50 by Ravi on October 4, 2009 - 2:10 pm

    Hi Peter,
    I am looking for a Load testing tool for one of the web application which is developed using Asp.net Ajax,Webservices ,Javascript and also some third party tools used in it.I have a few queries can you help me on this?
    1)whether VSTS is compatible with the above application ?
    2)Also Wheteher VSTS is compatible with IE 7.0,8.0 and Firefox 2 and 3 version browsers?
    3)Also child browsers are opened for few requests in our application is Vsts capable of recording these as well
    Looking forward for your help.
    Thanks & Regards
    Ravi

  50. #51 by Peter on October 5, 2009 - 8:42 am

    Hi Ravi,

    Please see my answers below>>

    1)whether VSTS is compatible with the above application ?
    Yes it should work with the above application.

    2)Also Wheteher VSTS is compatible with IE 7.0,8.0 and Firefox 2 and 3 version browsers?
    Its compatible with IE 7.0 and Firefox 2 version browsers?

    After you record your web tests, you can run web test or load test web tests with different browser. For info, please read http://msdn2.microsoft.com/en-us/library/ms243189(VS.80).aspx, http://msdn2.microsoft.com/en-us/library/ms318557(VS.80).aspx.

    If a browser is not inluded in the build-in browser template list, you can add one. Please read the following posts for information http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=167495&SiteID=1, http://blogs.msdn.com/slumley/archive/2006/11/15/adding-an-ie7-browser-template-for-use-by-web-tests.aspx.

    3)Also child browsers are opened for few requests in our application is Vsts capable of recording these as well

    Ya the child browsers should be OK

    Regards

    Peter

  51. #52 by Fabio on October 11, 2009 - 12:46 pm

    Hi Peter,

    I could manage to get VS 2008 Test edition.
    The web test recorder appears in my IE when I start the test, but it’s not active.. It’s disabled for some reason..
    I am using IE7 and Windows Vista home premium as OS, and have made a research about the problem, I got some solutions but none of them worked with me.. The most possible cause is IE enhanced security, that I need to disable it in order to get the recorder to work, but I can’t find the way to do it. Also tried some solutions to disable the IE enhanced security but without success, some solutions were to disable it from control panel/windows setup, but can’t find it there, other were from registry, and also cannot find the registry keys that were mentioned…

    Any suggestions?

    Regards

    Fabio

  52. #53 by Peter on October 12, 2009 - 8:40 am

    Hi Fabio,

    I don’t know why your recorder would be disabled I certainly never encountered that issue. My suggestion would be to log this issue on the MSDN Forum at this stage and see what suggestions they make to resolve your issue.

    Regards,

    Peter

  53. #54 by Peter on October 12, 2009 - 10:10 am

    Hi Fabio – here is a blog article that makes some suggestions http://blogs.msdn.com/mtaute/archive/2007/11/09/diagnosing-and-fixing-web-test-recorder-bar-issues.aspx

    Hope this helps,

    Regards,

    Peter

  54. #55 by Mahadev on November 11, 2009 - 2:33 pm

    Hi Peter,

    My question is how can i use the VSTS 2005 load testing feature to analyse that my web application is able to handle 50 users at a time. Please clarify my doubt.

    Thanks,

  55. #56 by Peter on November 11, 2009 - 4:11 pm

    Hi Mahadev,

    1. Create a web test
    2. Then create a load test with a specific load pattern (constant or step load) and whatever runb settings you deem to be appropriate
    3. Add whatever web tests you want to the load test
    4. Run the Load Test and analyse the response times, DB server, App Server etc..
    5. While running login to your app and see what impact a load of 50 users has at different intervals

    Regards,

    Peter

  56. #57 by Mahadev on November 11, 2009 - 11:54 pm

    Hi Peter,
    I am looking for the How much Resource Usages by a Dot.net ( .Net) Application) while Application is Access by a User in a particular Machine ( PC OR Laptop)
    The Resource Usage means
    E.g. CPU Usages, Memory Usasge, Processor Usages
    Bases on these Overall Usages Details We can estimate or Suggest the Server Configuration to Client.
    If there are any Free Tool for measuring above details Please give me details. OR Can i get the above detail information through the VSTS 2005 or 2008 ( web test or Load Test )
    Thanks,

  57. #58 by Mahadev on November 12, 2009 - 12:23 am

    Hi Peter,

    I am looking For Stndards User manuals Format.
    Basicaly User Manuals are prepared on Module or User Role

  58. #59 by Peter on November 12, 2009 - 1:44 am

    Hi,

    The Visual Studio Team System 2008 Test Load Agent generates test loads for web applications to accurately test the performance of Web applications and servers under load. It does provide performance monitoring capabilities but having said that we used performance monitoring software named -Performasure to do the performance monitoring for us. So we generated sufficeint load using Visual Studio 2008 Load Test Tool and then monitored using Performasure.

    Regards,

    Peter

  59. #60 by Peter on November 12, 2009 - 1:47 am

    Hi,

    If you are looking for manuals, documentation or help on Visual Studio please goto the MSDN Forum – http://social.msdn.microsoft.com/Forums/en-US/vstswebtest/threads

    Regards,

    Peter

  60. #61 by Mahadev on November 12, 2009 - 2:37 am

    Hi Peter,
    Thanx for reply
    actually We developed a application For Medical Representive & in this application have the 4 modules .
    And this application have the 4 User Role
    1> Admin 2> Buadmin 3> Manager 4> User ( End User )
    So based on that User Role I want to Prepared the User Manuals For above user then this User Manual help them to operate or use the application workflow.
    so I want a User Manuals Format or Template which help me to prepared the Standard User manuals.

    Thanks,

  61. #62 by Mahadev on November 15, 2009 - 5:30 am

    Hi Peter,

    i want to know where we can get the information of page details ( every compontacts / objects size ) in web test using VSTS 2005.

    In our Application after user logged in he will clicks on one “Total” Link where application takes too much time for open the All total Data .
    same Scnario i have tested in web test where its showing Same Page Size is 1 MB but While Clicks on page requests plus mark its showig all 1 MB Compontacts

  62. #63 by Mahadev on November 15, 2009 - 5:31 am

    ITs not showing the 1 MB pages all componats / object

  63. #64 by Peter on November 15, 2009 - 5:35 am

    Hi,

    Please goto the MSDN Forum and register as a user, you can then create a question on the forum that will be answered by a member of the support team. They will be able to deal with questions that are specific to your application and its usage under VSTS2005.

  64. #65 by Ashi on November 19, 2009 - 2:56 am

    Hi,

    I have to create a web test for a site which opens up new page for each functionality. When the user logs in, he can view many fucntions he is allowed to perform. Whenever he clicks any function to work a new page is opened. Please suggest how to record all these pages. As they need to remember session id too..

  65. #66 by Peter on November 19, 2009 - 10:23 am

    Ashi you can find information relating to your question on:-

    Try:- http://blogs.msdn.com/edglas/pages/content-index-for-web-tests-and-load-tests.aspx

  66. #67 by Ravi on February 15, 2010 - 7:52 am

    Hi, I am trying to test a seibel application which contains Javascript objects, frames and applets. But I was failed in certains requests, like applicaiton menus are not displayed.

    My requirement is depend on this tools functionality. Could you help me in this regard?

  67. #68 by Ravi on February 15, 2010 - 7:54 am

    Hi,

    I think my query is not clearly mentioned. Hear a little bit expanded.

    I am trying to test a seibel application which contains Javascript objects, frames and applets. But I was failed to record certain requests.
    For example when executed the web test applicaitons menus are not displayed, and in some pages activeX content was blocked. I tried with FIDDLER as well.

    My requirement is depend on this tools functionality. Will this web test recording/FIDDLER will support “Javascript objects, frames and applets”

    Could any one help me in this regard?

  68. #69 by Peter on February 15, 2010 - 8:57 am

    Hi Ravi,

    As the Visual Studio web test only records communication between the browser and the web server, Applet communication is not recorded.

    The Web Test will not handle testing of application functionality within the Java applet once it is loaded.

    You can simulate JavaScript actions at runtime by using Web test plug-ins, Web test request plug-ins, extraction rules, or coded Web tests.

    Please take a look at these blogs:-http://blogs.msdn.com/slumley/pages/web-tests-work-at-the-http-layer.aspx

    Here is some informaton about JavaScript and ActiveX Controls in Web Tests
    http://msdn.microsoft.com/en-us/library/ms404678.aspx
    http://msdn.microsoft.com/en-us/library/ms182536.aspx

    Additionally – In VS 2010, there is a new UI test tool to perform this sort of testing,I have’nt yet used vs2010 though.

    Peter

  69. #70 by Sameer on February 19, 2010 - 6:48 am

    Hi Peter,
    I learned VSTS as part of my project testing and it worked fine for me for the project, but now when I am testing one of my other projects, it is causing me a lot of problems.
    Here is the scenario:-
    I recorded the website in which the user needs to login to the site and select a list of options from the menu manager and then create a new form and then move on to next page and then submit the form by selecting few plans. The application works fine during recording.

    But when I try to run the web test, it fails throwing an 500 internal server error and the web browser page displays the ID not found and on the response it says EVENT_TARGET failed and when I see the EVENT_TARGET in the previous page it is null and it remains the same for previous pages also but those pass the validation, I am not quite sure why it is happening like this for only this page. Could you please help me on this? Thanks and appreciate your feedback.

  70. #71 by Peter on February 19, 2010 - 7:03 am

    Hi Sameer,

    I do recommend that you take a look at the msdn forum that addresses issues like the one you are encountering. That forum can be accessed at:-http://social.msdn.microsoft.com/Forums/en/vstswebtest/thread/bd3b1caf-ca7b-408e-b415-3b8e3465bb03

    The reason for your issues could be because –
    With ASP.NET sites, this problem most commonly occurs when a Web control calls the __doPostBack() JavaScript method to set the __EVENTTARGET hidden field as shown above. Automatic hidden field binding results in the form parameter having a value such as {{$HIDDEN1.__EVENTTARGET}}, instead of the actual value — btnNext. To correct this problem, the parameter value must be set to the value being set in JavaScript (for example, btnNext).

    OR

    take a look at the msdn library – http://msdn.microsoft.com/en-us/library/ms364082(VS.80).aspx which details why the Web Server Responds Differently During Execution than Recording

    I hope this helps with your issue in some way, do let me know if the above has helped you resolve your issue.

    Best Regards,

    Peter

  71. #72 by Sameer on February 19, 2010 - 9:00 am

    Hi Peter,
    Thanks a bunch for your reply. I am getting the following errors to be in precise.
    Request failed: Context parameter ‘$HIDDEN1.__EVENTVALIDATION’ not found in test context (This is the error that I view in web browser and response) and the follwing values are null
    $HIDDEN1.__EVENTARGUMENT
    $HIDDEN1.__EVENTTARGET
    $HIDDEN1.__LASTFOCUS
    Could you please help me on this.
    and more over
    “{{$HIDDEN1.__EVENTTARGET}}, instead of the actual value — btnNext. To correct this problem, the parameter value must be set to the value being set in JavaScript (for example, btnNext).” I am not sure where and how to set this value. So, I appreciate if you could please provide me with the solution. Once again thank you very much for your reply.

  72. #73 by Peter on February 19, 2010 - 5:11 pm

    Sameer,

    Please take a look at Sean Lumleys blog for a possible solution:-

    http://blogs.msdn.com/slumley/pages/debugging-errors-in-load-test.aspx

  73. #74 by Sameer on February 19, 2010 - 7:52 pm

    Hi Peter,
    Thank you very much for the reply. I reviewes the Sean Lumleys blog but of no use , because I already knew the error that I am getting, it is showing me stating that ApplicationID not found in the browser an SQL Exception, but that works fine when I normally recored the test. So. I am more thankful if you could more elaborate and fix this issue. Thanks and apprecaite your feedback.

  74. #75 by Sameer on February 22, 2010 - 3:53 pm

    Peter please do reply to my question. I am in desparate need of that.

  75. #76 by Zankar Patel on April 4, 2010 - 8:18 am

    Hi there,

    I would like to know that if Microsoft Visual Studio 2008 Test Edition will work with Silverlight Development envionment for load testing. Please reply to me on my email-: patelzankar@rediffmail.com

  76. #77 by Arun on April 13, 2010 - 6:54 am

    Hi,

    I am Arun, did any one know how to test an Hand held application using VSTS Test Edition tool.

  77. #78 by Ashraf on April 19, 2010 - 9:20 am

    Hi,

    I’m using VSTS 2008 for web testing of a .NET application, the application contains JAVA SCRIPT and AJAX. the VSTS 2008 can record the pages but while run the recorded script, it can’t login to the solution, it displays only the login page, but while recorded, i logged in and performed some actions. Also displays “Pass”. What should i have to do to solve the problem.

  78. #79 by Peter on April 19, 2010 - 10:03 am

    Ashraf,

    What errors are you seeing any errors in the response?
    Record a seperate test for just logging in and run that and see what the response shows you.

  79. #80 by Prasad Patel on April 19, 2010 - 10:39 am

    hi peter,

    I am suppose to configure the URL dynamically. Now i have already recorded the webtest, how do i change the url of all the webtest’s request. I can probably change the WebServer by “Parameterize Web server” property but what about the other part of the URL.

    E.g http://123.45.69.85//home/library

    In the above e.g now how do i change , so that i can make or set some common place where i change the same only once and it gets refelcted everywhere.

    Please Reply.

  80. #81 by Ashraf on April 19, 2010 - 10:47 am

    Peter,

    Thanks for the quick response. Actualy it is not showing any error. I have recorded separate test, just log in and log out. but still while run the script it keeps the login page and can’t login. No error.

  81. #82 by Peter on April 19, 2010 - 11:04 am

    Hi Ashraf,

    Are you sure its not logging in, because if it did’nt login none of your other tests should run. Just because it showing you the login page does’nt mean its not logging in, the tool is based on requests and responses and its those requests you should be looking at not the page that is beiung rendered. If the tool is reporting a pass then it must be logging in. If you run the login again see what the responses are for the login, there is a tab in the results that allows you to review the responses.

  82. #83 by Ashraf on April 19, 2010 - 12:42 pm

    Dear Peter,

    Many many thanks for the reply. Actually i’m using the VSTS for more than a year. I have some recorded scripts, which i recorded earlier. Now while run the old scripts, in result window i can see that the actions step by step and it is working fine. Now the application has been updated with AJAX implementation, now while i’m recording newly, it seems that the recording is going well but while run the script and view the result step by step it displays login page first, go next step and view the same login page, for every steps we view the same login page without seeing the actual page.

  83. #84 by Peter on April 19, 2010 - 1:00 pm

    Ashraf,

    What version of VSTS are you using I know the 2005 edition did not work well with Ajax. Apart from that I can’t figure why you could be having an issue with the Login page running. All I can suggest is that you post a question on the MSDN forum that deals with VSTS issues and see if anyone on the forum can be of assistance.

  84. #85 by Ashraf on April 19, 2010 - 8:40 pm

    Dear Peter,

    Thanks for your suggestion, i’ll post a question on the MSDN forum.

  85. #86 by anemon on June 1, 2010 - 6:40 pm

    Hi!
    I have the same problem – “Context parameter ‘$HIDDEN1.__EVENTVALIDATION’ not found in test context” in load test. Web test passed ok. If I`d remove $HIDDEN1.__EVENTVALIDATION from web test, the next form post parameter($HIDDEN1.__EVENTVARGUMENT, …) will cause error in load test
    How to solve this problem?
    P.s. I use vs 2008, 2010

  86. #87 by anemon on June 3, 2010 - 6:50 am

    fix this

  87. #89 by Ashraf on October 7, 2010 - 12:54 pm

    Hi,

    can i perform web test and load test on php application using VSTS 2008

  88. #90 by Venkat on November 12, 2010 - 6:30 am

    Hi peter,
    I am able to do load test on a web application using vsts 2010.But it restricts generation of load up to 250 users.For generating more than 250 users load it asks for purchase a virtual user license pack.Is there any other way to create more load(i.e my recorded actions have to run across 1000 browsers simultaneously) by editing recorded script without purchasing virtual user license pack?
    In general how can we edit and save the recorded script in webtest?
    Can u help me in finding the solution. If it is possible give me some sample code or link.

  89. #91 by Peter on November 12, 2010 - 10:40 am

    Hi Venkat,

    I am still using vsts2008 and not 2010. However it appears from what you are saying that this is a licensing issue, you must be using a trial version or something.

  90. #92 by Ramesh on November 22, 2010 - 11:27 am

    Hi

    I was looking into VS Web test and we are at a stage where our construction is complete and also the System testing is complete. We quite a lot of Minor changes that needs to implemented that would touch a lot of the code paths.

    Will it be a fair assumption to say Web test at this point cannot be used as a unit testing tool and can definitely be used as Regression testing tool. Since we would be targeting specific important scenarios in Regression testing..

    Thanks
    Ramesh

  91. #93 by Peter on November 22, 2010 - 11:37 am

    Hi Ramesh,

    Without more information its difficult for me to advise, but in general if construction is complete and System testing is complete. Then it sounds like a good time to put a regression test suite together.

    Changes to the code might break some of the regression tests and cause them to fail but that should be ok, because that will highlight to you areas of functionaliy that have changed. It should just be a matter of fixing up those tests and re-running.

    Regression test scripts should save you a lot of time if they are recorded at the right time and changes to them are minimal. But there is always a cost in terms of maintenance.

    Hope that helps..

    Rgds,

    Peter

  92. #94 by Sutapa on April 7, 2011 - 11:20 am

    Hi,

    Does VSTS 2008 support recording for https (secure) sites? I have tried doing it with one application, it does start the recording and login page gets recorded but does not go beyond that. The recording stops abruptly after that.

    Please if any of you have used VSTS 2008 for load testing a https application then let me know. Also suggest some other tools(preferably open source) if VSTS does not work on https.

    Regards,

    Sutapa

  93. #95 by Peter on April 7, 2011 - 11:28 am

    Hi Sutapa,

    Yes VSTS 2008 does support https. If you site needs client certificates then you need a coded test. If this is the case take a look at the MSDN forum there is a section on Web Testing and you can search that for suggestions on how to do that.

    If its a case that the initial window closes you could try this:-
    http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=4344&SiteID=1

    Hope that helps,

    Peter

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: