问题
As the project I'm working on is growing, the number of tests is also growing. But, in my case, when the number of scenario's being tested increases, the stability of Specflow seems to be decreasing.
Let me try to clearify: When I'm running, for instance, some test lists (with 5 to 10 scenario's) in Visual Studio 2010 separately, all the scenario's are passing. However, when I'm running all the test lists at once (something like 70 scenario's total), some scenario's fail, that in the 'separate test list run' passed. When I immediately run the 'total test run' again, different scenario's fail, or sometimes all the files pass. In other words, which scenario's fail is totaly random.
Is anyone familiar with this issue and/or can enlighten me about the (what it seems to be) stability of Specflow when the number of scenario's to test is increasing?
回答1:
I dont think this is a specflow issue at all, we run around 800 tests and all pass every time. What I expect is that you are getting crosstalk between your tests. IE your tests are failing because they are sharing data you arent expecting.
This is a pretty common problem.
来源：https://stackoverflow.com/questions/11882712/specflow-stability