xunitcontrib Issue Tracker Rss Feed

Commented Unassigned: Skipping tests in base class [4162]

cowst — Tue, 18 Jun 2013 08:09:35 GMT

Commented Unassigned: Cant run unit test built with xUnit 2 [4163]

mattellis — Thu, 06 Jun 2013 19:38:37 GMT

When I try to run a unit test that is referencing xUnit 2, I get the following error:

[Window Title]
Unit Test Runner

[Main Instruction]
Unit Test Runner failed to run tests

[Content]
System.ArgumentException: Could not find file: C:\Birddog\Merge\9.6\BirdDogFrameworkLayer\BirdDogSoftware.FactoryTest\bin\xunit.dll

[^]

[Buttons]
[Header=_OK, Content=]

[Expanded Information]
at Xunit.ExecutorWrapper..ctor(String assemblyFilename, String configFilename, Boolean shadowCopy)
at XunitContrib.Runner.ReSharper.RemoteRunner.TestRunner.Run(XunitTestAssemblyTask assemblyTask, TaskProvider taskProvider) in c:\Users\Matt\Code\forks\xunitcontrib\forks\main\resharper\src\xunitcontrib.runner.resharper.runner\TestRunner.cs:line 41
at XunitContrib.Runner.ReSharper.RemoteRunner.XunitTaskRunner.ExecuteRecursive(TaskExecutionNode node) in c:\Users\Matt\Code\forks\xunitcontrib\forks\main\resharper\src\xunitcontrib.runner.resharper.runner\XunitTaskRunner.cs:line 23
at JetBrains.ReSharper.TaskRunnerFramework.StartupTaskRunnerHost.Execute(TaskExecutionNode node)

Comments: The runner doesn't support xunit2 yet. It requires a significant rewrite to work with it, and while I have hacked together a proof of concept, it's nowhere near ready to use, and needs a proper implementation before it's useful. Also, xunit2 is still in early alpha stages, and I don't think it adds anything over the stable 1.9.1. I'd recommend using that version for now. My plan is to try and release a compatible runner around the time xunit2 hits beta.

Created Unassigned: Cant run unit test built with xUnit 2 [4163]

VoiceOfWisdom — Thu, 06 Jun 2013 16:39:44 GMT

Commented Unassigned: Skipping tests in base class [4162]

mattellis — Wed, 29 May 2013 16:42:13 GMT

Edited Unassigned: Skipping tests in base class [4162]

mattellis — Wed, 29 May 2013 16:42:13 GMT

Commented Unassigned: Skipping tests in base class [4162]

Sgro — Wed, 29 May 2013 14:50:00 GMT

I have some base classes for reused tests (some of them abstract, some of them concrete).

When running ALL tests in the solution from resharper integration, all the tests in the base classes are being skipped, with yellow icon and description "Inconclusive: test wasn't run".

If I run only the tests of a single derived class though, all the tests are run, including the ones in the base class which were skipped when running all.

I've already checked to have the correct version of the plugin. I'm using Vs2012 update 2 with Resharper 7.1
Comments: If I keep it exactly as you wrote it, it works. However, I was able to reproduce the problem by adding a Derived2 class, adding a Derived2Test class as well. The tests in the base class are either ran for Derived OR Derived2, not both. I.E. If I put the tests: Test1 Test2 Test3 in the base test class, I can get one of the following scenarios: Test1 is ran for Derived but not for Derived2. Test2 and Test3 are ran for Derived2 but not for Derived. This or any other combination, but the same test is never run for more than 1 of the derived classes. Hope this helps you to find out what's wrong.

Commented Unassigned: Skipping tests in base class [4162]

mattellis — Wed, 29 May 2013 13:45:24 GMT

I have some base classes for reused tests (some of them abstract, some of them concrete).

When running ALL tests in the solution from resharper integration, all the tests in the base classes are being skipped, with yellow icon and description "Inconclusive: test wasn't run".

If I run only the tests of a single derived class though, all the tests are run, including the ones in the base class which were skipped when running all.

I've already checked to have the correct version of the plugin. I'm using Vs2012 update 2 with Resharper 7.1
Comments: Unfortunately, I can't reproduce this error. I'm trying with ReSharper 7.1 + VS2012 Update 2. I'm using the following code, all in one file, and running it every way I can think of - right click on file, project, solution, in the file, and running from the ReSharper -> Unit Test menu. The test in the base class always runs. ``` using System; using Xunit; namespace xunitDerivedTests { public abstract class ClassBase { } public class Derived : ClassBase { public string Code { get; set; } } public abstract class ClassBaseTest<T> where T : ClassBase { [Fact] public void ShouldNotThrow() { Assert.DoesNotThrow(() => Activator.CreateInstance<T>()); } } public class DerivedTest : ClassBaseTest<Derived> { [Fact] public void ShouldThrowWithNullCode() { var item = new Derived(); var ex = Record.Exception(() => item.Code = null); Assert.Null(ex); } } } ``` Can you confirm if this test file runs for you or not, please? Thanks Matt

Commented Unassigned: Skipping tests in base class [4162]

Sgro — Tue, 21 May 2013 12:54:42 GMT

I have some base classes for reused tests (some of them abstract, some of them concrete).

When running ALL tests in the solution from resharper integration, all the tests in the base classes are being skipped, with yellow icon and description "Inconclusive: test wasn't run".

If I run only the tests of a single derived class though, all the tests are run, including the ones in the base class which were skipped when running all.

I've already checked to have the correct version of the plugin. I'm using Vs2012 update 2 with Resharper 7.1
Comments: I could paste here some sample code, anonymized. ``` public abstract class ClassBaseTest<T> where T : ClassBase // ClassBase is abstract { [Fact] public void ShouldNotThrow() { Assert.DoesNotThrow(() => Activator.CreateInstance<T>()); } } ``` Then a derived test: ``` public class DerivedTest : ClassBaseTest<Derived> // Derived : ClassBase { [Fact] public void ShouldThrowWithNullCode() { var item = new Derived(); var ex = Record.Exception(() => item.Code = null); Assert.NotNull(ex); } ``` If I run all the tests in the solution, or in the folder containing those tests, the tests defined in the abstract base class are skipped with the aforementioned message. If I run the tests only in the derived test class, everything works fine. As stated, with TeamCity and xunit runner gui everything works fine.

Commented Unassigned: Skipping tests in base class [4162]

mattellis — Tue, 21 May 2013 12:27:52 GMT

Commented Unassigned: Skipping tests in base class [4162]

Sgro — Tue, 21 May 2013 11:59:55 GMT

Created Unassigned: Skipping tests in base class [4162]

Sgro — Tue, 21 May 2013 11:58:19 GMT

Closed Issue: Support RunWith attribute [2139]

mattellis — Thu, 09 May 2013 19:06:20 GMT

There is currently mixed support for the RunWith attribute. The file doesn't display unit test icons next to the class or the test methods, but the item appears to be run when running all tests in a file/assembly.
Comments: Fixed in release 1.0

Closed Issue: Please provide Strong-named binaries [4121]

mattellis — Thu, 09 May 2013 19:05:58 GMT

As the title says.

More context from Brad re: xunit's strong-named assemblies.

We strong-name xunit.dll, xunit.extensions.dll, and xunit.runner.dll.

The reason is simple: if you are strong naming something, then it must be linked against only things which are themselves strong named. We also ship our public and private key in the repository so that people can strong name it themselves, so we don't consider this to be any kind of security measure (nor should our users). If compilers didn't enforce "you are signed, therefore everything you link to must be signed", we never would've bothered.
Comments: Shouldn't need to reference any xunitcontrib libraries. ReSharper runner shouldn't care about strong named assemblies.

Closed Issue: NuGet package [4124]

mattellis — Thu, 09 May 2013 19:04:39 GMT

Create a NuGetPackage for xUnit.net Contrib. It will be much easier to install it and upgrade it's versions..
Comments: Implemented as part of ReSharper 8.0's nuget based extension manager

Closed Unassigned: MDA throwning BindingFailure and LoadFromContext [4161]

mattellis — Thu, 09 May 2013 19:04:03 GMT

If I run the Resharper test runner throwning the following MDA (Managed Debugging Assistants, see http://msdn.microsoft.com/en-us/library/d21c150d.aspx):
* BindingFailure
* LoadFromContext
I get the following dialogs:

__LoadFromContext was detected__
```
Message: The assembly named 'xunit.runner.utility' was loaded from 'file:///C:/Users/user/AppData/Local/JetBrains/ReSharper/v6.1/Plugins/xunitcontrib/xunit.runner.utility.DLL' using the LoadFrom context. The use of this context can result in unexpected behavior for serialization, casting and dependency resolution. In almost all cases, it is recommended that the LoadFrom context be avoided. This can be done by installing assemblies in the Global Assembly Cache or in the ApplicationBase directory and using Assembly.Load when explicitly loading assemblies.

```
and

__BindingFailure was detected__
```
Message: The assembly with display name 'xunit.runner.utility.{Dynamic}' failed to load in the 'LoadFrom' binding context of the AppDomain with ID 2. The cause of the failure was: System.IO.FileNotFoundException: Could not load file or assembly 'xunit.runner.utility.{Dynamic}, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null' or one of its dependencies. The system cannot find the file specified.
```
and

__BindingFailure was detected__
```
Message: The assembly with display name 'xunit.runner.utility.{Dynamic}' failed to load in the 'LoadFrom' binding context of the AppDomain with ID 2. The cause of the failure was: System.IO.FileNotFoundException: Could not load file or assembly 'xunit.runner.utility.{Dynamic}, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null' or one of its dependencies. The system cannot find the file specified.
```
and

__BindingFailure was detected__
```
Message: The assembly with display name 'xunit.runner.utility.{Dynamic}' failed to load in the 'LoadFrom' binding context of the AppDomain with ID 2. The cause of the failure was: System.IO.FileNotFoundException: Could not load file or assembly 'xunit.runner.utility.{Dynamic}, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null' or one of its dependencies. The system cannot find the file specified.
```
Is this by design?

Closed Issue: Test categorization [4128]

mattellis — Thu, 09 May 2013 19:02:53 GMT

There is a nice Category feature in the R# test runner but unfortunately it appears it doesn't work with XUnit. Best I can tell there is no category attribute in Xunit and I can request that with them. There is a category attribute in component model data annotations that could perhaps be used? Or some other way to get this to work possibly?
Comments: Fixed in release 1.0

Closed Issue: dotCover coverage fails in theories in subsequent sessions [4157]

mattellis — Thu, 09 May 2013 19:01:50 GMT

Run a Theory test with dotCover code coverage. The results show the Theory is covered. Close the test session and start again in a new session. The results show the Theory is not covered.
Comments: Fixed in release 1.0

Closed Feature: Add intellisense and find usage support for PropertyDataAttribute [4158]

mattellis — Thu, 09 May 2013 19:01:15 GMT

Like ReSharper's support for nunit's TestCaseSourceAttribute - intellisense for the property named in PropertyData, ctrl-click navigation to the property and include attribute in find usages.
Comments: Fixed in release 1.0

Closed Issue: Classes with only private tests not marked as tests [4159]

mattellis — Thu, 09 May 2013 19:00:32 GMT

If a class only has private tests, it's not marked as a test class in the editor. It must have at least one public test method.
Comments: Fixed in release 1.0

Commented Unassigned: MDA throwning BindingFailure and LoadFromContext [4161]

mattellis — Thu, 09 May 2013 18:57:46 GMT