C#•9mo ago

Issues running BenchmarkDotNet fron NUnit test

I am trying to have BenchmarkDotNet run a Benchmark when running (NUnit) tests for one of my services.
However the Benchmark fails with 'Build Error'.
My whole project has no trouble building and running, so i don't understand what its issue is...

I have included the testlog, for anybody who wish to look through that...

My test that runs the Benchmark is the following.

c#
[Test]
public void BenchmarkPerformance()
{
    ManualConfig config = ManualConfig.Create(DefaultConfig.Instance)
        .WithOptions(ConfigOptions.DisableOptimizationsValidator).AddLogger(ConsoleLogger.Default)
        .AddExporter(MarkdownExporter.GitHub).AddExporter(HtmlExporter.Default).AddExporter(JsonExporter.Default)
        .AddValidator(JitOptimizationsValidator.DontFailOnError).AddFilter(new ExcludeAssembliesFilter("Uno"));

    Summary? summary = BenchmarkRunner.Run<AppliedKeywordServiceBenchmarks>(config);
}

private class ExcludeAssembliesFilter : IFilter
{
    private readonly string[] _excludedAssemblies;

    public ExcludeAssembliesFilter(params string[] excludedAssemblies)
    {
        _excludedAssemblies = excludedAssemblies;
    }

    public bool Predicate(BenchmarkCase benchmarkCase)
    {
        foreach (string assembly in _excludedAssemblies)
        {
            if (benchmarkCase.Descriptor.Type.Assembly.FullName.Contains(assembly))
            {
                return false;
            }
        }

        return true;
    }
}

c#
[Test]
public void BenchmarkPerformance()
{
    ManualConfig config = ManualConfig.Create(DefaultConfig.Instance)
        .WithOptions(ConfigOptions.DisableOptimizationsValidator).AddLogger(ConsoleLogger.Default)
        .AddExporter(MarkdownExporter.GitHub).AddExporter(HtmlExporter.Default).AddExporter(JsonExporter.Default)
        .AddValidator(JitOptimizationsValidator.DontFailOnError).AddFilter(new ExcludeAssembliesFilter("Uno"));

    Summary? summary = BenchmarkRunner.Run<AppliedKeywordServiceBenchmarks>(config);
}

private class ExcludeAssembliesFilter : IFilter
{
    private readonly string[] _excludedAssemblies;

    public ExcludeAssembliesFilter(params string[] excludedAssemblies)
    {
        _excludedAssemblies = excludedAssemblies;
    }

    public bool Predicate(BenchmarkCase benchmarkCase)
    {
        foreach (string assembly in _excludedAssemblies)
        {
            if (benchmarkCase.Descriptor.Type.Assembly.FullName.Contains(assembly))
            {
                return false;
            }
        }

        return true;
    }
}

BenchmarkPerformance-638798724900292607.testlog123.23KB

WolfDKOP•4/10/25, 7:23 AM

From the testlog, it does not appear that my ´ExcludeAssembliesFilter ´ does the expected action of excluding my Uno Platform project from the code generated by BenchmarkDotNet. I highly suspect it is the inclusion of Uno Platform in the code generated by BenchmarkDotNet that is messing it up...
As i have no previous experience using BenchmarkDotNet, i have used Copilot to generate most of the code for this benchmarking, so it might also have some faults because of that...

The class can be view in full here: https://github.com/NoergaardMikkelsen/gaio/blob/benchmark/Statistics.Tests/Services/Benchmark/AppliedKeywordServiceBenchmarks.cs

GitHub

gaio/Statistics.Tests/Services/Benchmark/AppliedKeywordServiceBench...

Program to register questions to be asked to AI's and responses logged - NoergaardMikkelsen/gaio

WolfDKOP•4/10/25, 9:43 AM

... Fixed... One of my test was targeting a class in my Uno Platform project. Now that i have removed that test, and the project reference the benchmark works.