EvalRun
AgentPrism.Abstractions.dllA single execution record and summary of an EvalSuite.
public sealed record EvalRun : IEquatable<EvalRun>Inheritance
Section titled “Inheritance”Implements
Section titled “Implements”Inherited Members
Section titled “Inherited Members”object.GetType(), object.ToString(), object.Equals(object?), object.Equals(object?, object?), object.ReferenceEquals(object?, object?), object.GetHashCode()
Remarks
Section titled “Remarks”EvalRun.AgentVersion and EvalRun.ModelId are critical: regression tracking compares the same suite’s result across different versions. Both are filled in when the run actually starts (on the transition to EvalRunStatus.Running) — not at trigger time, because the agent definition can change while the job waits in the queue.
Constructors
Section titled “Constructors”EvalRun()
Section titled “ EvalRun()”public EvalRun()Properties
Section titled “Properties”AgentVersion
Section titled “ AgentVersion”The agent definition version being measured. null before the run starts.
public int? AgentVersion { get; init; }Property Value
Section titled “Property Value”int?
CompletedAt
Section titled “ CompletedAt”The completion time (UTC). null while the run is in progress.
public DateTimeOffset? CompletedAt { get; init; }Property Value
Section titled “Property Value”Failed
Section titled “ Failed”The number of remaining (failed) cases.
public int Failed { get; init; }Property Value
Section titled “Property Value”The run identifier.
public required Guid Id { get; init; }Property Value
Section titled “Property Value”InputTokens
Section titled “ InputTokens”The total input token count.
public long? InputTokens { get; init; }Property Value
Section titled “Property Value”long?
The identifier of the job record responsible for executing this run. The run is executed through the job queue (IJobStore).
public Guid? JobId { get; init; }Property Value
Section titled “Property Value”Guid?
ModelId
Section titled “ ModelId”The model identifier being measured. null before the run starts.
public string? ModelId { get; init; }Property Value
Section titled “Property Value”OutputTokens
Section titled “ OutputTokens”The total output token count.
public long? OutputTokens { get; init; }Property Value
Section titled “Property Value”long?
Passed
Section titled “ Passed”The number of cases that passed.
public int Passed { get; init; }Property Value
Section titled “Property Value”StartedAt
Section titled “ StartedAt”The start time (UTC).
public required DateTimeOffset StartedAt { get; init; }Property Value
Section titled “Property Value”Status
Section titled “ Status”The current status of the run.
public required EvalRunStatus Status { get; init; }Property Value
Section titled “Property Value”SuiteId
Section titled “ SuiteId”The identifier of the suite being measured.
public required Guid SuiteId { get; init; }Property Value
Section titled “Property Value”TenantId
Section titled “ TenantId”The tenant the run belongs to.
public required string TenantId { get; init; }Property Value
Section titled “Property Value”The total number of cases.
public int Total { get; init; }Property Value
Section titled “Property Value”Methods
Section titled “Methods”Equals(object?)
Section titled “ Equals(object?)”public override bool Equals(object? obj)Parameters
Section titled “Parameters”obj object?
Returns
Section titled “Returns”Equals(EvalRun?)
Section titled “ Equals(EvalRun?)”public bool Equals(EvalRun? other)Parameters
Section titled “Parameters”other EvalRun?
Returns
Section titled “Returns”GetHashCode()
Section titled “ GetHashCode()”public override int GetHashCode()Returns
Section titled “Returns”ToString()
Section titled “ ToString()”public override string ToString()Returns
Section titled “Returns”Operators
Section titled “Operators”operator ==(EvalRun?, EvalRun?)
Section titled “ operator ==(EvalRun?, EvalRun?)”public static bool operator ==(EvalRun? left, EvalRun? right)Parameters
Section titled “Parameters”left EvalRun?
right EvalRun?
Returns
Section titled “Returns”operator !=(EvalRun?, EvalRun?)
Section titled “ operator !=(EvalRun?, EvalRun?)”public static bool operator !=(EvalRun? left, EvalRun? right)Parameters
Section titled “Parameters”left EvalRun?
right EvalRun?