evaluators

package
v0.5.2 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Apr 18, 2025 License: Apache-2.0Imports: 10 Imported by: 0

Documentation

Overview

Package evaluators defines a set of Genkit Evaluators for popular use-cases

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func ConfigureMetric

func ConfigureMetric(g *genkit.Genkit, metric MetricConfig) (ai.Evaluator, error)

Types

type EvaluatorType

type EvaluatorType int

EvaluatorType is an enum used to indicate the type of evaluator being configured for use

const (  EvaluatorDeepEqual EvaluatorType = iota EvaluatorRegex  EvaluatorJsonata )

func (EvaluatorType) String

func (ss EvaluatorType) String() string

type GenkitEval

type GenkitEval struct {  Metrics []MetricConfig// Configs for individual metrics// contains filtered or unexported fields }

GenkitEval is a Genkit plugin that provides evaluators

func (*GenkitEval) Init

func (ge *GenkitEval) Init(ctx context.Context, g *genkit.Genkit) (err error)

Init initializes the plugin.

func (*GenkitEval) Name

func (ge *GenkitEval) Name() string

type MetricConfig

type MetricConfig struct {  MetricType EvaluatorType}

MetricConfig provides configuration options for a specific metric. More Params (judge LLMs, etc.) could be configured by extending this struct

close