ml3m
0.0.20

Getting Started

  • Installation
  • Generating Model Responses
  • Evaluating Model Performance

API Reference

  • ml3m.base
  • ml3m.errors
  • ml3m.mcq
  • ml3m.qa
  • ml3m.utils.openai
ml3m
  • Index

Index

_ | B | E | G | I | L | M | Q | R | S

_

  • _aget_score() (ml3m.base.BaseEvaluator method)
  • _extract_scores() (ml3m.base.BaseOpenAIEvaluator method)
  • _get_score() (ml3m.base.BaseEvaluator method)
  • _prompt() (ml3m.base.BaseOpenAIEvaluator method)

B

  • BaseEvaluator (class in ml3m.base)
  • BaseOpenAIEvaluator (class in ml3m.base)

E

  • evaluate() (ml3m.base.BaseEvaluator method)
    • (ml3m.base.BaseOpenAIEvaluator method)
    • (ml3m.mcq.McqOpenAIEvaluator method)
    • (ml3m.qa.QaMetricEvaluator method)
    • (ml3m.qa.QaOpenAIEvaluator method)

G

  • generate() (ml3m.base.ResponseGenerator method)
  • get_openai_config() (in module ml3m.utils.openai)

I

  • InvalidParameterError

L

  • load_avg_score() (ml3m.base.BaseEvaluator method)
    • (ml3m.base.BaseOpenAIEvaluator method)
    • (ml3m.mcq.McqOpenAIEvaluator method)
    • (ml3m.qa.QaMetricEvaluator method)
    • (ml3m.qa.QaOpenAIEvaluator method)
  • load_scores() (ml3m.base.BaseEvaluator method)
    • (ml3m.base.BaseOpenAIEvaluator method)
    • (ml3m.mcq.McqOpenAIEvaluator method)
    • (ml3m.qa.QaMetricEvaluator method)
    • (ml3m.qa.QaOpenAIEvaluator method)

M

  • McqOpenAIEvaluator (class in ml3m.mcq)
  • ml3m.base
    • module
  • ml3m.errors
    • module
  • ml3m.mcq
    • module
  • ml3m.qa
    • module
  • ml3m.utils.openai
    • module
  • module
    • ml3m.base
    • ml3m.errors
    • ml3m.mcq
    • ml3m.qa
    • ml3m.utils.openai

Q

  • QaMetricEvaluator (class in ml3m.qa)
  • QaOpenAIEvaluator (class in ml3m.qa)

R

  • ResponseGenerator (class in ml3m.base)

S

  • ScoringError

© Copyright 2023, Yao Xiao.

Built with Sphinx using a theme provided by Read the Docs.