LLMs

class Claude2(auth_token: str | None = None, api_key: str | None = None)

Bases: BaseLLM

Class for Claude 2 LLM by Anthropic.

Parameters:

  • auth_token (str | None) – Authentication token for accessing Anthropic LLMs

  • api_key (str | None) – API Key for accessing Anthropic LLMs

generate(prompt: str, max_tokens_to_sample: int = 1000) → str

Generate response to a prompt.

Parameters:

  • prompt (str) – Prompt

  • max_tokens_to_sample (int) – Maximum number of tokens to generate

Returns:

Generated response from the LLM

Return type:

str

Example:

from llmbox.llms import Claude2
llm = Claude2()
response = llm.generate(prompt='\n\nHuman: How far is the moon from the earth? \n\nAssistant:')
print(response)