evolving_ideas.infra.local_llm_client

evolving_ideas.infra.local_llm

Classes

LocalLLM

A simple local LLM interface using Hugging Face Transformers.

Module Contents

class evolving_ideas.infra.local_llm_client.LocalLLM(model_name: str | None = 'tiiuae/falcon-rw-1b')

Bases: evolving_ideas.infra.llm_interface.LLMInterface

A simple local LLM interface using Hugging Face Transformers. This is a naive implementation and can be improved with better prompt formatting.

generator

ask(prompt: str, context: str) → str

chat(chatlog: list[dict]) → str