evolving_ideas.infra.local_llm_client
=====================================

.. py:module:: evolving_ideas.infra.local_llm_client

.. autoapi-nested-parse::

   evolving_ideas.infra.local_llm



Classes
-------

.. autoapisummary::

   evolving_ideas.infra.local_llm_client.LocalLLM


Module Contents
---------------

.. py:class:: LocalLLM(model_name: Optional[str] = 'tiiuae/falcon-rw-1b')

   Bases: :py:obj:`evolving_ideas.infra.llm_interface.LLMInterface`


   A simple local LLM interface using Hugging Face Transformers.
   This is a naive implementation and can be improved with better prompt formatting.


   .. py:attribute:: generator


   .. py:method:: ask(prompt: str, context: str) -> str


   .. py:method:: chat(chatlog: list[dict]) -> str