xtrace_sdk.inference.llm
========================

.. py:module:: xtrace_sdk.inference.llm


Classes
-------

.. autoapisummary::

   xtrace_sdk.inference.llm.InferenceClient


Module Contents
---------------

.. py:class:: InferenceClient(inference_provider, model_name, api_key = None, prompt_template = None)

   A client wrapper for interacting with inference models via OpenAI API



   .. py:attribute:: client


   .. py:attribute:: model_name


   .. py:method:: query(query, context = None, stream = False, print_response = True)

      Query the inference model.

      :param query: The query string to send to the model.
      :type query: str
      :param context: Optional context string to provide additional information to the model.
      :type context: str, optional