Chatting With a LLM Using Ollama

Generative AI using a Large Language Model (LLM) is very common nowadays in software. After doing some research, I found out about that it is possible to use .NET to achieve this in SingularAgent. I learned that the Semantic Kernel is an open-source SDK that integrates and orchestrates AI models and services like OpenAI, Azure OpenAI, and Hugging Face with programming languages like C#. Microsoft.Extensions.AI is a set of libraries (including the Semantic Kernel) that provides a unified layer of C# abstractions for interacting with AI services, such as LLMs.

Using the steps provided in a tutorial, SingularAgent was able to chat with a local Phi-3 Mini LLM using an Ollama chat interface. Ollama a lightweight, extensible framework for building and running language models on a local machine. Here is the link to my YouTube video demonstrating this: https://www.youtube.com/watch?v=gzKR-a5WOoU.