DiscoverAzure & DevOps PodcastPer Kops: Architecture of Ollama and Local LLMs - Episode 342
Per Kops: Architecture of Ollama and Local LLMs - Episode 342

Per Kops: Architecture of Ollama and Local LLMs - Episode 342

Update: 2025-03-24
Share

Description

Per is an experienced software architect and developer with more than 19 years of experience in designing, developing, and testing software. He is currently serving as a Distinguished software developer at Delegate, a Microsoft Partner in Denmark.

 

Topics of Discussion:

[3:02 ] More about Per’s background in nearly two decades in .NET and Azure consulting.

[6:11 ] The concept of a boutique consultant.

[7:00 ] Founding ATC-Net to share common .NET libraries and avoid duplicative coding.

[10:02 ] Building trust with customers by open-sourcing “generic” components.

[11:50 ] Creating a connector to run Olama (local LLMs) with Semantic Kernel.

[20:08 ] Why Per “fell in love” with Semantic Kernel’s abstraction layers and extension possibilities.

[21:44 ] The role of vector stores (like Azure Cognitive Search) in retrieval-augmented generation.

[24:33 ] What do we mean by “vector” in the AI space?

[26:39 ] What is a “text chunker”?

[31:43 ] Azure AI search.

[34:07 ] Finding the right tool for the right task.

 

Mentioned in this Episode:

Clear Measure Way

Architect Forum

Software Engineer Forum

Programming with Palermo — New Video Podcast! Email us at programming@palermo.net.

Clear Measure, Inc. (Sponsor)

.NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo

atc-net GitHub

Per Kops LinkedIn

Per Kops GitHub

 

Want to Learn More?

Visit AzureDevOps.Show for show notes and additional episodes.

Comments 
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Per Kops: Architecture of Ollama and Local LLMs - Episode 342

Per Kops: Architecture of Ollama and Local LLMs - Episode 342

Jeffrey Palermo

We and our partners use cookies to personalize your experience, to show you ads based on your interests, and for measurement and analytics purposes. By using our website and our services, you agree to our use of cookies as described in our Cookie Policy.