Building a simple agent with smolagents and Azure OpenAI
How to integrate smolagents with Azure OpenAI to build Python-driven AI agents. Also, lots of ducks.
Prompt Caching with Azure OpenAI
How Azure OpenAI’s prompt caching feature works, its benefits, caveats, and a quick experiment
Clipit (previously Grabit), the Web Page Downloader
A web page downloader for humans and large language models alike
(Better) Dependency Injection in FastAPI
A bit of a rant on the state dependency injection in Python/FastAPI, and an implementation using the Injector and FastAPI-Injector libraries
Lessons Learned 2 - 8 December 2024
Interesting things I’ve learned in week 2 - 8 December 2024 (apart from the fact that democracy is fragile)
Vlad's Awesome Generative AI Compendium
Generative AI models I like
Fine-Tuning AI Models: Comparing the Costs of OpenAI vs Azure OpenAI
Understand the differences in pricing between Azure OpenAI and OpenAI for fine-tuning AI models, with a detailed analysis of token and hosting costs.
How I've Used Whisper to Transcribe, GPT-4 to Summarize, DALL*E to Illustrate, and Text-to-speech to Narrate OpenAI's DevDay Keynote
I heard you like OpenAI, so I used OpenAI’s Whisper to transcribe the OpenAI DevDay Keynote, OpenAI GPT-4 Turbo to summarize the transcript, come up with ideas that illustrate the main points and generate DALL-E prompts for said ideas, OpenAI DALL·E 3 to generate the images, and OpenAI Text to Speech to narrate the summary. Xzibit would be like, so proud.
Orca-2 and How to Run It on Apple Silicon with llama.cpp
About Orca-2 The fine folk at Microsoft Research have recently published Orca 2, a new small large language model and apparently, it’s quite good! Just look at the test results below – on average, both the 7B and the 13B variants are significantly better than Llama-2-Chat-70B, with Orca-2-13B superseding even WizardLM-70B. Pretty cool! 🚀 I also love the idea behind it: prompting a big large language model (in our case GPT-4) to answer some rather convoluted logic questions while aided by some very specific system prompts, and then fine-tune a smaller model (Llama-2-7B and 13B respectively) on just the question and answer pairs, leaving out the detailed system prompts. ...
Resources for Building an Internet-Connected Search Assistant from Scratch (Poor Man’s BingChat)
These are the slides and notebook I’ve used during my talk on how to build an Internet-connected search assistant almost from scratch. AKA Poor Man’s BingChat. First time I talked about it was at Codecamp Iasi, where it’s gotten a lot of positive feedback, plus it was awesome to share the stage with established speakers (and personal heroes of mine) like Mark Richards, Venkat Subramaniam, Eoin Woods, and Dylan Beattie. Yes, you can see them in the hero picture 😱. ...