Wes Roth

What is LoRA in AI?You may have heard of a concept called LoRA or QLoRA referring to AI and Large Language Models.Imagine you have a giant box full of Legos. You can build all kinds of things with this giant box - houses, cars, spaceships. But it's so big and heavy that it's hard to carry around. And most of the time, you don't need all these Legos to build what you want to build.So instead, you pick out a smaller box of your favorite, most useful Legos. This smaller box is easier to carry around, and you can still build most of the things you want.In this analogy, the giant box of Legos is like a large language model, like GPT-4. It's powerful and can do lots of things, but it's also big and heavy (it requires a lot of computational resources to use).The smaller box of Legos is like a "low-rank adaptation" of the large language model. It's a smaller, lighter version of the model that's been adapted for a specific task. It's not as powerful as the full model - there might be some things it can't do - but it's more efficient and easier to use.“Low-Rank Adaptation”LoRA stands for“Low-Rank Adaptation”"Low-rank" in this context refers to a mathematical technique used to create this smaller, lighter model. You can also think of “Low-Rank” as just reading all the highlighted parts in a book.“Full Rank” would be reading the entire book and “Low-Rank” would be reading just the important, highlighted parts.Why is LoRA important?Let’s say you have a large and advanced AI model trained on recognizing all sorts of images.You can "fine-tune" it to do a related task (like recognizing images of cats, specifically) by making small adjustments to that large model.You can also “fine-tune” it to add behaviors you want or remove behaviors you don’t.But this can be very expensive in terms of what computers you would need and how long it would take.Lora solves this problem by making it cheap and fast to fine tune smaller modelsLoRA is important because:1. EfficiencyUsing LoRA can greatly reduce the amount of resources used to train AI models to perform these tasks.2. Speed These lower-rank models are faster to train,but they also can provide faster outputs.This can be crucial in applications where results need to happen in real-time.3. Limited ResourcesIn many real world applications the devices that are available to run AI models may have limited computational power or memory.Your smartphone may not be able to run a large AI model, but a Low-Rank Adaptation can be used for specific tasks you may need.4. Stacking and TransferingLow-rank adaptations can be helpful for transfer learning where a model trained on one task can be adapted to a different, but related task.This is much more efficient than training the large model to do something from scratch.The updates and new skills learned by these low rank adaptations can also stack with other such adaptations, so multiple models can benefit each other as well as the original larger model.QLoRaQLoRA is a similar concept.The Q is for Quantized, so QLoRA is Quantized Low Rank Adaptation.Quantized refers to data compression.Quantization is converting a continuous range of values into a finite set of possible values.Image if you’re an artist mixing paint.You have an almost infinite range of colors you can create by mixing different amounts of colors together.This is like a continuous signal in the real world.But if you are working with a computer graphics program, it can’t handle an infinite range of colors.It might only allow each color component (red, green, and blue) to have one of several levels of intensity. This limited set of possible colors is like a quantized signal.Here it can apply to reducing the number of decimal places we need to express a number.For example Pi is an infinitely long number, bu Learn more about your ad choices. Visit megaphone.fm/adchoices

Check out my GPTs:Find the Perfect GPT for you!https://chat.openai.com/g/g-ODDsHkh7I-find-the-perfect-gpt-for-youYT AI | Video Descriptions + Video Chapters Assisthttps://chat.openai.com/g/g-Kx8TSfNF9-yt-ai-video-descriptions-video-chapters-assistHomebase (under construction)https://chat.openai.com/g/g-XY8KURcf3-homebaseGet on my daily AI newsletter 🔥https://natural20.beehiiv.com/subscribe[News, Research and Tutorials on AI]Video Summary:In this video, Wes Roth introduces viewers to the upcoming Open AI GPT store, a platform where individuals can create and sell their own GPT applications without requiring coding knowledge. He emphasizes the significance of early participation, comparing it to being early in the internet, app store, or Amazon selling spaces. Wes provides a step-by-step guide on preparing for the store launch, including setting up a builder profile, creating GPTs, and understanding the store's potential and strategy. He also discusses the importance of focusing on a niche and building a suite of related products to attract and retain users.Video Chapters:[00:00:00] Introduction to the Open AI GPT StoreOverview of the new GPT store and its revenue-sharing model.[00:00:49] Preparing for the Store LaunchSteps to get ready for the upcoming launch and the potential early mover advantages.[00:02:07] No Coding RequiredExplanation of how the store is accessible to non-coders and the benefits for tech-savvy individuals.[00:03:06] Building Reputation as a BuilderStrategies for establishing a niche and creating a product suite.[00:04:11] Setting Up Builder ProfileWalkthrough on creating and setting up a builder profile in the store.[00:09:40] Creating GPTs and Builder ProfileDetailed guide on creating GPTs and configuring the builder profile.[00:16:17] Creating GPTs for Specific NeedsDeveloping GPTs for various purposes and teaching them to find appropriate GPTs.[00:23:53] YouTube Description and Video Chapters GPT TutorialInstructions on using the YouTube Description and Video Chapters GPT, including a tutorial link.[00:27:51] Final Thoughts and Next StepsSummary of key points discussed in the video and future plans for building GPTs and the store.See more at:https://natural20.com/My AI Playlist:https://www.youtube.com/playlist?list=PLb1th0f6y4XROkUAwkYhcHb7OY9yoGGZH Learn more about your ad choices. Visit megaphone.fm/adchoices

The latest AI News. Learn about LLMs, Gen AI and get ready for the rollout of AGI. Wes Roth covers the latest happenings in the world of OpenAI, Google, Anthropic, NVIDIA and Open Source AI.Dario's Blog Post:https://www.darioamodei.com/essay/the-adolescence-of-technology______________________________________________My Links 🔗➡️ Twitter: https://x.com/WesRoth➡️ AI Newsletter: https://natural20.beehiiv.com/subscribeWant to work with me?Brand, sponsorship & business inquiries: [email protected] out my AI Podcast where me and Dylan interview AI experts:https://www.youtube.com/playlist?list=PLb1th0f6y4XSKLYenSVDUXFjSHsZTTfhk______________________________________________#ai #openai #llm Learn more about your ad choices. Visit megaphone.fm/adchoices

Build Your Second Brain With Recall. Free To Start, Or use code Wes25 For 25% Off: https://www.recall.it/?t=wesroth valid until July 1st, 2026.Episode shownotes, links, sources etc:https://natural20.beehiiv.com/p/openai-s-internal-model-discovers-new-math______________________________________________My Links 🔗➡️ Twitter: https://x.com/WesRoth➡️ AI Newsletter: https://natural20.beehiiv.com/subscribeWant to work with me?Brand, sponsorship & business inquiries: [email protected] out my AI Podcast where me and Dylan interview AI experts:https://www.youtube.com/playlist?list=PLb1th0f6y4XSKLYenSVDUXFjSHsZTTfhk______________________________________________00:00 OpenAI Solves Math (for real this time)06:20 Recall (sponsor)09:52 the 'secret sauce'19:50 the implications#ai #openai #llm Learn more about your ad choices. Visit megaphone.fm/adchoices

Details in the Newsletter: https://natural20.beehiiv.com/p/the-scariest-chart-in-ai-metr-ai-agents-capability-acceleratingThe Site My AI Agents Built:https://natural20.com/The latest AI News. Learn about LLMs, Gen AI and get ready for the rollout of AGI. Wes Roth covers the latest happenings in the world of OpenAI, Google, Anthropic, NVIDIA and Open Source AI.______________________________________________My Links 🔗➡️ Twitter: https://x.com/WesRoth➡️ AI Newsletter: https://natural20.beehiiv.com/subscribeWant to work with me?Brand, sponsorship & business inquiries: [email protected] out my AI Podcast where me and Dylan interview AI experts:https://www.youtube.com/playlist?list=PLb1th0f6y4XSKLYenSVDUXFjSHsZTTfhk______________________________________________#ai #openai #llm Learn more about your ad choices. Visit megaphone.fm/adchoices