DiscoverMisreading Chat#134: LoRA: Low-Rank Adaptation of Large Language Models
#134: LoRA: Low-Rank Adaptation of Large Language Models

#134: LoRA: Low-Rank Adaptation of Large Language Models

Update: 2024-06-09
Share

Description

巨大 ML モデルの軽量 fine-tuning 手法を向井が読みました。ご意見感想などは Reddit やおたより投書箱にお寄せください。iTunes のレビューや星もよろしくね。









<figure class="wp-block-audio"></figure>















<iframe src="https://docs.google.com/forms/d/e/1FAIpQLSdBvbhI98yeJQV_QWBsl1Q5vY7iohwFN-lJOY2fIh_pfjwRSQ/viewform?embedded=true" frameborder="0" width="100%" height="800" marginheight="0" marginwidth="0" allowfullscreen="true" mozallowfullscreen="true" webkitallowfullscreen="true"></iframe>
Comments 
Top Podcasts
The Best New Comedy Podcast Right Now – June 2024The Best News Podcast Right Now – June 2024The Best New Business Podcast Right Now – June 2024The Best New Sports Podcast Right Now – June 2024The Best New True Crime Podcast Right Now – June 2024The Best New Joe Rogan Experience Podcast Right Now – June 20The Best New Dan Bongino Show Podcast Right Now – June 20The Best New Mark Levin Podcast – June 2024
In Channel
#138: Distilling the Knowledge in a Neural Network

#138: Distilling the Knowledge in a Neural Network

2024-09-1123:38

#137: Optimal Quantile Approximation in Streams

#137: Optimal Quantile Approximation in Streams

2024-08-1327:31

#136: Distinct Elements in Streams: An Algorithm for the (Text) Book

#136: Distinct Elements in Streams: An Algorithm for the (Text) Book

2024-08-0725:58

#135: In-Datacenter Performance Analysis of a Tensor Processing Unit

#135: In-Datacenter Performance Analysis of a Tensor Processing Unit

2024-07-0244:18

#134: LoRA: Low-Rank Adaptation of Large Language Models

#134: LoRA: Low-Rank Adaptation of Large Language Models

2024-06-0928:40

#133: Triton: An Intermediate Language and Compiler for Tiled Neural Network Computations

#133: Triton: An Intermediate Language and Compiler for Tiled Neural Network Computations

2024-05-2130:18

#132: High-Resolution Image Synthesis with Latent Diffusion Models

#132: High-Resolution Image Synthesis with Latent Diffusion Models

2024-05-0234:30

#131: FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

#131: FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

2024-04-2330:40

#130: Diffusion models from scratch, from a new theoretical perspective

#130: Diffusion models from scratch, from a new theoretical perspective

2024-04-0530:44

#129: Programming Massively Parallel Processors (Ch.4- Ch.6)

#129: Programming Massively Parallel Processors (Ch.4- Ch.6)

2024-03-2659:43

#128: Faiss: A library for efficient similarity search and clustering of dense vectors.

#128: Faiss: A library for efficient similarity search and clustering of dense vectors.

2024-03-0942:38

#127: Programming Massively Parallel Processors (Ch.1- Ch.3)

#127: Programming Massively Parallel Processors (Ch.1- Ch.3)

2024-02-2928:52

#126: Vector Database Management Systems

#126: Vector Database Management Systems

2024-01-3054:03

#125: Always-on Vision Processing Unit for Mobile Applications

#125: Always-on Vision Processing Unit for Mobile Applications

2024-01-2327:46

#124: GAIA: a benchmark for General AI Assistants

#124: GAIA: a benchmark for General AI Assistants

2023-12-2241:33

#123: SYCL 2020 Specification

#123: SYCL 2020 Specification

2023-12-0537:50

#122: Lifting the veil on Meta’s microservice architecture

#122: Lifting the veil on Meta’s microservice architecture

2023-11-0954:03

#121: The SPACE of Developer Productivity

#121: The SPACE of Developer Productivity

2023-10-3122:51

#120: On-demand Container Loading in AWS Lambda

#120: On-demand Container Loading in AWS Lambda

2023-09-2133:32

#119: Overlapping Experiment Infrastructure

#119: Overlapping Experiment Infrastructure

2023-08-2232:56

loading
Google Play
Download from Google Play
Castbox
Download from App Store
usUnited States
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

#134: LoRA: Low-Rank Adaptation of Large Language Models

#134: LoRA: Low-Rank Adaptation of Large Language Models

Jun Mukai