DiscoverArxiv PapersTransformers Struggle to Learn to Search
Transformers Struggle to Learn to Search

Transformers Struggle to Learn to Search

Update: 2024-12-09
Share

Description





This study investigates transformers' search capabilities using graph connectivity, revealing that while they can learn to search, performance declines with larger graphs, unaffected by model size or in-context learning.




https://arxiv.org/abs//2412.04703




YouTube: https://www.youtube.com/@ArxivPapers




TikTok: https://www.tiktok.com/@arxiv_papers




Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016




Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers





---

Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Transformers Struggle to Learn to Search

Transformers Struggle to Learn to Search

Igor Melnyk