Arxiv Papers

[QA] Transformers Struggle to Learn to Search

2024-12-0907:41

This study investigates transformers' search capabilities using graph connectivity, revealing that while they can learn to search, performance declines with larger graphs, unaffected by model size or in-context learning. https://arxiv.org/abs//2412.04703 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Transformers Struggle to Learn to Search

2024-12-0919:58

This study investigates transformers' search capabilities using graph connectivity, revealing that while they can learn to search, performance declines with larger graphs, unaffected by model size or in-context learning. https://arxiv.org/abs//2412.04703 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

[QA] Navigation World Models

2024-12-0707:36

https://arxiv.org/abs//2412.03572 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Navigation World Models

2024-12-0719:47

https://arxiv.org/abs//2412.03572 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

[QA] Motion Prompting: Controlling Video Generation with Motion Trajectories

2024-12-0707:21

This paper presents a video generation model using flexible motion prompts for enhanced control over dynamic actions, enabling detailed user interactions and showcasing emergent behaviors in video content creation. https://arxiv.org/abs//2412.02700 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Motion Prompting: Controlling Video Generation with Motion Trajectories

2024-12-0716:36

This paper presents a video generation model using flexible motion prompts for enhanced control over dynamic actions, enabling detailed user interactions and showcasing emergent behaviors in video content creation. https://arxiv.org/abs//2412.02700 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

[QA] Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis

2024-12-0608:01

Infinity is a groundbreaking Bitwise Visual AutoRegressive Model that generates high-resolution images from text, outperforming existing models in speed and quality, with innovative scaling capabilities. https://arxiv.org/abs//2412.04431 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis

2024-12-0621:32

Infinity is a groundbreaking Bitwise Visual AutoRegressive Model that generates high-resolution images from text, outperforming existing models in speed and quality, with innovative scaling capabilities. https://arxiv.org/abs//2412.04431 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

[QA] NVILA: Efficient Frontier Visual Language Models

2024-12-0607:38

NVILA is an efficient visual language model that enhances accuracy while significantly reducing training costs, memory usage, and latency, outperforming many existing models across various benchmarks. https://arxiv.org/abs//2412.04468 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

NVILA: Efficient Frontier Visual Language Models

2024-12-0623:11

NVILA is an efficient visual language model that enhances accuracy while significantly reducing training costs, memory usage, and latency, outperforming many existing models across various benchmarks. https://arxiv.org/abs//2412.04468 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

[QA] o1-Coder: an o1 Replication for Coding

2024-12-0309:05

The report presents O1-CODER, a model for coding tasks using reinforcement learning and Monte Carlo Tree Search, focusing on System-2 thinking and standardized code testing. https://arxiv.org/abs//2412.00154 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

o1-Coder: an o1 Replication for Coding

2024-12-0319:21

The report presents O1-CODER, a model for coding tasks using reinforcement learning and Monte Carlo Tree Search, focusing on System-2 thinking and standardized code testing. https://arxiv.org/abs//2412.00154 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

[QA] Efficient Track Anything

2024-12-0307:55

https://arxiv.org/abs//2411.18933 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Efficient Track Anything

2024-12-0319:04

https://arxiv.org/abs//2411.18933 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

[QA] Reverse Thinking Makes LLMs Stronger Reasoners

2024-12-0208:08

https://arxiv.org/abs//2411.19865 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Reverse Thinking Makes LLMs Stronger Reasoners

2024-12-0216:36

https://arxiv.org/abs//2411.19865 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

[QA] Critical Tokens Matter: Token-Level Contrastive Estimation Enhence LLM’s Reasoning Capability

2024-12-0207:29

This paper introduces cDPO, a method for identifying critical tokens in LLMs that lead to incorrect reasoning, enhancing model alignment through token-level rewards and improving performance on reasoning tasks. https://arxiv.org/abs//2411.19943 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

Critical Tokens Matter: Token-Level Contrastive Estimation Enhence LLM’s Reasoning Capability

2024-12-0212:00

This paper introduces cDPO, a method for identifying critical tokens in LLMs that lead to incorrect reasoning, enhancing model alignment through token-level rewards and improving performance on reasoning tasks. https://arxiv.org/abs//2411.19943 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

[QA] JetFormer: an autoregressive generative model of raw images and text

2024-12-0207:29

JetFormer is a novel autoregressive transformer that jointly models images and text, achieving competitive text-to-image generation without relying on separately pretrained components, enhancing both understanding and generation capabilities. https://arxiv.org/abs//2411.19722 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

JetFormer: an autoregressive generative model of raw images and text

2024-12-0223:02

JetFormer is a novel autoregressive transformer that jointly models images and text, achieving competitive text-to-image generation without relying on separately pretrained components, enhancing both understanding and generation capabilities. https://arxiv.org/abs//2411.19722 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers --- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support

#box-pro-ellipsis-173403656726810{-webkit-line-clamp:2;}Arxiv Papers