Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoning

Arxiv Papers

26:46

For many travelers, Antarctica is a bucket-list destination, a once-in-a-lifetime opportunity to touch all seven continents. In 2023, a record-breaking 100,000 tourists made the trip. But the journey begs a fundamental question: What do we risk by traveling to a place that is supposed to be uninhabited by humans? And as the climate warms, should we really be going to Antarctica in the first place? SHOW NOTES: Kara Weller: The Impossible Dilemma of a Polar Guide Marilyn Raphael: A twenty-first century structural change in Antarctica’s sea ice system Karl Watson: First Time in Antarctica Jeb Brooks : 7 Days in Antarctica (Journey to the South Pole) Metallica - Freeze 'Em All: Live in Antarctica Learn about your ad choices: dovetail.prx.org/ad-choices…

6天之前 18:11

MP3•单集首页

Genius is an unsupervised self-training framework that enhances LLM reasoning without external supervision, using stepwise foresight re-sampling and advantage-calibrated optimization to improve performance.

https://arxiv.org/abs//2504.08672

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

2135集单集

#Science #Igor Melnyk

Arxiv Papers

Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoning

Arxiv Papers

published 6天之前

MP3•单集首页

https://arxiv.org/abs//2504.08672

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

2135集单集

#Science #Igor Melnyk

Wszystkie odcinki

Arxiv Papers

1
[QA] Reasoning Models Can Be Effective Without Thinking 7:29

23 hours之前7:29

7:29

This paper challenges the necessity of lengthy reasoning processes in LLMs, showing that simple prompting (NoThinking) can outperform traditional methods in various reasoning tasks, especially in low-budget scenarios. https://arxiv.org/abs//2504.09858 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…

Arxiv Papers

1
Reasoning Models Can Be Effective Without Thinking 20:05

23 hours之前20:05

20:05

Arxiv Papers

1
[QA] A Minimalist Approach to LLM Reasoning: from Rejection Sampling to Reinforce 8:27

23 hours之前8:27

8:27

This paper analyzes GRPO in reinforcement learning for language models, revealing that a simple rejection sampling method, RAFT, performs competitively and suggesting improvements for future reward-based training approaches. https://arxiv.org/abs//2504.11343 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…

Arxiv Papers

1
A Minimalist Approach to LLM Reasoning: from Rejection Sampling to Reinforce 14:38

23 hours之前14:38

14:38

Arxiv Papers

1
[QA] CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training 7:14

2天之前7:14

7:14

https://arxiv.org/abs//2504.13161 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Arxiv Papers

1
CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training 20:35

2天之前20:35

20:35

Arxiv Papers

1
[QA] Antidistillation Sampling 7:21

2天之前7:21

7:21

Antidistillation sampling modifies token probability distributions to weaken reasoning traces for model distillation, enhancing model security while maintaining performance. https://arxiv.org/abs//2504.13146 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…

Arxiv Papers

1
Antidistillation Sampling 10:44

2天之前10:44

10:44

Arxiv Papers

1
[QA] Position: The Most Expensive Part of an LLM should be its Training Data 7:16

3天之前7:16

7:16

This paper argues that compensating human labor for training data is the largest cost in developing Large Language Models, significantly exceeding model training expenses, and suggests fairer practices for the future. https://arxiv.org/abs//2504.12427 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…

Arxiv Papers

1
Position: The Most Expensive Part of an LLM should be its Training Data 20:05

3天之前20:05

20:05

Arxiv Papers

1
[QA] Activated LoRA: Fine-tuned LLMs for Intrinsics 8:16

3天之前8:16

8:16

Activated LoRA (aLoRA) enhances LoRA by adapting weights only for relevant tokens, allowing instant activation without recomputing the KV cache, improving efficiency in multiturn settings. https://arxiv.org/abs//2504.12397 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…

Arxiv Papers

1
Activated LoRA: Fine-tuned LLMs for Intrinsics 18:55

3天之前18:55

18:55

Arxiv Papers

1
[QA] COLORBENCH: Can VLMs See and Understand the Colorful World? 7:49

3天之前7:49

7:49

The paper presents COLORBENCH, a benchmark to evaluate vision-language models' color understanding, revealing limitations and emphasizing the need for improved color comprehension in multimodal AI. https://arxiv.org/abs//2504.10514 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers…

Arxiv Papers

1
COLORBENCH: Can VLMs See and Understand the Colorful World? 20:40

3天之前20:40

20:40

Arxiv Papers

1
[QA] ReTool: Reinforcement Learning for Strategic Tool Use in LLMs 8:33

3天之前8:33