https://blog.tylerzhu.com/categories/vision/ Recent content in Vision on Tyler Zhu Hugo -- 0.154.3 en-us Thu, 09 Apr 2026 22:06:29 -0400 https://blog.tylerzhu.com/2026/04/lethoughts-on-jepa-the-return-of-ssl/ Thu, 09 Apr 2026 22:06:29 -0400 https://blog.tylerzhu.com/2026/04/lethoughts-on-jepa-the-return-of-ssl/ <p>I used to be very up to date on self-supervised learning, but fell out of it as the field itself slowly died down in favor of VLMs and what not after SigLIP/DINO/V-JEPA became the dominant paradigms. This means I haven&rsquo;t read any SSL papers seriously since 2023.</p> <p>However, that doesn&rsquo;t mean I&rsquo;ve been living under a rock. I&rsquo;m still well aware of Yann LeCun&rsquo;s anti-pixel prediction tirade, and in that time, nothing came out that convinced me we could move away from pixel-level supervision. It&rsquo;s simply such a strong prior to enact for self-supervision: you get multi-view consistency and true spatial grounding at the slight cost of having to model high-frequency pixel details.</p>