Bitter Lesson; The sooner one embraces a bitter lesson, the better. Bitter experiences become lenses through which we can view the rest of our lives more wisely.
The Origin of 'The Bitter Lesson'
- "The Bitter Lesson" is a short essay written in 2019 by Professor Richard Sutton, focusing on AI and Machine Learning (Reinforcement Learning).
- The essay underscores that AI models trained extensively on large volumes of data, through repeated searching and learning, yield better long-term results compared to models heavily reliant on human knowledge and perspectives.
- AI models developed with minimal human intervention and bias, solely learning from vast data, show better long-term progress and outcomes than those where researchers have more artificially intervened, which might give satisfying results in the short term but lead to stagnation in AI development in the long run.
- This concept, while rooted in engineering, intriguingly intersects with philosophy and management.
The Philosophy Behind My Name - Steve Yoo
- As a Korean, my name, 承學 written in Hanja (Korean based on Chinese characters), embodies the spirit of 'relentless learning' – a testament to my parents' aspirations for me.
- Rather than seeking the most efficient path in learning, I aspire to be someone who embraces 'failure & learning' as a repetitive, integral part of the journey.
- Just as numerous failures and continuous learning have been pivotal in advancing AI, the concept of the 'bitter lesson' resonates deeply with me. Embracing failures and constant learning aligns with my life philosophy, acknowledging that avoiding failures to achieve efficiency can impede the progress of AI models.
The Essence of Bitter Lesson
- The site name 'Bitter Lesson' profoundly reflects my life view and expertise, drawing a powerful connection with a pivotal concept in AI.
- This background forms the cornerstone of this site, aiming to share insights and experiences that embody this philosophy of continuous learning and growth.