Notes on "The Long-Tail Problem in AI, and How Autonomous Markets Can Solve It"
July 27, 2020
For my own mental health I try to limit my VC Twitter exposure, but this article on decentralizing AI by Ali Yaha at Andreessen Horowitz has been making some wider rounds.
Broadly speaking these are subjects I care about as I watch both the moral hypotheticals in AI grow more real and the decentralization tech improve with each passing year. I’ve accepted that this technology is not going away because it’s just too darn useful to nation states and all their various apparatuses.
Experiment: CIFAR-10 Training Order
June 6, 2020
I’ve been thinking about machine learning training order on and off for a little while now. Sometimes these thoughts bubble up while playing Switch. Sometimes it’s while pulling into the parking lot of some big-box store, but I digress.
Let’s consider some sort of supervised learning system (like the Not Hotdog image classifier from Silicon Valley). As best as I remember I was always taught to feed in training data in random order.