explore/exploit tradeoff: model vs. reality

To navigate life we create mental models of the world out there, and then we confuse the models for reality. What is the explore/exploit tradeoff? The gambler needs to learn new knowledge about the machines and simultaneously use what they have already learned to optimize their decisions. In the literature, these two activities are referred to as exploring and exploiting. You can’t do both things at the same time. When you explore, you are pulling new arms on the bandit trying to figure out their expected payout. When you exploit, you pull the best arm you’ve found. You need to find the right balance. If you spend too little time exploring, you get stuck playing a machine with a low expected payoff. But if you spend too much time exploring, you will earn less than you would if you played the best arm. This is the explore/exploit trade-off. ...

February 27, 2024 · 4 min · un01s

The despair of Ukraine and others

There is one commentary on politico.eu on Ukraine by Mariam Naiem. On June 6, a catastrophic event unfolded in Ukraine as the dam in Nova Kakhovka was destroyed, another war crime by Russia. I’d like to highlight the following paragraph. “To us (Ukrainians), it feels as though the world is anticipating yet another tragedy, as if we are simply characters in a dystopian series. Only when faced with a concoction of pandemics, floods, bombings, torture and rape can we receive help and support. And not only this, but we have to repeatedly prove to the audience that we are brave, honest, “civilized” and not wasteful. Prove again and again that no, we are not Nazis — contrary to what Russian President Vladimir Putin has claimed. When making a moral case for support, that we are not irrational or too emotional.” ...

June 29, 2023 · 1 min · un01s