The expectation of the maximum of RVs is greater or equal to the maximum of the expectations

For any sequence of RVs X1,…,Xn the following holds:

E[max{X1, …, Xn}] >= max{E[X1], …, E[Xn]}    (*)

Proof. We have that max{X1, …, Xn} >= Xi for all i. Thus, this holds in expectation as well, i.e. E[max{X1, …, Xn}] >= E[Xi] for all i. Since this holds for all i, it holds for their maximum as well.

Interpretation: “the expected best idea out of a fixed population of ideas dominates the expected value of any individual idea (even the best one!)”. Variability plays a role here.

When does (*) hold with equality and when with strict inequality?

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s