I think you summarized the idea very well. I guess the idea behind CV is to estimate the E_out (by E_cv) in situations when you are short on data to start with. Then you can't afford losing data points when you reevaluate the optimal
on
in order to get
.