The gain is marginal. If it will clear up in .020 or .030 or .040 I'd go with that. For one, if you ever have to do it again, you can without much possible issue. The thiner the cylinder wall the more likely to have cooling issues. Keep in mind, I don't know what the wall thickness in a 4.0 . There may be no issue at all. I am just of the school of doing what needs to be done, and not more.
I'd concentrate on head work, and so on. The gains in head work, cam and lifters, and machine work, and quality parts will net you a lot more that going with a bigger bore than you need.