on the whole与 in the whole 区别在于：
1. on the whole，是一个固定词组，意思是：基本上，大体上；就全体而论；
在句子里面作状语。例句：
He liked them on the whole.
他大体上还是喜欢他们的。
On the whole, people miss the opportunity to enjoy leisure.
大体上说，人们都渴望享受休闲时光的机会。
On the whole the celebrations were remarkably good-humored .
大体上说，庆祝活动非常快乐祥和。
2. in the whole ，不是固定词组，in是一个介词，the whole是定语，修饰后面的名词，整个构成介词短语。例句：
It's the best job in the whole wide world.
这是整个大千世界中最好的工作。
She really didn't want to be involved in the whole family thing.
她实在不想卷入这件家事中。
"Finest business in the whole country," said Toad.
“全国最好的行当。”托德说道。