I think you should do whatever you want with YOUR inheritance. Your brother's whining should be of no concern.