Does he have Tourette’s? It’s not really physical flaw though. Or he shakes as a response to some meds or maybe has Parkinson’s? I’d say if you two have no future plans and it’s jusf casual, it’s ok to not share. If there’s some future plans you both would have to disclose your conditions