I think he must have been hiding Gil from someone specific, until Gil was old enough to protect himself. Possibly the Skifandrians who he thinks would want to kill Gil, but that seems awfully paranoid. Maybe someone else entirely.

I see Tarvek in those pictures as up to a couple of years older than Gil, but not by much.