Change Avatar appearance at runtime

Is there any possible way to change the avatar's appearance on runtime with only changing the avatars ID. My application has to change constantly one avatar's look depending on the user and re-instantiating it is really heavy on the performance