Should i be rugging up my boy to keep warm or should i be letting him strip down to cool off?

I have a 21month old boy with a temp of 40.1, should i be keeping him rugged up and warm or should i be letting him take his jumper off to cool down?