Do I need an altar to burn the Super KAnd-ELs?

No. However, they are more powerful if you have an altar.