Adapt or Perish: Adaptive Sparse Transformer with Attentive Feature Refinement for Image Restoration | Read Paper on Bytez