On the Test-Time Zero-Shot Generalization of Vision-Language Models: Do We Really Need Prompt Learning? | Read Paper on Bytez