Can large language models explore in-context? | Read Paper on Bytez