This study evaluates the zero-shot performance of pre-trained foundation models on remote sensing tasks. The research analyzes whether these models have previously encountered satellite imagery and assesses their adaptability to standard benchmarks like EuroSAT and BigEarthNet-S2. Additionally, it explores the impact of geospatial domain-specific textual descriptions compared to standard class-based prompts.