trying to make Geospatial Foundation Models work
Research Fellow at @ESA PhiLab
Previously at @KULeuven, @Cnam
PhD in Data Science at @Sapienza
website: https://sites.google.com/uniroma1.it/valeriomarsocci
#AI4EO #GeoAI #SSL4EO
I am Valerio, from Rome (IT), doing a postdoc at KU Leuven
I am working on benchmarking and adapting geospatial foundation models for environmental tasks🌏
Hope to connect with Earth Observation and Deep Learning enthusiasts here! ✨
Follow my #50paperschallenge
This paper introduces: a) a new pre-training dataset; b) a new benchmark dataset; c) a GFM, all based on a diverse set of Copernicus data.
⬆️: really appreciate the grid embeddings part
⬇️: some doubts about claims about generalizability
arxiv.org/pdf/2503.11849
This paper introduces: a) a new pre-training dataset; b) a new benchmark dataset; c) a GFM, all based on a diverse set of Copernicus data.
⬆️: really appreciate the grid embeddings part
⬇️: some doubts about claims about generalizability
arxiv.org/pdf/2503.11849
New preprint around :)
Incorporating inductive biases specific to MSI can enhance the fine-tuning of large Earth observation models, pre-trained on RGB
arxiv.org/pdf/2503.09493
New preprint around :)
Incorporating inductive biases specific to MSI can enhance the fine-tuning of large Earth observation models, pre-trained on RGB
arxiv.org/pdf/2503.09493
The authors introduce NC and discuss the characteristics of EO and climate data, w.r.t natural images
⬆️: great entry point
⬇️: no baseline exps
arxiv.org/pdf/2503.01505
The authors introduce NC and discuss the characteristics of EO and climate data, w.r.t natural images
⬆️: great entry point
⬇️: no baseline exps
arxiv.org/pdf/2503.01505
This study pretrains two SSL methods on ImageNet and GeoNet. The improvement with GeoNet is minimal.
⬆️ useful to reduce computation?
⬇️ more considerations about the resolutions?
arxiv.org/pdf/2502.10669
This study pretrains two SSL methods on ImageNet and GeoNet. The improvement with GeoNet is minimal.
⬆️ useful to reduce computation?
⬇️ more considerations about the resolutions?
arxiv.org/pdf/2502.10669
Galileo is a family of pretrained RS models designed to flexibly process multimodal RS data. It has two loss: one in the pixel space, one in the latent space.
⬆️: multi-modal/temporal/sensor
⬇️: why just using Sentinel data?
arxiv.org/pdf/2502.09356
Galileo is a family of pretrained RS models designed to flexibly process multimodal RS data. It has two loss: one in the pixel space, one in the latent space.
⬆️: multi-modal/temporal/sensor
⬇️: why just using Sentinel data?
arxiv.org/pdf/2502.09356
This paper presents a novel world-wide dataset and a novel convolutional-transformer, named Glacier-VisionTransformer-U-Net (GlaViTU), for multitemporal and global glacier mapping.
⬆️ relevant task and nice results
⬇️ weak zero-shot transferability?
www.nature.com/articles/s41...
This paper presents a novel world-wide dataset and a novel convolutional-transformer, named Glacier-VisionTransformer-U-Net (GlaViTU), for multitemporal and global glacier mapping.
⬆️ relevant task and nice results
⬇️ weak zero-shot transferability?
www.nature.com/articles/s41...
It looks like they can :)
⬆️: validating it on a real-world task
⬇️: is it super-resolution or mapping S2 to NAIP?
arxiv.org/pdf/2501.15847
It looks like they can :)
⬆️: validating it on a real-world task
⬇️: is it super-resolution or mapping S2 to NAIP?
arxiv.org/pdf/2501.15847
This paper provides a comprehensive review of the applications of diffusion models in remote sensing
⬆️ excellent entry point
⬇️ not sure about the statement about the "inherent denoising ability" of diffusion models
arxiv.org/abs/2404.08926
This paper provides a comprehensive review of the applications of diffusion models in remote sensing
⬆️ excellent entry point
⬇️ not sure about the statement about the "inherent denoising ability" of diffusion models
arxiv.org/abs/2404.08926
I'll make it swift: I have just started my new position as Internal Research Fellow at European Space Agency - ESA Phi-Lab
I am very happy because it looks like a great place where to do research and because I am back in my beloved hometown, Rome 😍
I'll make it swift: I have just started my new position as Internal Research Fellow at European Space Agency - ESA Phi-Lab
I am very happy because it looks like a great place where to do research and because I am back in my beloved hometown, Rome 😍
Last year I decided to do a #50paperschallenge
I ended up with 43. Still:
🥵 I read more than 50 papers. I just didn't post all
😇 the strategy worked independently of the posted ones
For this reason, this year I will do a #40paperschallenge!
Last year I decided to do a #50paperschallenge
I ended up with 43. Still:
🥵 I read more than 50 papers. I just didn't post all
😇 the strategy worked independently of the posted ones
For this reason, this year I will do a #40paperschallenge!
GNNs open new possibilities for EO, handling irregular, multi-source datasets (e.g. point clouds) for smarter weather forecasts, disaster relief, etc..
⬆️: excels at non-Euclidean spatial data
⬇️: limited scalability across diverse data (?)
arxiv.org/abs/2411.03223
GNNs open new possibilities for EO, handling irregular, multi-source datasets (e.g. point clouds) for smarter weather forecasts, disaster relief, etc..
⬆️: excels at non-Euclidean spatial data
⬇️: limited scalability across diverse data (?)
arxiv.org/abs/2411.03223
Are geospatial foundation models really impactful?
Check it in our new pre-print!
Welcome to **PANGAEA: a global and inclusive benchmark for GFMs**
arxiv.org/abs/2412.04204
Check also the public GitHub repo (other news/updates soon):
github.com/VMarsocci/pa...
a short thread 🧵
Are geospatial foundation models really impactful?
Check it in our new pre-print!
Welcome to **PANGAEA: a global and inclusive benchmark for GFMs**
arxiv.org/abs/2412.04204
Check also the public GitHub repo (other news/updates soon):
github.com/VMarsocci/pa...
a short thread 🧵
Can global SatML models solve local challenges?
This study finds local models outperform global & fine-tuned models for TCH mapping in Africa
⬆️: interesting set of research questions
⬇️: what about "generalist" geospatial foundation models?
arxiv.org/pdf/2411.14354
Can global SatML models solve local challenges?
This study finds local models outperform global & fine-tuned models for TCH mapping in Africa
⬆️: interesting set of research questions
⬇️: what about "generalist" geospatial foundation models?
arxiv.org/pdf/2411.14354
TO BEAT SUPERVISED BASELINES
Specialized FMs in genomics, satellite imaging, and time series, struggle w.r.t. supervised learning pipelines
⬆️: very relevant work
⬇️: just classification, limiting the real-world capabilities*
arxiv.org/abs/2411.02796
TO BEAT SUPERVISED BASELINES
Specialized FMs in genomics, satellite imaging, and time series, struggle w.r.t. supervised learning pipelines
⬆️: very relevant work
⬇️: just classification, limiting the real-world capabilities*
arxiv.org/abs/2411.02796
Many more missing, please let me know how is already in bsky to add them!
go.bsky.app/BowzivT
Many more missing, please let me know how is already in bsky to add them!
go.bsky.app/BowzivT
direct.mit.edu/qss/article/...
A 🧵 1/n
#AcademicSky #PhDchat #ScientificPublishing #SciPub
direct.mit.edu/qss/article/...
A 🧵 1/n
#AcademicSky #PhDchat #ScientificPublishing #SciPub
A few weeks ago, we launched Pangaea, a benchmark for geospatial (foundation) models!
Focused on dense tasks, Pangea offers a repo to test several models on a global, inclusive and multimodal set of downstream tasks
w/
@lebellig.bsky.social
@yurujia.bsky.social
github.com/yurujaja/pan...
👇
A few weeks ago, we launched Pangaea, a benchmark for geospatial (foundation) models!
Focused on dense tasks, Pangea offers a repo to test several models on a global, inclusive and multimodal set of downstream tasks
w/
@lebellig.bsky.social
@yurujia.bsky.social
github.com/yurujaja/pan...
👇
I'm reminded how lopsided the gender divide is still in our field when I get 1 woman follower for every 10 men. It's particularly noticeable right now.
go.bsky.app/Ay1iTTe
I'm reminded how lopsided the gender divide is still in our field when I get 1 woman follower for every 10 men. It's particularly noticeable right now.
go.bsky.app/Ay1iTTe
#phd #forests #remotesensing #lidar
🌳🌲🛰️⚡
www.findaphd.com/phds/program...
#phd #forests #remotesensing #lidar
🌳🌲🛰️⚡
www.findaphd.com/phds/program...
go.bsky.app/PGYLmPG
go.bsky.app/PGYLmPG
🤯🤯🤯🤯
nianticlabs.com/news/largege...
Btw interesting
🤯🤯🤯🤯
nianticlabs.com/news/largege...
Btw interesting
bsky.app/profile/did:...
I already follow too many people and I need lists to organize myself.
bsky.app/profile/did:...
I already follow too many people and I need lists to organize myself.
ALISE (ALigned SITS Encoder) is a model for processing irregular and unaligned Satellite Image Time Series (SITS)
⬆️: great sparse data and label handling
⬇️: would be great to extend the domains (geographical and sensor-related)
arxiv.org/abs/2407.08448
ALISE (ALigned SITS Encoder) is a model for processing irregular and unaligned Satellite Image Time Series (SITS)
⬆️: great sparse data and label handling
⬇️: would be great to extend the domains (geographical and sensor-related)
arxiv.org/abs/2407.08448
Here's a thread of some of my favourite starter packs so far - let me know what I've missed!
🛰️ Earth Observation & remote sensing: go.bsky.app/4PMRhNL
🌏 GIS: go.bsky.app/TJ7qQF6 @milos-makes-maps.bsky.social
(1/n)
Here's a thread of some of my favourite starter packs so far - let me know what I've missed!
🛰️ Earth Observation & remote sensing: go.bsky.app/4PMRhNL
🌏 GIS: go.bsky.app/TJ7qQF6 @milos-makes-maps.bsky.social
(1/n)