fedland 0.1.1

Research Libary for Federated Learing Loss Landscapes

Fedland: Loss Landscapes in Federated Learning

Summary:

Loss landscapes in the federated learning [1] setting are relatively more complex and often fragmented as compared to the centralized setting, owing to variations in local data distributions [2]. The project will study and contrast local and global loss landscapes to derive insights about a local client’s contribution to the overall loss landscape. Understanding these dynamics can potentially enhance our ability to optimize federated learning systems.

Task:

• Training a neural network model in two settings:

  1. In a centralized environment
  2. In a federated environment

• Conduct experiments with the federated setting focusing on analyzing the loss landscapes of the models trained in these settings, including both the global model and individual client-side local models.

Project Layout:

Since I am using FEDn, the project follows their recommended project structure.

I have added pyproject.toml for managing our dependencies. I have written it to use Poetry. You probably want to use an virtual environment or tool to manage your virtualenv. To install the dependencies using poetry, simply run poetry install. I set it to use python 3.11

project
├ client
│ ├ fedn.yaml
│ ├ python_env.yaml
│ ├ model.py
│ ├ data.py
│ ├ train.py
│ └ validate.py
├ data
│ └ mnist.npz
├ fedland
│ └ __init__.py
├ README.md
├ pyproject.toml
├ scripts / notebooks
└ Dockerfile

Running the project

1. Setup a venv
2. Run poetry install in venv
3. Create and fill in the .env fields based on .env.example
   • run: cp .env.example .env
4. Run whatever scripts you want in /scripts
   • eg: python scripts/centralized_base.py