Skip to main content

Muon FSDP2 is a implementation of Muon optimizer for FSDP2

Project description

Muon FSDP2

muon implementation for FSDP2. Mainly copied this gist credits to @main-horse

Usage

from muon_fsdp2 import Muon

optimizer = Muon(model.parameters(), lr=0.001)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

muon_fsdp2-0.1.0.tar.gz (5.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

muon_fsdp2-0.1.0-py3-none-any.whl (5.7 kB view details)

Uploaded Python 3

File details

Details for the file muon_fsdp2-0.1.0.tar.gz.

File metadata

  • Download URL: muon_fsdp2-0.1.0.tar.gz
  • Upload date:
  • Size: 5.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for muon_fsdp2-0.1.0.tar.gz
Algorithm Hash digest
SHA256 98143e5d241dd850142070743fe18c7c2c63a7111f1748c4c74a6f84355ff7ad
MD5 337bd894e7b7bb31152facd9643f25ab
BLAKE2b-256 e9ba55874e888af611f447d0e313a3dabe68eeddb491e93833460bfc9e258858

See more details on using hashes here.

Provenance

The following attestation bundles were made for muon_fsdp2-0.1.0.tar.gz:

Publisher: publish-pypi.yml on samsja/muon_fsdp_2

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file muon_fsdp2-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: muon_fsdp2-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 5.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for muon_fsdp2-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 62073e39eb8bf647739061da0b469f8345a3b261833ab31069e97032f4725fa4
MD5 ec0e426957bcee2d5ee1f776e13ccab4
BLAKE2b-256 a914ebf925efd48e22f592b8c5deacb7d27e30c21b0b058a3bce98ac6649ca59

See more details on using hashes here.

Provenance

The following attestation bundles were made for muon_fsdp2-0.1.0-py3-none-any.whl:

Publisher: publish-pypi.yml on samsja/muon_fsdp_2

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page