shmap

Here are 2 public repositories matching this topic...

Tensor Parallelism with JAX + Shard Map

transformers gpt tpu jax tensor-parallelism pjit shmap

Jax/Flax re-write of @karpathy 🐐 NanoGPT using some of the common Jax libraries/features (shmap, pallas, jmp, optax, orbax)

transformers flax jax gpt-2 shmap

To associate your repository with the shmap topic, visit your repo's landing page and select "manage topics."