dont suppose anyone knows how to use modular to shard data and run it through a tpu?

I got a grant from google and ive been playing around with running models on it. I have played with modular a bit but havent had time to really sink in. Just hoping someone else has blazed the trail for me. Otherwise ill be figuring it out my self
1 Reply
sa-code
sa-code12mo ago
Right now it only support cpu as a target Congratulations on the grant btw! You might want to look at JAX for the time being
Want results from more Discord servers?
Add your server