dont suppose anyone knows how to use modular to shard data and run it through a tpu?
I got a grant from google and ive been playing around with running models on it. I have played with modular a bit but havent had time to really sink in. Just hoping someone else has blazed the trail for me. Otherwise ill be figuring it out my self
1 Reply
Right now it only support cpu as a target
Congratulations on the grant btw! You might want to look at JAX for the time being