equivalents of beartype and jaxytping? for runtime static type checking and shape checking
hi all! we are building local first large language models for health care based on work i did during my phd (http://arxiv.org/abs/1904.05342) and that we are now scaling through a non-profit (onefact.org).
key blockers for us in porting this encoder-only and other encoder-decoder transformer-based models we have trained for health care use cases include runtime type checking and shape checking, given we work with XLA/TPU/GPU systems at various hospitals and health systems.
happy to elaborate or discuss if needed, email is jaan@onefact.org and cv is jaan.io/cv 🙏 we were referred to you by core rust contributors.
arXiv.org
ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readm...
Clinical notes contain information about patients that goes beyond structured data like lab values and medications. However, clinical notes have been underused relative to structured data, because notes are high-dimensional and sparse. This work develops and evaluates representations of clinical notes using bidirectional transformers (ClinicalBE...
1 Reply
There isn't really anything like that atm AFAIK. The Tensor type in the standard lib was actually recently deprecated in favor of letting library authors implement their own tailored to their needs. Basalt is really the only decent ML library we have atm and Mojo is currently limited to CPU only but we should be getting GPUs soon
https://github.com/basalt-org/basalt
GitHub
GitHub - basalt-org/basalt: A Machine Learning framework from scrat...
A Machine Learning framework from scratch in Pure Mojo 🔥 - basalt-org/basalt