These are chat archives for thunder-project/thunder
BoltArray— it would need to be a Python object that exposes the key features of the NumPy
ndarrayAPI…only it would use MPI behind the scenes instead of Spark
So if MPI was added behind the scenes to a BoltArray, would it functionally be pretty easy to be included in Thunder?
I guess I'm wondering how much of the code in Thunder relating to the spark context functions as just a pointer to code in Bolt, vs is actually integrated in Thunder with the new rewrite?
Seriesobject. Once the object is created, we just store the array — a NumPy array in local mode, a BoltArray in spark mode — and then, because the APIs are so similar, Thunder can often operate on that array in a way that is agnostic to whether it is a NumPy array or a BoltArray