Data type¶

https://arrow.apache.org/docs/python/api/datatypes.html

https://arrow.apache.org/docs/python/generated/pyarrow.dictionary.html

pyarrow to numpy¶

Many numpy functions still does not support pyarrow data types. When using pyarrow backend we must convert df cols to numpy first:

df[cols].to_numpy(dtype=np.float32)