The doc page at .html# says that spark uses arrow to convert data for use in pandas UDFs. However, the