Hello i can't use the advanced versions of spark.
It seems that all of apache spark version later than spark 3.1.2 are using scala 2.13 so the 3. jars are compatible anymore with apache spark versions.
Now I am forced to use old versions of spark. Did you Consider this issue and are you working on fixing it ?
Thank you.