This repo demonstrates an issue with running Spark materialisations in Feast by which the following error is thrown:
pyspark.errors.exceptions.base.PySparkTypeError: [CANNOT_INFER_SCHEMA_FOR_TYPE] Can not infer schema for type: `ChunkedArray`.To reproduce the issue, follow these steps:
- Set your
JAVA_HOMEenvironment variable to java 17:
export JAVA_HOME=$(/usr/libexec/java_home -v 17)- Run make to install and run the example
make run