About

The MongoDBFullLoadTranslator has been generalized on behalf of recent improvements to cratedb-toolkit already. This patch just slots it into the right place to make it reusable, and also makes the MongoDBCDCTranslator use the improved decoding machinery. Along the lines, the patch fixes a little issue with Zyp Transformations and exercises another use case.

Details

• MongoDB: Added MongoDBFullLoadTranslator and MongoDBCrateDBConverter
• MongoDB: Use bson package to parse BSON CANONICAL representation
• MongoDB: Complete and verify BSON data type mapping end-to-end
• MongoDB: Use improved decoding machinery also for MongoDBCDCTranslator
• Zyp: Fixed execution of collection transformation
• Zyp: Added software test and documentation about flattening lists

References

• MongoDB: More ad hoc fixes for supporting real-world data cratedb-toolkit#255
• MongoDB: Improve support for reading JSON/BSON files cratedb-toolkit#261
• MongoDB Full: Refactor transformation subsystem to commons-codec cratedb-toolkit#269