Tags: mbta/lamp
Tags
fix(bus): add tm_point_type and tm_full_trip columns. cleanup some ba… …ckfill logic (#604) * add tm_point_type and tm_full_trip to output data * cast types properly when constructing dataframe * handle missing TM files - this branch is invalid for calculating bus metrics * update regenerate_bus_metrics to accept write_local argument, and to get start_day from the latest file instead of midnight, to line up with service_date times and eliminate est/utc offset issue * Update Data_Dictionary.md Co-authored-by: Corey Runkel <[email protected]> * Update src/lamp_py/bus_performance_manager/write_events.py Co-authored-by: Corey Runkel <[email protected]> * Update src/lamp_py/bus_performance_manager/write_events.py Co-authored-by: Corey Runkel <[email protected]> * convert tm_point_type to string for clarity * refactor some of bus runner * black * move logging up to top --------- Co-authored-by: Corey Runkel <[email protected]>
feat(spare/tableau): Ingest, flatten, and upload Spare resources to t… …ableau (#547) * refactor jobs into lamp jobs and spare jobs - add spare job for vehicles * add new remote_files for spare resources * add a combined parquet/hyper create method to call from the spare job * spare autogen to grab all schemas and size the tableau convert - document all the column types to handle * generator for spare inputs * create all spare tableau jobs based on autogenerated inputs/outputs * handle u64 -> i64 because tableau does not support * modify to convert lists and structs to strings instead
PreviousNext