You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
feat(rail): export `vehicle_events` and `vehicle_trips` tables as Par…
…quet (#756)
* Add data asset locations
* Add jobs to export vehicle_events and vehicle_trips
* Address TypeError
* Make schema into property
* day-by-day export
* Coerce timestamps
* Fix types
* typo
* another typo
* Add revenue to exported fields
* allow none for operand and operator, which will do no filtering. this simplifies the class construction for the new vehicle_events and vehicle_trips
* direction_id is a bool in vehicletrips...
* reorder performance_manager_jobs back into "operational" order.
* put experimental vehicletrips and events at the bottom of the list
---------
Co-authored-by: Henry Huang <1400827+huangh@users.noreply.github.com>
feat(tableau/lrtp): LRTP vehicle position include terminal and termin…
…al adjacent stops (#757)
* lrtp vehicle position tableau uploads now include terminal and terminal adjacent stations. applies to prod and devgreen datasets.
* black
* add terminal stop ids to validation check
* remove duplicates rows in schema definition...what??
* leave hyperjobs alone...but bump up BUS_ALL_NDAYS till 12/14/25, as we have falldataset to cover period before this.
fix(ingestion): Don't treat GTFS_ARCHIVE as parquet (#754)
* fix(ingestion): Don't treat GTFS_ARCHIVE as parquet
* ruff
* black
* Check if file is parquet
fix(rail): Interleave Tableau jobs (#746)
* Rename fast_iter to writes
* Run the next job in the list
* black
* Add back in DBManager
* Reduce the amount of time between jobs
* Cycle explicitly
* More specific logging
* format imports
fix(ingestion): Stop deleting BusLoc VehiclePosition records without …
…`route_id` (#733)
* Write test to show that some data are removed
* Pass ingestion test by changing BusLoc VehiclePositions partition key to vehicle.vehicle.id