-
Notifications
You must be signed in to change notification settings - Fork 146
Description
Describe the bug
Match phase no longer outputs any data
To Reproduce
Steps to reproduce the behavior:
- Run the notebook we always run which calls the input, model and sets output pipe
- run the match phase
- match phase take 5 times longer than usual to run, and completes successfully
- no output data is present
Expected behavior
This worked prior to November 18th fabric update
Expect that the matched results are written to a table in the default lakehouse
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
- OS: Window s11
- Browser Chrome
- Version 138.0.7204.158 (Official Build) (64-bit)
Smartphone (please complete the following information):
- Device: [e.g. iPhone6]
- OS: [e.g. iOS8.1]
- Browser [e.g. stock browser, safari]
- Version [e.g. 22]
Additional context
I have tried many different output types, etc. but nothing works to output the file.
It seems like something has changed in Fabric permissions with spark.
Job eventually completes successfully, but no output.
Verified read/write permissions are set, schema is aligned for input, model and fielddef's
Verified that input data has 15,000 rows
findTrainingData - works
Training Phone - works
Match - fails to output