Details
-
Bug
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
3.5.0, 4.0.0
Description
We observed the issue that existing StreamingQueryListener implementations in PySpark start to fail after upgrading to 3.5.0. We identified that the root cause is https://issues.apache.org/jira/browse/SPARK-43183 since onQueryIdle was defined as `@abstractmethod`, requiring all exiting implementations to implement the method.
It seems like abstractmethod annotation should be removed to retain backward compatibility.
Attachments
Issue Links
- links to