Skip to content

Commit

Permalink
Global global tables (faust-streaming#431)
Browse files Browse the repository at this point in the history
* add static partition assignment possibilities

* add global partitions as actives as well

* pin mode as long we didn't switch to newest faust version that supports python 3.11

* first version of global global tables

* add GlobalGlobalTable Object

* have global global as attribute of global table

* use use_partitioner also for having all partitions as standby

* Update requirements.txt

* fix tests, assert that global flag is set in case global global is used, linting

* remove test artefact

* fix linting again

* rename global global to synchronize_all_active_partitions

* fix linting

* add base.py changes

* fixed synchornized_all_active_partitions attribute handling in GlobalTable Constructor

Co-authored-by: Alexander Oberegger <alexander.oberegger@smaxtec.com>
Co-authored-by: Marco Julian Moser <marco.moser@smaxtec.com>
  • Loading branch information
3 people authored Jan 10, 2023
1 parent 89b82ab commit c0fde84
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion faust/app/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -1186,6 +1186,7 @@ def GlobalTable(
window: Optional[WindowT] = None,
partitions: Optional[int] = None,
help: Optional[str] = None,
synchronize_all_active_partitions: Optional[bool] = False,
**kwargs: Any,
) -> GlobalTableT:
"""Define new global table.
Expand Down Expand Up @@ -1220,7 +1221,7 @@ def GlobalTable(
# as they come min (using 1 buffer size).
standby_buffer_size=1,
is_global=True,
synchronize_all_active_partitions=False,
synchronize_all_active_partitions=synchronize_all_active_partitions,
help=help,
**kwargs,
),
Expand Down

0 comments on commit c0fde84

Please sign in to comment.