Project Fiesole
TL;DR:
Can we VFL MNIST?
Project Fiesole aims to demonstrate the feasibility of integrating CNN architectures within Vertical Federated Learning to enhance data-driven models without compromising data privacy. In this context, data exists in islands, meaning various entities or organizations possess distinct features for the same sample population. Rather than consolidating these diverse datasets, Vertical Federated Learning allows for collaborative model training where each entity contributes its unique feature set. This approach not only upholds data privacy but also leverages the richness of diverse input parameters, offering a holistic perspective that a singular dataset might miss. Fiesole is a subproject of Project Florence.
Method
In VFL, each island has different "input parameters" for the same "subject". Thus, we split the original image (here, 9) into four distinct pieces in this demo. Each of them will necessarily work as a "distinct input."
I created four training sets, one for each quadrant, with masking.
Control Group
Ran entire ten epochs with the original dataset
- MNIST CNN: 99.16 %
One by One
I ran ten epochs on one dataset and have yet to come back. Then I moved on to the next one.
- TL(10): 26.82 %
- TL(10), TR(10): 36.44 %