Hi everyone. Currently, I am working on a project for distributed learning for LMs (Language models). I want to ask whether Flower AI supports distributed learning with different models for clients (e.g., T5 for client1, Llama for client 2,…) and then update the global model through knowledge distillation for example. Besides, can I train these client with different dataset?
Thank everyone for help.