- ES Español (Latinoamérica)

- EN English

3.67. AI366 Distributed AI Systems (Elective)
- Credits: 4
- Hour of this course: Theory: 2 hours; Laboratory: 4 hours;
- Syllabus:


Español (Latinoamérica)

English - Prerrequisites:
- AI264 Deep Learning (7th Sem)
- AI265 Reinforcement Learning
- ES Español (Latinoamérica)

- EN English

3.67.1. Justification Back to top


This course covers the design and implementation of distributed AI systems, including federated learning, swarm intelligence, and decentralized architectures for collaborative model training.
- ES Español (Latinoamérica)

- EN English

3.67.2. Generales Goals Back to top


- Implement federated learning algorithms
- Design decentralized training architectures
- Evaluate privacy-communication-efficiency tradeoffs
- ES Español (Latinoamérica)

- EN English

3.67.3. Contribution to Outcomes Back to top


- AG-C05) Project Management: Applies management principles in computing to manage projects. (Usage)
- AG-C09) Design and Development of Solutions: Designs, implements, and evaluates solutions for complex computing problems. (Usage)
- ES Español (Latinoamérica)

- EN English

3.67.4. Content Back to top


- ES Español (Latinoamérica)

- EN English

3.67.4.1. Distributed AI Fundamentals (12 hours) [Skills AG-C05,AG-C09] Back to top


Bibliography: (Bonawitz et al., 2019)
Topics
- Centralized vs decentralized architectures
- Communication protocols (gRPC, MPI)
- Synchronization in heterogeneous systems
Learning Outcomes
- Compare distribution approaches [Assessment]
- Configure distributed testbeds [Usage]
- ES Español (Latinoamérica)

- EN English

3.67.4.2. Advanced Techniques (24 hours) [Skills AG-C05,AG-C09] Back to top


Bibliography: (Nguyen et al., 2022; Li et al., 2021)
Topics
- Federated learning (horizontal/vertical)
- Swarm optimization algorithms
- Blockchain for decentralized AI
Learning Outcomes
- Implement FL with PySyft [Usage]
- Design fault-tolerant systems [Assessment]
- ES Español (Latinoamérica)

- EN English

3.67.4.3. Security & Governance (8 hours) [Skills AG-C05,AG-C09] Back to top


Bibliography: (Bonawitz et al., 2019)
Topics
- Distributed system attacks (poisoning, sybil)
- Model consensus mechanisms
- Governance in collective autonomous systems
Learning Outcomes
- Analyze attack vectors [Familiarity]
- Implement basic defenses [Usage]
- ES Español (Latinoamérica)

- EN English

3.67.5. Bibliography Back to top


Bonawitz, K., Kairouz, P., and McMahan, B. (2019). Federated Learning: Fundamentals and Advances. MIT Press.
Nguyen, T., Nguyen, D., and Khoa, N. L. D. (2022). Swarm intelligence for distributed machine learning. IEEE Transactions on Neural Networks, 33(7).
Li, Q., Lin, Y., and Zhou, Z. (2021). Decentralized federated learning: A survey and perspective. In NeurIPS.