3.67. AI366 Distributed AI Systems (Elective)

3.67. AI366 Distributed AI Systems (Elective)

Figure 3.66: Connection Map. AI366 Distributed AI Systems

3.67.1. Justification Back to top

This course covers the design and implementation of distributed AI systems, including federated learning, swarm intelligence, and decentralized architectures for collaborative model training.

3.67.2. Generales Goals Back to top

  1. Implement federated learning algorithms
  2. Design decentralized training architectures
  3. Evaluate privacy-communication-efficiency tradeoffs

3.67.3. Contribution to Outcomes Back to top

AG-C05) Project Management: Applies management principles in computing to manage projects. (Usage)
AG-C09) Design and Development of Solutions: Designs, implements, and evaluates solutions for complex computing problems. (Usage)

3.67.4. Content Back to top

3.67.4.1. Distributed AI Fundamentals (12 hours) [Skills AG-C05,AG-C09] Back to top

Bibliography: (Bonawitz et al., 2019)

Topics

  1. Centralized vs decentralized architectures
  2. Communication protocols (gRPC, MPI)
  3. Synchronization in heterogeneous systems

Learning Outcomes

  1. Compare distribution approaches [Assessment]
  2. Configure distributed testbeds [Usage]
3.67.4.2. Advanced Techniques (24 hours) [Skills AG-C05,AG-C09] Back to top

Bibliography: (Nguyen et al., 2022; Li et al., 2021)

Topics

  1. Federated learning (horizontal/vertical)
  2. Swarm optimization algorithms
  3. Blockchain for decentralized AI

Learning Outcomes

  1. Implement FL with PySyft [Usage]
  2. Design fault-tolerant systems [Assessment]
3.67.4.3. Security & Governance (8 hours) [Skills AG-C05,AG-C09] Back to top

Bibliography: (Bonawitz et al., 2019)

Topics

  1. Distributed system attacks (poisoning, sybil)
  2. Model consensus mechanisms
  3. Governance in collective autonomous systems

Learning Outcomes

  1. Analyze attack vectors [Familiarity]
  2. Implement basic defenses [Usage]

3.67.5. Bibliography Back to top

Bonawitz, K., Kairouz, P., and McMahan, B. (2019). Federated Learning: Fundamentals and Advances. MIT Press.

Nguyen, T., Nguyen, D., and Khoa, N. L. D. (2022). Swarm intelligence for distributed machine learning. IEEE Transactions on Neural Networks, 33(7).

Li, Q., Lin, Y., and Zhou, Z. (2021). Decentralized federated learning: A survey and perspective. In NeurIPS.

Spotted a typo, an outdated course, a broken link, or have a suggestion? Let us know.

Scan to open on your phone