The following figure explains the difference between offline and online machine learning with NetSim

C-based ML algorithms

  • ML Model in C. NetSim code is in C
  • Tight integration is possible since they can be compiled together
  • Difficult. Low-level memory management

MATLAB/Python ML algorithms

  • Inter-process communication via sockets
  • Easy and user-friendly. Use inbuilt ML algorithms/APIs

Useful resources

Example papers that have used RL with NetSim