dnAnalytics is an open source numerical library for the .NET Framework and Mono.
An other matthlib is extremeoptimization her
Mathematical software can be very expensive. Programs like Mathematica, Maple and Matlab are incredibly powerful, flexible and usually well documented and supported.
Valuable mentions are:
Disclaimer The opinions expressed herein are my own personal opinions and do not represent my employer's view in any way.