Why use numerical methods?
f(x) is a very highly complicated, like non-linear with multiple dimensions. So its first-order derivative cannot be expressed or calculated analytically. For example the function as follows:
Now we need the help of numerical methods to solve the problem.
Summary on Unconstrained Optimization Methods
Mindmap : Unconstrained Optimization