The biggest difference between linear models and neural network models, ** lies in the nonlinearity of neural networks that causes most of the cost functions we are interested in to become non-convex. **This means that neural network training usually uses iterative, gradient-based optimization, which only makes the cost function reach a very small value; instead of a linear equation solver like a trained linear regression model, alive is used to train logistic regression or The SVM's convex optimization algorithm can guarantee global convergence. Convex optimization converges from any initial parameter (in theory, it is also very robust in practice but may encounter numerical problems). ** The stochastic gradient descent for non-convex loss functions does not have this guarantee of convergence and is sensitive to the initial values of the parameters. **For feedforward neural networks, it is important to initialize all weight values to small random numbers. The offset can be initialized to a positive value of zero alive.

## Part 2: Gradient-based learning

#### Latest article

- Leetcode 133. Clone Graph
- [Python] Find the prime number dictionary within 1000
- Dynamic programming in recursive structure
- The error in the Linux environment is incorrect.
- Using Javascript to achieve full selection and not to choose
- Java knowledge point notes
- Self-learning java object class
- GPIO input control
- SpringBoot commonly used annotation
- ARong's Blog
- Mastering_Rust: The compiler plugin (Chapter 9)
- [LeetCode] 721. Accounts Merge Problem Solving Report (Python)
- Internet overseas market articles----starting from here
- PHP's syntax error syntax error (Parse error: syntax error, unexpected end of file in xxxxxxxx)
- Internet overseas market articles---- Looking back at the past
- MySQL table integrity constraints
- The programmer was too straightforward, causing a bug in Apple's official website. The netizen shouted: It is so cute that most
- Happy-ip development tcp client example (protobuf version)
- Java-rpc framework
- The difference between mobile front-end development and web front-end development