Bias (Math) or Bias Term
The bias term is a learnable additive constant b added to the weighted sum of a neuron's inputs before an activation function is applied, computed as $$z = w \cdot x + b$$.
Mathematics
Explore Mathematics through related topics and the articles other pages reference most.
Explore articles
Browse subtopics: Neural Networks
Articles that also belong to these categories. Counts cover all of Mathematics.
All articles (82)Machine Learning (48)Statistics (14)Deep Learning (11)AI for Science (10)Training & Optimization (9)AI Research (6)Google DeepMind (5)Reinforcement Learning (5)AI Benchmarks (4)Computer Science (4)Algorithms (3)Generative AI (3)Large Language Models (3)Natural Language Processing (3)Neural Networks (3)AI Agents (2)AI Ethics (2)AI Tools & Products (2)Chinese AI (2)Developer Tools (2)Information Retrieval (2)Open Source AI (2)People (2)Programming Languages (2)AI Hardware (1)AI History (1)AI Incidents & Controversies (1)AI Infrastructure (1)AI Policy & Regulation (1)Anthropic (1)Artificial Intelligence (1)ChatGPT (1)Computer Vision (1)Data & Datasets (1)Google (1)Interpretability (1)OpenAI (1)Reasoning Models (1)Robotics (1)Software Development (1)
Showing 1-3 of 3 articles
Sigmoid Function
The sigmoid function is a mathematical function that maps any real number to a value between 0 and 1 using the formula $$\sigma(x) = \frac{1}{1 + e^{-x}}$$, producing a smooth S-shaped curve.
Weighted Sum
A weighted sum is a mathematical operation that combines multiple input values by multiplying each value by a corresponding weight (coefficient) and then summing the results.