Spiking Neuralnet (SNN) vs ANN: Event-based Instead of Feed-based

SNN is more active instead of passive compared to ANN. SNN can work in both modes: Feed & self-thinking (from a point in neuralnet); whi...

20 March, 2025

Human Brain vs Modern AI Capacity Comparison (2025)

Human brain has roughly 100 billion neurons. The number of params in ChatGPT-4 has not been undisclosed but experts estimate it at roughly 2,000 billion params (1 thousand times of Gemma 2B, the basic chatbot which is considered as sophisticated). Notice the 2 words neurons vs params as they're different.

Use the B as 1 billion and M as million, let's say 100B neurons of human are split into 100 thousand layers, each layer should have 1M neurons per layer.

Simply put each layer is connected to next layer by dense weights, number of params between 2 layers in human brain is:

1M x 1M params (already reaching the half-size of GPT4)

With 100 thousand layers, number of params in human brain is:

100,000 x 1M x 1M params = 50,000 GPT4

No comments:

Post a Comment