Use the B as 1 billion and M as million, let's say 100B neurons of human are split into 100 thousand layers, each layer should have 1M neurons per layer.
Simply put each layer is connected to next layer by dense weights, number of params between 2 layers in human brain is:
1M x 1M params (already reaching the half-size of GPT4)
With 100 thousand layers, number of params in human brain is:
100,000 x 1M x 1M params = 50,000 GPT4
No comments:
Post a Comment