The brain burns glucose only. If your body isn’t able to supply it directly then it has to convert fat into glucose which is a much slower and complicated process. That’s the ‘wall’ that people often describe.
There is also mental fatigue which isn’t well studied but the brain is an organ and can be overloaded just like others.