It assumes a math background implicitly. I feel like you need some context already to get value out of it. I wouldn't bother reading it without doing something hands on or going through another course like cs231n or fastai first. It's an excellent book regardless of the above points.