If precision & recall monotonically go down when increasing NN then it means you don't have enough training data.