You absolutely can. "Expect" doesn't necessarily mean "think will happen". It can also refer to having "expectations" of responsibility, which is good. If you don't, then the irresponsible will never hear any criticism of their behavior. How clear it was that they were going to misbehave is beside that specific point.