The same could be said about going home at 6pm (except for the sleeping). Take the Oedo line out of Shinjuku or Roppongi between 6 and 8pm and tell me everyone is still at work.
"Not everyone works at black companies" and "nobody works at black companies" are very different statements. People going home at 6 is evidence for the former, not the latter.