To train a CNN to do lane following we only select data where the driver was staying in a lane and discard the rest.