Hacker News new | ask | show | jobs
by seattleeng 1855 days ago
I used to joke at work that the fastest, simplest way to get promoted to a staff engineering position was to finish a 1 yr refactor.

Getting existing codebases to do new things is hard, and most of enterprise software engineering is basically "rework this API (in the general sense, not web-API sense) for a new product use case".

This tool seems to borrow the philosophy of Go's keeping the language simple, with the tradeoff of a more complex (but fairly well supported) ecosystem to account for missing language features.

IME, Golang (some would say paradoxically due to a lack of generics) is one of the best languages to refactor because of:

- Forced error handling semantics so that unhappy paths are easily enumerated

- Tooling like `rdep` to quickly grok the impact of a package refactor

- String templates/codegen being a first-class "blessed" part of the ecosystem (i.e. you can find tooling by the Go team as a reference when writing your own)

Some would balk at things like codegen being how Go handles this, but for the iteration loops at most companies at scale (where a few tools to do codegen are written & maintained by one team and consumed by others) it works well. For paradigms where you want everyone to contribute to the tooling, it works slightly less well since the barrier of understanding the ecosystem is greater than just understanding the language. Nevertheless, it seems to be the right tradeoff for most enterprise use cases.

4 comments

> Forced error handling semantics so that unhappy paths are easily enumerated

They could have just added pattern matching and exhaustivity checking though, right?

I'm a Googler, and while that might be true at another place, unfortunately this is not true at Google. Refactoring/Tech Debt/Eng Excellence work will not get you promoted pass L4 for the majority of teams. In some team, it will get you to L5, but that's rare. Getting to L6 based on "1 yr refactor" is... simply extraordinary. I haven't seen or heard of one case in 7 years here.
I'm pretty sure that the comment you replied to was talking about "the general rule" and not "the exception to the rule." you don't need to call out that your specific employer is different than other employers. everyone here already knew that.
I’m guessing this was really just a way to brag about where they work. Seems oddly common among people that work at that company.

For what it’s worth, I’ve been at more than a few companies and this lines up. Managing a refactor or migration that’s long term and creates significant impact across an org chart or product area is definitely in the purview of promotion to senior or staff, whatever it’s called.

Given that the tool mentioned in this thread, rf, is written by Russ Cox, who works at Google, to help refactor go, a language developed and maintained by Google, how Google addresses these things feels not totally irrelevant.

I also think that "migration" and refactor are completely different concepts. And only the first is going to get you promoted (in the context of Google), because there's so much tooling for making even large refactoring relatively trivial. Pretty much every language has something like this, the build system also supports it too, so the process of, for example, taking a file, renaming it, querying and updating all dependencies (both source files and the build system), testing and sending out pull requests is essentially entirely automated. Unless there's something unique about a refactoring, it's not challenging enough to be promo-worthy.

Refactors are rarely as simple as moving a few file names or symbols around, at least where I work. While we do have some automation to help (and not break existing consumers), it’s significantly more involved in an SOA architecture for tier1 services. These sorts of big refactors also generally come with data model changes, performance profiling etc. This tool seems fantastic for parts of that, but not all of it.

Just as a friendly aside, your tone seems strangely defensive (though this may just be my fault reading this tired at 3AM) - Levels tells me you make on the order of half a million a year, while I’ll be lucky to make half of that in the next decade at my employer, so you really can’t feel persecuted by this when you most likely work half as much as me while being rewarded for it while folks like me struggle to tread water and are considered mentally deficient.

> Refactors are rarely as simple as moving a few file names or symbols around, at least where I work. While we do have some automation to help (and not break existing consumers), it’s significantly more involved in an SOA architecture for tier1 services. These sorts of big refactors also generally come with data model changes, performance profiling etc. This tool seems fantastic for parts of that, but not all of it.

Yes, I'd refer to that as a migration, which absolutely is a lot of effort, but a tool like this isn't going to be particularly helpful with a migration precisely because the majority of the effort with such a migration will be like...doing all the data stuff and traffic stuff. Changing the code is a minimal part. A refactor is often not a thing that even registers at a smaller company, because its on the scale of a few files. But "Large Scale Changes" are a thing when you end up having millions of lines of code (https://www.youtube.com/watch?v=TrC6ROeV4GI), and tools like this one are useful for those kinds of changes. But a single LSC won't get you promoted.

And rf is neat, but in a very go way, it's not particularly exciting if you're familiar with https://github.com/google/pasta or https://github.com/bazelbuild/buildtools/blob/master/buildoz... or clangmr or https://github.com/google/Refaster, or outside of google Semgrep and Bowler and others, since its essentially the same, but built in go for go.

> Just as a friendly aside, your tone seems strangely defensive (though this may just be my fault reading this tired at 3AM)

Not at all. I was however, pointing out that "this was really just a way to brag about where they work. Seems oddly common among people that work at that company." was certainly unnecessary, and perhaps unkind.

Sorry I should have clarified - by "refactoring APIs" I meant the sort of work that would e.g. be unifying all photo abstractions at Facebook behind a new service, not just refactoring package-level abstractions. That sort of work does involve a lot of symbol-level renaming and dependency hell management, but that's just a part of the work.
yeah you gotta replace something in prod that already works perfectly fine - or release a greenfield feature and sunset it in 14mo lmaoo
I feel like I've been involved in quite a few projects like that; Some Guy sold technology X to a company, so now it's all hands on deck.

Over the years, one company I've worked for off and on (as a consultant/contractor) went from a jQuery UI library, to a CSS component library (which was fine), to an AngularJS component library, then some ex-googler (younger than me) swept in and became CTO or similar and Decided that the whole company should use, drumroll please, Polymer. Then Polymer 2 came around and they had to scramble to make everything Polymer 2 compatible. They were just about done when Polymer 3 came around, which did things Differently once again.

But I'm sure the guy made decent scratch and left the company right before things came crashing down to an even more cushy job. That's usually what happens.

Does Google actually use Polymer much?
It does: https://github.com/Polymer/polymer/wiki/Who's-using-Polymer%...

The whole idea of web components was somehow sold inside Google, hard. They even re-wrote Youtube with web components v0 which was almost immediately deprecated. And Chrome had to support it for years before Youtube rewrote stuff in v1.

This is from 2018, though.
Thanks for the insight.
What is `rdep`? Couldn't seem to find it with a cursory google search.
Reverse dependencies, meaning find all sources that depend on a given file. Likely inspired by the Bazel query function by the same name.

https://docs.bazel.build/versions/master/query.html#rdeps

The sibling comment touches on this, but the class of tooling that lets you analyze (R)everse (dep)endencies. There's a bunch that do similar things, but examples:

Rdep: https://github.com/axw/rdep Gomod: https://github.com/Helcaraxan/gomod

If you look at what they're doing under the hood, its mostly gluing bunch of official Golang libs that let you inspect package-level information.

Doesn't that just mean that, while Go the language is simple, to become productive one must not only learn the language but an ecosystem that is bigger than the ecosystems of other languages?