Hacker News new | ask | show | jobs
by bogota 947 days ago
Start paying 250k a year for cobol developers and the problem fixes itself really fast. That or start migrating the system. Or more likely they keep using it until it completely breaks and then run to the government for a big handout to fix it.

Easy to be irresponsible with other peoples money.

9 comments

Incentives only work on low-skilled labor that is quantifiable. Eg. more money for flipping more burgers. It is not a settled science paying people a lot more will automagically solve problems. People crave Autonomy, Mastery & Purpose: https://www.youtube.com/watch?v=rbR2V1UeB_A

What is definitely going to happen is you will attract the cowboys who have convinced themselves and can convince you to pay top dollar. They will come up with lets do kubernetes + service-mesh + multi-cloud hybrid + blockchain + crypto + AI/MI on this COBOL ... They will take top dollar, make a bigger pile of mess, sell it as a success story and move on make bigger messes.

>People crave Autonomy, Mastery & Purpose

I'm not a sack of chemicals whose desires can be reduced down to some pithy pseudo-scientific Maslowian quip. The only thing I crave from my job is cash so I can take care of me and my family. 250k/yr for a COBOL position would suit that end just fine. You can keep your autonomy, mastery, purpose, and all the other foofoo, just hand me the check so I can be on my way.

> I'm not a sack of chemicals whose desires can be reduced down to some pithy pseudo-scientific Maslowian quip. The only thing I crave from my job is cash

I thought you were against reductionism?

They were replying to someone who was saying something about "people"; they only said something about "I" (themselves).
>The only thing I crave from my job is cash so I can take care of me and my family

sounds like purpose, of which you need mastery of some skillset to earn your autonomy to furfill.

That said, I'm sure there's much easier ways to earn 250k than untangling a governement codebase. Not that they are offering that to begin with.

>just hand me the check so I can be on my way.

Yeah, you probably wouldn't pass clearance with that attitude if we're being frank.

250k is not top dollar, it is average for experienced engineers.
Outside the Bay Area, $250K is top dollar.
Not really, even in the Midwest, such as the Metro Detroit region, 250k is definitely attainable. I’m in that band and live there.
Base or with bonuses?

I find it hard to get roles in the midwest (large metro in Ohio) clearing 200k, though sometimes bonuses get you up there.

TC, my base isn’t that high.
It definitely is not.
WTF. I worked on some high exposure projects as a senior dev and never a final offer above $130k USD. Even after haggling hard at a company I had been at for 3 years and they told me I was their top, highest paid engineer and it led me to quit. Then I got approached by Facebook to work in London HQ and the offer they were dangling was £100GBP which was about $130k USD. Highest offer I ever got before I even got to the final round of interviews was $160k USD from a well known crypto company but for some reason the head of engineering didn't show up to the final interview at the last minute after I flew through all the tech tests as those devs who interviewed admitted. It was weird.

I always assumed the reported 250k plus salaries were fake news or only reserved for children of powerful people.

I just quit a $180k job for a $125k job. I did it to join a team that I want to work with, and people that I can trust. I used to waddle out of bed around 9am and quit at 2-3pm after hours or boredom. Now I jump out of bed at 5am and don't quit until 4 pm--sometimes I spend all day traveling. I about cry at night because I love my job so much.
To be fair, I think the 250k mark usually implies some kind of specialization.
Why would you assume that? Look up levels.fyi

$250k total comp isn't even particularly high at one of the big companies.

250k is not top dollar for programmers, but it is top dollar in absolute terms. The point is that you don't incentivize better work by paying top dollar. Taking a mediocre developer and paying them more doesn't make them a better developer or even motivate them to become better.

It can attract people who are already good software developers absolutely, but the second point being made is that you also attract a lot of charlatans as well and so just throwing more money at the problem isn't exactly a great solution.

You need a solid culture to go with the money.

Depends on where you live. An “experienced engineer” is going to make a lot less if they live in Mississippi than if they were in California. 250k for the former is likely “top dollar”.
People on HN are convinced if you don't live in California maximizing your salary, you're not capable of doing so.

Highlighted in the sibling comment: "you will get whatever candidates decided to live in Mississippi"

As if top talent never decides to live in Mississippi and accept 250k/year as their salary ceiling...

I didn't say that top talent doesn't live in Mississippi, I just said you will get what candidates DO decide to live in Mississippi. If you want top talent, you have to advertise nationally, and be willing to pay the national rate. I live in a city that is quite poor for an employer that is quite large. They pay slightly better than average for the area except for their engineers and upper management, that goes to market rate because they are willing to hire the best available.
People also seem to forget that there are "cost of living adjustments" for a reason. Many companies will fight and suggest that you don't need salary X if you don't live in place Y.

It's not impossible and $250k is nowhere near the ceiling. But you're not going to find those jobs on a causal LinkedIn search like you would in California.

If you are a small shop, sure. If you are a major employer you will either meet market rate and get top candidates (willing to live in your area) or you will get whatever candidates decided to live in Mississippi.
This is a lie that is commonly spread here and on reddit.
250k with government perks and retirement is pretty nice. Also for 250k cash you will find lots of people willing to learn cobal.
No, that is not average, maybe in high COL areas, but that obviously would then not be average.
Outside of CA?
Even in Southern California, $250K is a very high salary for developers, at least in embedded systems, which is the space I’m familiar with.
embedded system engineers have always had low salaries... I don't think I've ever seen an embedded C or C++ job pay more than $130k. I made more than that writing JS almost ten years ago..
Cobol cowboys are a thing. They make substantially more than 250k. They’re competing with Wall St though, so hard to just pay more.

Fed govt migrations are ALWAYS shitshows. The army alone has like 20 individual email services. The pentagon is to org complexity what big tech is to technical complexity. It’s turtles all the way down.

This is literally one of the largest bureaucratic challenges on earth. There’s no simple fixes

The solution is simple: you need someone with absolute authority over everyone including the generals to lead the effort.

There's a time and place for democracy - but large IT projects are not. Do a thorough need analysis, compare with what's reasonably possible using COTS software, and adapt or discard what is not possible.

That's exactly why DoD kept bringing Grace Hopper out of retirement first in 1967. They eventually gave her a star in the 80s, and along the way she was as responsible as anyone for the standardization efforts for COBOL and Fortran including the design of standardized compiler validation suites. Testing and interoperability before testing or interoperability were a thing! One of the later major projects she worked on was modernizing the Navy payroll system. Even junior sailors at the time knew that she and her team had made sure they got their paychecks. She retired from the Navy at age 79 in 1986. Nobody messed with Grace Hopper.
Adm. Grace Hopper wasn't the only senior officer who was recalled because of their expertise. One is a retired JAG lawyer (a friend actually) who continues to advise at the Pentagon on several areas of expertise. She actually learned COBOL from Adm. Hopper herself, and always had high amount of respect for Adm. Hopper and how she disliked bureaucracy. There is a lesson there.

Ironically, my friend has programmed COBOL on DoD mainframes, and still does as a consultant, having interacted with them for decades. Back in the 1970s she had a surplus IBM minicomputer that her father brought home for business use, and learned COBOL on that, and used the computer for furthering her legal research.

I can't tell if you're being sarcastic, or earnest.

This is the funniest possible response. The 'thorough need analysis' is the reason we are where we are now!

The thoroughness is so thorough that the needs change faster than the analysis can be completed, obviating the analysis in the first place.

Part of the problem is, you tend to need cobol experts to actually have any hope of successfully transitioning to another technology, and if we had enough cobol experts would look at the cost of migrating and say, “who needs to, we have a bunch of cobol developers?”
Hire experts and have it be reported as "waste" and hear complaints in Congress about government waste.

We want government to be cheap. You get what you pay for.

That could work if the existing code is actually up-to-date, correct, and if you have knowledgeable users of the systems backed by this code. The part about 'code corruption' makes me thing this is not the case.

Worked at a big bank migrating some old code to new stack one time:

  - Original developers are gone.
  - Existing users don't understand the systems outside of their own narrow use-cases.
  - Code which was committed to repositories didn't match the actual running code, because people would go into production servers, manually edit the code there, in place, not document or commit the changes to repo. There were like 20 years of adhoc changes made in this way.
We had some business analysts which were supposed to talk to the users and gather requirements - they very quickly simply gave up and asked the developers to 'reverse engineer' everything.

Anyway, it was a hilarious shit-show, but kinda fun at the same time (if you're able to ignore incompetent leadership pressure - a skill I mastered during this time).

>Code which was committed to repositories didn't match the actual running code

I remember the first time I saw this at a small company. The head programmer was the only one with the actual production source, despite a working source control system. He complained about how people didn't appreciate how hard it is to make builds work. I should have left when we lost three man months of code to losing email. I only left after screaming at the head programmer for refusing to stop making the repository unbuildable at all.

In the last part of the series from 2013 we have a chart that shows the Pentagon had spent over $10b modernizing their accounting systems (that was through 2013, no idea how much that number has grown.) I can't imagine anyone would miss a few million of that going to COBOL developers. The money scale for Pentagon projects is mind-boggling to me.
Don't they have caps and levels for federal employee salaries? I agree that raising the salary would decrease the issues. I think that they'd need exceptions to account for these increases though.
Yes, but not for contractors. Most software sustainment ultimately ends up in the hands of contractors with government supervision in the form of program offices. Not all, though, many programs are also "organic", primarily or fully staffed by government employees and managed by government employees.
> Yes, but not for contractors.

Sure, but it’s not like the consulting firms are paying their “contractors” more, they just siphon up the difference for their shareholders.

That's not really how it works. They are more than happy to have "market forces" drive up the hourly rates, so long as they get to keep their overhead % fixed, and that's probably how the contract is structured. Win-win (and perhaps -lose for taxpayers).
> That's not really how it works. They are more than happy to have "market forces" drive up the hourly rates

That’s exactly how it works, look at contract government salaries compared to anything in the private sector. They charge the government more as rates “go up”, but that certainly isn’t passed along. If large contracting companies really offered value to the government _and_ kept up with market rates for their employees, the state of federal software wouldn’t be what it is today.

I didn't say that your rate at a govt focussed consultancy would be identical to your rate elsewhere. I probably should have been more explicit.

I rejected the idea that the consultancy would get a rate increase based on "market rates being higher" and then just capture it all - in my (admittedly somewhat limited and path dependent) experience that just isn't how it works. It's more like we pay randmeerkat $X, we bill them out at $X * factor + overhead. "Market forces" mean we have to go Y > X in renewal or we will lose randmeerkat & friends, so now they get $Y and we bill $Y * factor + overhead. It's of course usually more complicated in general, and overhead especially likely isn't that simple.

Nowhere in there is the assertion that X or Y is what randmeerkat would get on the open market. Importantly, their market isn't really "programmers", but "programmers that work in govt + contracting halo". Which is part of why the idea: I could get $N more in SF tech may be compelling for you, but isn't compelling for them (unless too many people actually make that change, instead of just talk about it).

Also there are many other ways they can raise there rates, but if the claim is that it is due to market on the developer salaries that are going to be a line item, there is going to be at least first pass look at a) is that true (find some market data and wave hands) b) did it actually get spent that way (may come up in an audit).

So the real answer seems to be not "They get more and I get nothing" but "I get a bit more, and they get more scaled by what I get", i.e. "win-win".

There is lots wrong with the system of contracting, but I don't think criticizing a cartoony straw-man of it gets anywhere useful.

Starting pay for cobol in finance was around 350k last time I glanced. Nobody wants to rewrite a working system which will likely be much more expensive than finding one person to maintain the project.
With rewrite comes uncertainty and risk too, how many new bugs compared to code that works for decades?
> Start paying 250k a year for cobol developers and the problem fixes itself really fast.

Do you think they aren't? I don't know any now, but the last one I did was making more than that 15 years ago.

Old crufty legacy systems in a big bureaucracy are many peoples idea of hell. Empirically speaking, good pay and job security aren't enough to have people knocking down your door for that kind of work if they have other decent options.

This is a problem not just in software. Today, everyone wants a senior <insert job role> for the price of a junior <insert job role>. So many problems would be solved orders of magnitude more soon if people were properly compensated. Instead, most things in the United States are running on economic fumes.