[maccard]

I do the infra from our company. I _want_ them to train on our infra and everyone else's infra and to tell me what actually works and will solve my problem, not what my account manager recommends because AWS approve it. That's basically the value add of the tool.

[willsmith72]

But how will it learn "what works" just based on different company's infra? I don't see how that would help an AI learn without things being labelled, and the answer can't be "lower latency means better". I'd actually be more trusting of the results of the current approach (GPT-4), because at least it's trained on every blog, forum response, and book ever.

[maccard]

> But how will it learn "what works" just based on different company's infra?

The same way as the current data was trained. I'm not expecting magic, I'm expecting help.

> because at least it's trained on every blog, forum response, and book ever.

Random blog posts that people write as examples as they're learning how to structure their infrastructure is not what I want to mirror our infrastructure on. I don't blindly trust the AWS documentation, I don't blindly trust a blog post, so why will I blindly trust an AI tool?

[tommy_mcclung]

Love this.

[samstave]

Exactly.

It would be interesting if just like an AI coding assistant, this would be a DevOPs/SRE/Infra assistant, whereby you can also just do your regular CI/CD/deployments/whatever - and have it make recommendations on caveats based on other architectures, or such.

e.g.

"describe examples for an architecture to accomplish X" and it spits out some examples - then you can choose, and save these "Infra-Prompts" and then later say

"generate a new sand-box based on X and connect it to such-and-such and notify USERA when their environment is available, include a status page, and alert cron and a costing line in the daily CFO report" etc

[maccard]

Couldn't agree more. Imagine if it could look at all the other 30-50 person companies who are running a SAAS and say "teams like yours use ECS + Fargate instead of Kubernetes" (as an example)

[samstave]

So is there already a "stack crawler" - or how does it know their infra?

[maccard]

I don't really know honestly, I'm just a proponent of "information sharing" in these spaces. I work with a few software providers that have a "give-back" clause for modifications, and it's a wildly powerful thing. I'd like to see it in this space too.

If I was implementing it, I would add some sort of survey a few days after the recommendations/queries are made and ask "Did this work, why/why not?", and attempt to train off of that. If you wanted to verify the accuracy, you could implement a test that ensures that things don't change wildly (e.g. if you tell it you're a small business running a SAAS on AWS that it doesn't recommend switching to Azure, or using EKS if you're already on ECS).

[samstave]

We need an AI as Infrastructure (TM) Conference, mayhaps.

-

It would be great to see AIAI Talks from folks on how well they leveraged AI for streamlining making the world a better, more equitable and connected safe-space place!