Artwork for podcast Act of Intelligence
From NASA to Digital Handyman: Choosing How Much to Trust Your AI
Episode 56th September 2026 • Act of Intelligence • Ajay Medury, Andrew Sierota
00:00:00 01:16:36

Share Episode

Shownotes

What does it take to stop babysitting your coding agents? Ajay and Andrew open with how big-tech office politics quietly manage people out, then get into the real news: Luxwander finally has a true progress number (95%), and the workflow that made it measurable has been split out into Rigr — a spec-first system with assurance tiers that let you dial expected quality from NASA-grade down to digital handyman. Along the way: a Minecraft server with a physical gold economy, why front-loading specifications kills a hundred rounds of code review, parallel CI as the new agentic bottleneck, the multi-repo versus monorepo argument, and a closing debate on whether today's models are intelligent or just acting.

In this episode:

How people get managed out, and what an IC can move without authority

Luxwander at 95 percent, and what a real progress bar took

Minecraft Nations: guilds, territory, and a physical in-game gold economy

Assurance tiers: matching AI effort and cost to the stakes of the job

Rigr: specs, slices, and contracts before a line of code is written

Parallel CI, multi-repo orchestration, and the monorepo debate

Are we the intelligent ones, or is the AI acting?

Chapters:

(00:00:00) - Teaser: launch a rocket on tier five

(00:00:18) - Office politics and how people get managed out

(00:06:37) - What an IC can actually move without authority

(00:07:42) - Luxwander at 95%: finally a real progress number

(00:10:36) - From "just build it" to eighteen modules

(00:11:52) - Minecraft Nations: guilds, territory, a physical gold economy

(00:19:28) - Assurance tiers: NASA at one, digital handyman at five

(00:25:39) - Why Rigr got split out of Luxwander

(00:31:39) - Zooming out to an orchestration layer over the agents

(00:38:30) - Front-loading specs to kill a hundred rounds of review

(00:40:55) - Modules, slices, contracts, and isolation

(00:51:16) - Parallel CI becomes the agentic bottleneck

(01:00:25) - Multi-repo orchestration and the monorepo argument

(01:06:23) - Opinionated defaults, and why design stays human

(01:08:43) - Tier thought experiments: rockets and cancer screening

(01:10:58) - Are we the intelligent ones?

Transcripts

Andrew:

Um, I guess I can just talk about real quick about this YouTube video I've been

Andrew:

watching.

Andrew:

Okay.

Andrew:

It's interesting.

Andrew:

It's about office politics, particularly Amazon, which you're familiar with.

Andrew:

There's this retired VP, and I'm only about two hours into the video.

Andrew:

It's three hours.

Andrew:

Oh, okay.

Andrew:

And they're just talking about like how they manage people, fire people.

Andrew:

Oh, yeah.

Andrew:

Okay.

Andrew:

You know, they, you know, they move people around to fire them.

Ajay:

Um, it's, it's good to know.

Ajay:

That's, that's, I mean, a VP individual, that's, I'm curious because that's a level

Ajay:

where they probably see a lot more of it.

Andrew:

Yeah, yeah.

Ajay:

Just like, just like they probably have, a VP would probably be like four or five

Ajay:

hundred people in an organization.

Ajay:

And it's, if you assume like a five percent, you know, year over year of their VP

Ajay:

for, let's say, four years, that's a hundred people at least.

Ajay:

So that's, that's quite a few.

Andrew:

Yeah, no, I, for me, what I was taking from it, I was like, wow.

Andrew:

Wow.

Andrew:

Like, these people are vicious.

Ajay:

I mean, yeah, it's, it's, yeah.

Andrew:

Like, the way he talks about some of the concepts, like explaining like how to, like

Andrew:

how things work in the office or how do you get someone to do something, you know,

Andrew:

and stuff like, like, kind of like really, really like pointed conversations, right?

Andrew:

Like, it's just like, wow, like these are like, kind of like conversations that.

Ajay:

Okay.

Andrew:

Like, you would not want to have done.

Andrew:

Like, in person at the workplace in front of other people.

Ajay:

Yeah, in front of other people.

Ajay:

Yeah, I was gonna, I was gonna say, that's very interesting.

Andrew:

So he's retired.

Andrew:

And I think that's another thing is that I, he wouldn't be talking about it this way

Andrew:

if he wasn't retired, I think.

Ajay:

Yeah, I mean, if you're, if you're gonna work, continue working with people, you

Ajay:

probably don't want to be having these kind of like letting these things out of the

Ajay:

bag kind of approach.

Ajay:

I, it's very interesting.

Ajay:

I had never have any, I had one experience from a non

Ajay:

-engineering person.

Ajay:

And it was very much a, hey, this needs to get done by this date.

Ajay:

And I was like, yeah, that's the target.

Ajay:

That's what we're gonna do.

Ajay:

And they were like, okay, I have heard of other individuals who had more, um,

Ajay:

strained experiences.

Andrew:

Yeah.

Ajay:

I don't think I've really experienced so many of them personally.

Ajay:

I really will say it's an interesting thing is, uh, I don't know.

Ajay:

Maybe, maybe it was just the fact that I was usually just saying yes to everything.

Ajay:

That could just be what I was doing.

Andrew:

Yeah.

Andrew:

Yeah.

Andrew:

I think it was, it was more so from like a management perspective since it was the

Andrew:

ODP.

Andrew:

Probably.

Ajay:

Probably.

Andrew:

Like there's a lot of politics to be done.

Ajay:

Yeah.

Andrew:

And I think just kind of revealing that side of it to me that I haven't really seen

Andrew:

or heard of before.

Andrew:

It was, it was just interesting to hear about.

Ajay:

I feel like though it happens everywhere.

Ajay:

Like some level of that.

Ajay:

Uh.

Andrew:

Oh yeah.

Ajay:

Yeah.

Ajay:

I feel like you get into the multiple hundreds of people.

Ajay:

You get into thousands of individuals.

Ajay:

At some point you kind of don't have a direct line to every individual in your

Ajay:

organization and I wouldn't be surprised.

Ajay:

I mean, I honestly have heard similar weird experiences outside of tech.

Ajay:

Um, clearly I think if you're, especially on a manufacturing line, I think it would

Ajay:

be very difficult to get that experience like of a personalized experience.

Andrew:

Yeah.

Ajay:

Um, with that, with that being said, I'm, I'm curious.

Ajay:

So like, were there, were there.

Ajay:

Were there mechanisms or something that they talked about?

Ajay:

Was it just like every time things are just super harsh?

Ajay:

Like what, what does, what would the learnings or what was their approach?

Andrew:

So for example, like when, um, they wanted to like

Andrew:

get someone to quit.

Andrew:

Oh, right.

Andrew:

They would just move this person to like a different org that people

Andrew:

considered like other.

Ajay:

Oh, interesting.

Andrew:

Yeah.

Andrew:

It's like, it's not an org that is like doing anything in particular.

Andrew:

Yeah.

Andrew:

Like for example, they weren't like working on like the Kindle or, or, or something

Andrew:

like that or the fire stick or whatever.

Andrew:

Right.

Andrew:

They were working on like something that's not seen from the public.

Andrew:

It's just other, they're like, okay, it's just something that has to be done, but

Andrew:

it's not going to get used like visibility, visibility anywhere.

Andrew:

So it's basically a dead end.

Ajay:

So it's a, some deep internal service somewhere that, you know, probably other

Ajay:

individuals who are, you know, internal users exist.

Ajay:

Some subsystems that may be public facing exist, uh, though the actual system that

Ajay:

you're working on might be three levels removed from any external customer.

Andrew:

Yeah.

Andrew:

Yeah.

Andrew:

And I, and I was just like, oh yeah, so that's a, that's a way to, they were just

Andrew:

saying like, okay, this is how we get rid of people like without firing them.

Ajay:

I mean, it is a discouraging motive, right?

Ajay:

Like, I mean, no, nobody in the tech industry who I think is came in with a lot of

Ajay:

energy and a lot of motivation wants to work.

Ajay:

Kind of in that position, um, there are individuals who feel very comfortable in, in

Ajay:

their career, comfortable where they are, who may pick that up and just be, I have

Ajay:

said this before on this podcast is like, uh, engineers, honestly, a lot of times

Ajay:

are janitors.

Ajay:

Those that embrace the janitorial duties actually make out very well if they are

Ajay:

accepting that that is what they're going to be doing.

Ajay:

You can earn a really good paycheck and not care about like, what is your day to

Ajay:

day.

Ajay:

Right.

Ajay:

Right.

Ajay:

Um, but that, that is a different place to be.

Ajay:

So.

Ajay:

So if you're coming into the industry and you're hoping to get like a really cool,

Ajay:

you know, in a big organization, working on Kindle, working on other things like

Ajay:

that, um, yeah, it can be really discouraging.

Ajay:

And I think it can be really like, oh, I'm not getting the interesting work that I

Ajay:

want, especially if you're a high performer and you're somebody who's used to being

Ajay:

like, I'm going to build this stuff.

Ajay:

I'm going to send it out.

Andrew:

Yeah.

Ajay:

Yeah.

Ajay:

I can see that, that being away to push them out quietly.

Ajay:

Yeah.

Andrew:

Yeah.

Andrew:

Yeah.

Andrew:

And there was a lot of other things he spoke of.

Andrew:

Um, but yeah, overall I was just, it was interesting to hear about like high level

Andrew:

office politics and how there were some talk of some ways to,

Andrew:

you know, get into that, like at an engineer level.

Ajay:

Okay.

Andrew:

Um, but, uh, I think we're just getting into that now, so yeah, about an

Andrew:

hour left.

Andrew:

Yeah.

Ajay:

Oh yeah.

Ajay:

I think so.

Ajay:

That's, that's a curious one.

Ajay:

Like from an IC perspective.

Ajay:

Yeah.

Ajay:

Okay.

Andrew:

Yeah.

Ajay:

So, um, this is a lot different than, I mean, if you're, if you're a people manager,

Ajay:

you, you have, that is your role.

Ajay:

That is your, you have leverage to do things that you have control.

Ajay:

Uh, as an individual contributor, I really don't think you can force people to do

Ajay:

things.

Ajay:

Um, you can work with managers to get things done.

Andrew:

Mm-hmm .

Ajay:

Um, I think the one thing I have honestly seen be the most effective

Ajay:

is how do you galvanize individuals?

Ajay:

How do you excite them?

Ajay:

You have to kind of figure out the right, um, common, you have to find common

Ajay:

footing.

Ajay:

Then you have to build on that common footing.

Andrew:

Yeah.

Ajay:

And then you gotta excite that this is the common footing that will help us build

Ajay:

that awesome feature that will get a lot of excitement and really drive, you know,

Ajay:

that feature, uh, and, and drive engagement.

Ajay:

And I don't think I've met too many engineers who hate the idea of driving

Ajay:

engagement.

Ajay:

So I don't know how do you, how you feel though?

Ajay:

I mean, Andrew, you, you, you're, you're aspiring, right?

Ajay:

Like here in that same space.

Andrew:

Yeah.

Ajay:

If you could drive engagement, if you could build something that people would engage

Ajay:

with and try and, you know, use, how would you feel about that?

Andrew:

I mean, it would feel great.

Andrew:

Yeah.

Andrew:

I mean, I, I mean, that is what's motivating me right now with Luxwander.

Ajay:

Yeah.

Ajay:

Right?

Andrew:

Yeah.

Andrew:

Like I, for me, it's like, it's a little bit less of a theory since it's already

Andrew:

been validated before.

Ajay:

Mm-hmm .

Andrew:

So there's kind of like that confidence that I know people are waiting for this

Andrew:

product right now.

Andrew:

Exactly.

Andrew:

Like people are going to use this.

Ajay:

Yeah.

Andrew:

Um, you know, when it's released and, and on that, I'm actually almost done.

Andrew:

I, this time I'm going to say almost done.

Andrew:

Oh, okay.

Ajay:

All right.

Andrew:

So with, uh, Rigr, which is, you know.

Andrew:

Yes.

Ajay:

Yes.

Ajay:

Yes.

Andrew:

Yes.

Andrew:

Um, it, I did, I ported some features back in the Luxwander,

Andrew:

like upstream, but not all of it.

Andrew:

Obviously it's a whole different system.

Andrew:

So, but I took some crucial parts of it that were part of the building out the

Andrew:

different systems.

Andrew:

Mm-hmm .

Andrew:

Um, and so from there I was able to finally get an actual percentage of what's built

Andrew:

out.

Andrew:

Oh.

Andrew:

Yes.

Andrew:

Because I actually have a detailed, you know, specifications of everything that's

Andrew:

supposed to be in this slice.

Andrew:

Like all the, the, the promises that were made.

Andrew:

Right.

Andrew:

And.

Ajay:

Because Rigr gave you what the total spec should be.

Ajay:

Yeah.

Ajay:

At the end of the day.

Ajay:

So at least it gave you a estimated map.

Ajay:

Yeah.

Ajay:

And now you can genuinely compare against it.

Andrew:

Yes.

Andrew:

Yeah.

Andrew:

Before it was like, oh, well.

Andrew:

We don't really know, but now it's like, okay.

Andrew:

Like I, I don't necessarily know how long it is between certain things, but at least

Andrew:

there's some sort of list now that says, okay, 40 out of 45 objectives.

Andrew:

Yes.

Andrew:

Have been, you know, it's, it's feature complete.

Ajay:

Different items on the list may be weighted differently.

Ajay:

Uh, but I'm expecting that just having the number on a piece of paper.

Andrew:

Yeah, it's, it's better than just not knowing what's being made.

Ajay:

Yes.

Andrew:

So, so we're, we're about 95%.

Andrew:

Through.

Ajay:

I, I, uh, I, I love it.

Ajay:

How much is, how much is the weight on the last five percent?

Andrew:

Uh, if, uh, we trust Codex's, um,

Andrew:

uh, analysis on that, it would say, I think it was like

Andrew:

six to eight hours.

Ajay:

Okay.

Ajay:

Yeah.

Ajay:

Six to eight hours is, uh, in Codex land.

Ajay:

I mean.

Ajay:

Yeah.

Ajay:

That'll be like, what, two engineering months or something.

Ajay:

Yeah.

Ajay:

Um.

Ajay:

Okay.

Ajay:

Yeah.

Andrew:

Yeah.

Andrew:

So we'll see.

Andrew:

Um, it's been thankfully, you know, thanks to all the resets that have been

Andrew:

happening mid way and it's just been running ever since I, you know, set it on its

Andrew:

task.

Andrew:

So I was like, okay, I like, I check in and I see, okay, we're, we're actually

Andrew:

getting somewhere.

Andrew:

Um, and I'm really excited to actually use the rigor workflow more formally once

Andrew:

it's done.

Andrew:

Nice.

Ajay:

Yes.

Andrew:

Um, and I'm going to be trying to publish it soon, actually like the first alpha

Andrew:

version of it.

Andrew:

Yeah.

Ajay:

I do, um, want to get into that a little more, but before we get into the rigor, um,

Ajay:

piece, I do want to ask you, Andrew, I guess maybe the question becomes is maybe too

Ajay:

laid out for our audience.

Ajay:

Can you talk a little more about like, uh, the number of modules, what rigor gave

Ajay:

you, what you were dealing with earlier and like how it helped you reconcile?

Ajay:

Like what did, what were you expecting and what did you actually get and how did it

Ajay:

help you?

Andrew:

Right.

Andrew:

So I guess if I start from the beginning, when I started just using Claude Code and I

Andrew:

set out to build the project out, I knew from the beginning I needed different

Andrew:

modules for different features for at least from an architecture perspective.

Andrew:

But as we just built it out, I kind of just said, well, build it,

Andrew:

right, right.

Andrew:

Here's the modules.

Ajay:

One shot, go.

Andrew:

Build it.

Andrew:

Right.

Andrew:

Yeah.

Andrew:

And so as you remember, I scrapped all of that.

Andrew:

I quickly realized that that was a bad idea.

Andrew:

This was way too complex for something like that.

Andrew:

Um, it was a, you know, 30 page game design document.

Andrew:

There was a lot in there, a lot of different modules.

Andrew:

I think about 18 modules and I think, uh,

Andrew:

not everything is like in the first phase.

Andrew:

So phase one has like a certain amount of modules or a certain amount of features in

Andrew:

these modules.

Ajay:

And then if I may ask, so specifically we were looking at the game design documents,

Ajay:

it was saying that there would be nations, there would be guilds.

Ajay:

So it's kind of like a hierarchical, can you maybe talk a little more?

Andrew:

Yeah.

Andrew:

Yeah.

Ajay:

Just a reminder of you.

Ajay:

Yeah.

Andrew:

So basically the game mode or the server or whatever, it would be called a Minecraft

Andrew:

nations.

Andrew:

It was actually based on the very first server I ever made.

Andrew:

Um, and so groups of people will be able to join one of three nations and

Andrew:

from one of those nations, they'll be able to create guilds and you capture land,

Andrew:

defend territory towns.

Andrew:

There's going to be like a real physical money trading, not like, not like Diablo,

Andrew:

like, but in game, there's going to be like an actual gold economy, an in-game gold,

Andrew:

in-game gold economy.

Andrew:

Yeah.

Andrew:

And, and that money will actually, um, it's all physicalized.

Andrew:

So there's no like digital inventory, you know, you can't just open up your, uh,

Andrew:

thing and see like a number for your like little, like hottest gold or something.

Andrew:

Yeah.

Andrew:

You actually have to have it in your inventory.

Andrew:

We, we'll probably have a function to count what's in your inventory to kind of keep

Andrew:

that in line with your inventory.

Andrew:

So you're carrying gold with a modern take on it, but you still need the gold with

Andrew:

you.

Ajay:

So you're carrying gold.

Andrew:

You're carrying gold.

Ajay:

And you have to basically be able to account for that gold.

Ajay:

And that was also one of the modules.

Ajay:

Um, and I think that's maybe the thing is like, uh, we were talking about how the

Ajay:

nations existed, the guilds existed, um, the economy was its own module there.

Ajay:

And so there's all these, uh, features and capabilities that you're enabling.

Ajay:

Yeah.

Ajay:

Um, essentially when you had the game design documents, I read them more as

Ajay:

narratives, kind of like a narrative of explaining what.

Ajay:

Yeah.

Ajay:

The nation, nation relationship would be what the guilds relationship would be.

Ajay:

How guilds would be related to nations.

Ajay:

Um, I think there was some graphs also, if I'm remembering right back then, which,

Ajay:

so I, I akin to, I was, uh, uh, maybe relating those a lot more to design documents.

Ajay:

Yep.

Ajay:

I'm curious what, uh, rigor workflow has given you now.

Ajay:

Is it similar?

Ajay:

Is it different?

Ajay:

If I may ask.

Andrew:

So for its usage and Luxwander, it's not like a, I haven't actually

Andrew:

used rigor for, uh, for Luxwander yet directly.

Andrew:

Okay.

Andrew:

I only took some of the concepts while I was, I was like, okay, I like this certain

Andrew:

piece of rigor.

Andrew:

And that piece was the very specific and detailed part where it was like,

Andrew:

okay, here's the design documents now from this create a very specific

Andrew:

and detailed version of her spec sheets slice by slice.

Ajay:

Got it.

Ajay:

Okay.

Andrew:

So, so that way the, the work was both.

Andrew:

Um.

Andrew:

Yeah.

Andrew:

More portable.

Ajay:

Of course.

Ajay:

Right.

Ajay:

Yeah.

Andrew:

Uh, because that didn't happen the first time.

Ajay:

Yeah.

Andrew:

So, and because it's portable, there is many checkpoints of where we can see how we

Andrew:

completed.

Ajay:

Go and verify this is work actually done.

Ajay:

Can you check a few specific things like in the game open kind of maybe, maybe at

Ajay:

some point we haven't done that yet, I believe, but that could be, could have, could

Ajay:

be one of the checks you put in the future is like, as you build it, like, can the

Ajay:

game be like run kind of thing at that point.

Ajay:

Um.

Ajay:

Um, I, I think I was gonna jump into one question there as well as like, uh, it, it

Ajay:

is great to see that you're able to take slices and actually experiment with them

Ajay:

individually.

Ajay:

That's amazing.

Ajay:

Um, I'm curious, like, uh, in this thing we just talked about, what did the spec

Ajay:

sheet give you?

Ajay:

Was it more like just a checklist or just specifically like what, what was, what

Ajay:

were you looking at when it actually came out with a portable, um, spec?

Andrew:

So there is a lot there.

Andrew:

I would actually say before I say anything, we should just go take a look later.

Andrew:

All right.

Ajay:

Okay.

Ajay:

Okay.

Andrew:

I, I, I have meditated it so much and I haven't actually used the actual workflow.

Ajay:

I see.

Ajay:

Yeah.

Andrew:

Except for in a dog fooding way.

Ajay:

Okay.

Andrew:

So it is now, it is now successfully building itself.

Ajay:

All right.

Ajay:

Yeah.

Andrew:

So it's actually engaging the workflow, upgrading its own conflict files.

Ajay:

Okay.

Ajay:

Okay.

Andrew:

And stuff like that.

Ajay:

So it's, it's, it's kind of like you're saying that, Hey, Claude, go do the original

Ajay:

spec.

Ajay:

It gave you a bunch of stuff back then.

Ajay:

Yeah.

Ajay:

This time you're saying, Hey, go rigor, go do the same thing.

Ajay:

And now I can actually compare.

Ajay:

And as I go along at like, or don't like things, I'll actually go improve.

Ajay:

So maybe, maybe I'm putting the, uh, uh, cart in front of the horse a little bit

Ajay:

here.

Ajay:

Maybe we'll, maybe I'll, I'll give you an opportunity to, you know, release and, uh,

Ajay:

you know, and the alpha version and then we can talk about it more.

Andrew:

Yeah.

Andrew:

Yeah.

Andrew:

Once it's like actually done, like I'll be inspecting, um, and

Andrew:

critiquing those parts once I can actually see it for now.

Andrew:

So now it's like, okay, I can see based on things that it's working.

Andrew:

And there was actually, um, part of testing the first alpha for it.

Andrew:

There was like 18 different scenarios that we painted out.

Andrew:

Um, and we, Claude Code or Codex.

Andrew:

Right.

Andrew:

And basically created like a web store, um, that was able to, you know, save data,

Andrew:

you know, you could render it in a browser.

Ajay:

Right.

Ajay:

Yes.

Andrew:

And so there was like an acceptance criteria for each scenario.

Ajay:

Yes.

Ajay:

Yes.

Andrew:

And then running all of those different scenarios through it, did it accomplish it

Andrew:

or not?

Andrew:

That was one of the first ways we were testing the workflow to see if it was

Andrew:

actually working at all.

Andrew:

Because, you know, obviously waiting for it to work for Luxwander is just a big

Andrew:

task.

Ajay:

Yeah.

Ajay:

It's just a big project.

Andrew:

So I was just kind of like, okay, how can we have smaller tests where I can at

Andrew:

least, you know, get a result today.

Ajay:

Oh yeah.

Andrew:

And, and, and, and be able to visually see and like start up the web server.

Andrew:

Manually inspect it.

Andrew:

Say, okay, I see it's working.

Andrew:

Like I see it built this out.

Andrew:

I can see that it matched up to what we were looking for.

Andrew:

Um.

Ajay:

Exactly.

Ajay:

Yeah.

Ajay:

Absolutely.

Ajay:

Uh, that is actually, um, exactly what I was, uh, you, you answered my question.

Ajay:

So at this point that, that, that is precisely what I was, uh, curious about is

Ajay:

like, yeah, you're seeing a specification set along with like a specific acceptance

Ajay:

criteria kind of thing.

Ajay:

Yeah.

Ajay:

Um, software engineering land, you know, and, and.

Ajay:

But actually I'm, I'm having, I'm, I'm having my hands right now because that's

Ajay:

essentially, you know, it's very hand wavy.

Ajay:

Everybody has their own way of representing that.

Ajay:

Um.

Ajay:

You know, I think I've seen a lot of cases where it's a simple as saying that, oh,

Ajay:

this is a heading.

Ajay:

This is a short description as to what we're achieving.

Ajay:

And the acceptance criteria is when X user can do ABC and sounds very similar

Ajay:

at the end of the day to that.

Ajay:

Right.

Ajay:

Yeah.

Andrew:

Yeah.

Andrew:

Yeah, so, and the reason why I haven't said, like, what level, because I haven't

Andrew:

inspected the spec sheets directly yet.

Ajay:

Yeah.

Andrew:

Right, and so I don't want to say, like, well, I know how detailed they are,

Andrew:

but I haven't done, like, a line-by-line check yet.

Ajay:

Got it, and Claude is basically giving you an estimate based on the lines that it

Ajay:

generated using Rigger and what has already been completed so far, and that's a 95%.

Andrew:

So, for the 94 Luxwander, so that wasn't using the actual, like, Rigger workflow

Andrew:

again.

Ajay:

Oh, got it, okay, my bad.

Ajay:

Well, I went down this whole rabbit hole, and we, okay, my apologies.

Andrew:

Yeah, it is, I was talking about that for, like, those, like, scenario tests, test

Andrew:

scenarios with, like, the web store front.

Ajay:

Okay, okay.

Ajay:

I do not know about that.

Ajay:

That's an interesting one.

Ajay:

Okay, but we have been also, like, I am curious, Dennis.

Ajay:

It sounds like Rigger is being iterated on.

Ajay:

Yes.

Ajay:

It's getting better.

Andrew:

I mean, we're, it's already at first alpha.

Andrew:

Now we're doing, I'm doing polishing for first publish now.

Ajay:

What can one expect with first alpha?

Ajay:

Like, can you maybe point to three or three to five, like, feature capability

Ajay:

slices?

Andrew:

Yeah, yeah, yeah.

Andrew:

So, first, it will be able to ingest some

Andrew:

documents, design documents, right?

Andrew:

From that, again.

Andrew:

And you do, you, they're called assurance tiers now.

Ajay:

Assurance tiers, yeah.

Andrew:

And you'll be able to choose, you know, from one to five, right?

Andrew:

And one being the highest, five the lowest.

Ajay:

Digital handyman being the five, and, you know, NASA being one, like, expectation of

Ajay:

quality.

Ajay:

Yeah, yeah.

Andrew:

And then, so, let's say you choose three, and that's the standard, like, average

Andrew:

production.

Andrew:

Like, it's not dealing with money or lives or anything like that.

Andrew:

It's just, like, you know, everyday use, right?

Andrew:

They'll be good enough, right?

Andrew:

So, from there, that standard will be applied to how the model will

Andrew:

spit out the actual specifications.

Andrew:

Okay.

Andrew:

Because there's different levels of detail for each tier, right?

Andrew:

So, once it's, you know, puts that out, from there, it will use those specs

Andrew:

and actually build it out, right?

Andrew:

And then, from there, it will do a short review.

Ajay:

Mm-hmm.

Ajay:

Mm-hmm.

Andrew:

Because it's actually not going to be, the reviews are actually really short now,

Andrew:

because the first review happens on the spec sheets.

Ajay:

Okay.

Ajay:

Yes.

Ajay:

I, if, just a, just a really quick recap.

Ajay:

So, we're saying, basically, in just my current documents, my current plans.

Ajay:

Yep.

Ajay:

Figure out what I want to do.

Ajay:

Yeah.

Ajay:

Rate, would you be rating it?

Ajay:

Would I, if I'm the user, would I be rating it saying that the expectation is tier

Ajay:

one or tier two up to five?

Andrew:

The user is supposed to.

Ajay:

So, I'll give it my spec sheet.

Ajay:

I'll give it the tier rating.

Ajay:

Yep.

Ajay:

Um, and then, it'll basically go do a initial, um, generation of some specs.

Ajay:

Yeah.

Ajay:

And it'll do a self-review of those specs.

Ajay:

Yep.

Ajay:

And it will have that conversation with you.

Ajay:

Like, me as a user.

Andrew:

Yeah.

Andrew:

Yeah.

Andrew:

So, it'll have it like, okay, yeah, if there's anything to check over.

Andrew:

Mm-hmm.

Andrew:

Thankfully, the spec generation is actually specific enough so far in my usage of

Andrew:

it.

Ajay:

Mm-hmm.

Andrew:

That there hasn't really been, there's actually no need for review anymore.

Andrew:

There are review processes.

Ajay:

Mm-hmm.

Andrew:

Right?

Andrew:

Right.

Andrew:

And, like, short enough, I'm assuming once we get up to more complex things, it's,

Andrew:

we're going to run into hiccups because of context, maybe.

Ajay:

Yeah.

Andrew:

Um, but, like, the storefront and stuff, those have been validated pretty

Andrew:

straightforward things, I think.

Ajay:

Which, which is totally reasonable, I think.

Ajay:

From, uh, how would I put it?

Ajay:

The, you don't want to get too specific too early.

Ajay:

No.

Ajay:

Yeah.

Ajay:

It might be actually distracting and, uh, taking away from the ability to look at it

Ajay:

holistically.

Andrew:

Yeah.

Andrew:

Yeah.

Andrew:

Because right now, what I'm trying to do is, like, I've kind of learned from my

Andrew:

mistakes earlier with Luxwander, trying to get everything done all at once.

Ajay:

And this is Luxwander iteration two or three?

Andrew:

Oh, the, the, the, the project as it's going now, like, you know, scrapping all the

Andrew:

original code, right?

Ajay:

Yeah.

Andrew:

Um, I, I'm trying to just get it working as fast as possible now.

Andrew:

I, I want to see it play from A to Z.

Ajay:

Yeah.

Andrew:

And then I'll go back and start to critique it because I already had an idea, it's

Andrew:

all played out in my mind.

Andrew:

Like, I already have all of it, like, written out of what I wanted it to look like.

Andrew:

And basically I'm going to let it finish building out.

Andrew:

Then now I'm going to do a pass on actually critiquing each module, like working

Andrew:

through it.

Andrew:

And that's when I'm going to start looking at the specs, right?

Andrew:

Because I can see that the tests had worked, but now I'm going to be like, okay,

Andrew:

well, what's in there?

Andrew:

What is it missing?

Andrew:

What would I like it to be there?

Andrew:

You know?

Andrew:

Right.

Andrew:

, um, like for example, I'm like, oh, well, I remembered, like, for example, this

Andrew:

could be, this could be something I find.

Andrew:

I was like, oh, for some reason it's choosing the assurance tier on its own.

Andrew:

Let's say that I'm like, okay, that's not what I want.

Andrew:

And I wanted to be able to select it.

Ajay:

Yep.

Ajay:

Yep.

Ajay:

Because that is an explicit input that you want to gate.

Ajay:

So you don't get it to do too much work when you actually don't want it to do too

Ajay:

much work.

Ajay:

Alternatively, you want it to have a higher bar when it may not assume you should.

Andrew:

Yeah.

Ajay:

So, um, yeah, are you, are you thinking, so it sounds like it is a particular case

Ajay:

where because Codex is doing its own thing, it's going the goal oriented, you know,

Ajay:

solutioning that Codex can do, just ignore everything else is YOLO, let's go build.

Ajay:

Um, that sounds like it is doing certain things where you want to inject a more

Ajay:

specific, um, expectation at each phase.

Ajay:

And that is kind of like the part that's missing and you want to, or I guess, what,

Ajay:

how are you thinking you're going to solve that?

Andrew:

Well, well, I, again, um, like now that we're basically at first alpha,

Andrew:

uh, now it's when I'm going to start to manually review and work the process.

Ajay:

Got it.

Ajay:

So you're going to, you're going to feed it to rigor and then rigor.

Andrew:

I'm actually going to start using it and seeing, seeing where it doesn't live up to

Andrew:

my expectations and then I'll be able to.

Ajay:

Kind of like now is the dogfooding session now that you've, uh, you've been building

Ajay:

the main, you know, product for quite a while, which is a Luxwander, you know, game

Ajay:

with all of the nations and all the, oh, sorry.

Ajay:

What was the name that you gave it?

Andrew:

Minecraft nations, Minecraft nations.

Ajay:

And, and so you've been building that product for a while now.

Ajay:

Uh, you have, uh, now also recognize that there's all these learnings about how to

Ajay:

build it.

Ajay:

And that is essentially where rigor is becoming this, uh, solution to help build it

Ajay:

more effectively in a more organized way that you can track more effect, you know,

Ajay:

software engineering, life cycle almost as DLC style almost.

Ajay:

And, and, uh, the intention now is to start plugging in rigor and use it in a more

Ajay:

organized way.

Ajay:

Would you start using it in the remaining portions of the Luxwander or, uh, you

Ajay:

know, like, or in this case, I'll say Minecraft nations, or would you say that you

Ajay:

will basically

Ajay:

restart from scratch maybe?

Andrew:

Um, I'm definitely not going to restart Luxwander from scratch.

Andrew:

Yeah.

Andrew:

Fair enough.

Andrew:

Um, but.

Ajay:

We did joke about being like a hundred, 200,000 lines of code or something.

Andrew:

It's a, it's up to 600 now, but, but, um, yeah, I'm definitely not going

Andrew:

to restart that there.

Andrew:

I think like there comes a point.

Andrew:

There comes a time where, um, you just have to ship it.

Ajay:

Mm.

Ajay:

Right.

Andrew:

And at this point I'm like, okay, I'm not really worried cause I'm not shipping it

Andrew:

to like the public yet, but I need to start shipping it internally so I can start

Andrew:

testing it.

Ajay:

Right.

Andrew:

And so it's funny because I was doing so much work with

Andrew:

Luxwander and the workflow itself.

Andrew:

That's why I separated it out to rigor because I was like, okay, I'm iterating so

Andrew:

much on the workflow.

Ajay:

Yeah.

Andrew:

That now.

Andrew:

Luxwander is not getting iterated on cause I keep going back and say, oh, this can

Andrew:

be better.

Andrew:

That can be better.

Andrew:

This can be better.

Ajay:

This is one of the fun moments of when we talk about parallelization.

Ajay:

This is a valid case of parallelization in software engineering where you're like,

Ajay:

okay, we recognize there's a bunch of things we could get better at.

Ajay:

Should we stop our product development to do that?

Ajay:

No, no.

Ajay:

Let's just, let's just go do it at the side when, when it reaches a reasonable

Ajay:

version, a usable version, we will now pull it back in and then the next iteration

Ajay:

of our solution.

Ajay:

So we're not changing.

Ajay:

We're not building rebuilding from scratch.

Ajay:

We're the solution.

Ajay:

The workflow that we build has to accept an existing project or product and

Ajay:

essentially build on top is what it sounds like.

Andrew:

Yes.

Andrew:

Yeah.

Andrew:

So, so basically I've, I've ripped out everything that now from there, well, I guess

Andrew:

copied and that turned into rigor in a different repository.

Andrew:

So now they're both being worked on at the same time, but Luxwander has the older

Andrew:

version, the brainchild version.

Ajay:

Right.

Andrew:

So it's not actually running rigor because it's not implemented there.

Andrew:

Right.

Andrew:

But it does have its own version with some influences, like some key features that

Andrew:

I've extracted out of rigor.

Ajay:

Some unavoidable things that you were like, I really need this right now.

Ajay:

Exactly.

Ajay:

This needs to be there.

Andrew:

Just enough to get it going.

Andrew:

Yeah.

Andrew:

And then after that, I set it off to complete it because I was like, I was like, it

Andrew:

would take too long to integrate now at this point.

Andrew:

I'll do that on phase two.

Ajay:

That is, that is, that's very.

Ajay:

Reasonable thing to do.

Ajay:

I just bumped my mic stand.

Ajay:

So if you heard something, my apologies.

Ajay:

The, that is a totally reasonable approach.

Ajay:

And, and I think you can't fix everything.

Ajay:

No.

Ajay:

There might be things that if you fix a use, the benefit is so big or things you

Ajay:

just absolutely need to build confidence in what you're doing.

Ajay:

Yeah.

Ajay:

Therefore you will actually go ahead and implement it or pull it back in.

Andrew:

And that's exactly what I did.

Andrew:

It was like, it's like you kept asking me, how's it going?

Andrew:

Yeah.

Andrew:

And I said, I'm not sure.

Ajay:

Yes, that's fair enough.

Andrew:

And so that's, was one of the things, like, I would like to be sure of how long this

Andrew:

is going to take.

Ajay:

The confidence levels were low.

Ajay:

Yup.

Andrew:

But be from taking that feature out of rigor, putting it into there just like that

Andrew:

one piece.

Ajay:

Yes.

Andrew:

I was able to finally get an actual progress bar going.

Andrew:

Yeah.

Ajay:

And interestingly, I will, um, I'm going to digress just a little bit here.

Ajay:

Um, I think the thing I'm thinking about in this particular scenario is, uh, it

Ajay:

feels like.

Ajay:

Um, we have been talking about, um, Minecraft worlds as a

Ajay:

Minecraft nations.

Ajay:

Sorry, didn't mean to, again, I'm, I'm going to get used to that name Luxwander.

Ajay:

We've been talking about Luxwander as, as a project and kind of been focusing on it

Ajay:

from a, uh, 30,000, uh, more, more like actually 5,000 feet view.

Andrew:

Yeah.

Ajay:

So if I imagine if I use a plane analogy, um, I can see your mic is bothering you

Ajay:

there, but I, I can appreciate that, uh, I'm having the same challenge, but.

Andrew:

Yeah.

Ajay:

Uh, coming back to the plane analogy and, uh, the way you've been operating right

Ajay:

now has been actually very close to the code.

Ajay:

You've been watching the coding assistants do a lot of the work very closely and

Ajay:

tracking their work on a day-to-day basis, almost hourly basis at times.

Ajay:

Um, now it almost feels like you are pulling a little bit higher because you're

Ajay:

like, okay, it did this in these last few iterations.

Ajay:

These were certain behaviors that did not give me any confidence.

Ajay:

You, I feel like you've actually gone from, let's say.

Ajay:

5,000 to almost 20,000 feet where you're like, okay, what happened the last four

Ajay:

times?

Ajay:

And tell me now, uh, it's not an exact analogy.

Ajay:

It was just, this is just now.

Ajay:

Um, and this is sounds like there are certain things which you've discovered where

Ajay:

you're like for the next, you know, next few iterations.

Ajay:

I need this.

Ajay:

I just, I need this capability, even if it's being built in parallel and that other

Ajay:

project and the workflow, like in rigor workflow creation, there is certain things I

Ajay:

just need as part of Luxwander for me to build that confidence that we can actually

Ajay:

get there.

Ajay:

And, uh, this is, I think the plain analogy working out where you were, you were

Ajay:

monitoring mostly at that 5,000 so far, but now you're coming up and you're

Ajay:

observing that there's things going on in many places that I can kind of start

Ajay:

putting together.

Ajay:

So that is, that is really cool.

Ajay:

That is actually part of the also thing in software engineering and software

Ajay:

development, where at some point you must recognize that there may be parallel work

Ajay:

being done in two separate places that need to unify in a way and need to come

Ajay:

together.

Ajay:

Um, and I think those are things that really excite me, uh, because as an engineer

Ajay:

who has worked in large engineering teams in the past, uh, you know, repeated work

Ajay:

in slightly different ways is completely mind boggling and also very impossible

Ajay:

to maintain long-term is, is just not tenable.

Ajay:

It's just like things just change.

Ajay:

Like there's just everything.

Ajay:

Most of the ideas are the same, but then there's just like variations, just like

Ajay:

slight cracks going, you know, or slight branches going.

Ajay:

Yeah.

Ajay:

Left and right.

Ajay:

And, uh, in, in the two separate work streams.

Ajay:

And I think that's, that becomes really dangerous and unmaintainable and long-term.

Ajay:

So I think what you're doing now is awesome.

Ajay:

Like in terms of recognizing that there are things that could be unified now

Ajay:

providing immediate value while also, uh, being unified in the long-term and,

Ajay:

uh, providing a good value in the long-term.

Ajay:

So I don't know if that's what you feel like you're doing though, Andrew.

Ajay:

I think that is actually what I'm seeing.

Andrew:

Yeah.

Andrew:

I actually agree completely.

Andrew:

Like, uh, I mean, just from how I'm using it now, I used to kind of babysit like

Andrew:

the agent, right.

Andrew:

I'm like, okay, like, but now it's like, okay, it's, I, I'm confident that the

Andrew:

specifications were written out and detailed enough to actually get it done

Andrew:

correctly.

Andrew:

And now I'm just, just waiting for it to complete it.

Andrew:

And so essentially it's been coding itself for, you know,

Andrew:

maybe like two weeks.

Andrew:

Yeah.

Andrew:

Yeah.

Ajay:

Yeah.

Ajay:

Yeah.

Andrew:

Um, the, it's funny as I kind of zoom out more, I see

Andrew:

more bottlenecks, right.

Andrew:

And so now I'm actually in the process of kind of brainstorming a

Andrew:

kind of like automated orchestration layer that has my

Andrew:

objectives, broader objectives there.

Andrew:

So that way when something occurs at a lower level agent that, uh,

Andrew:

you know, broader agent would be able to actually redirect and push them in the

Andrew:

right direction.

Ajay:

Um, I, I really love the idea.

Ajay:

Also dangerous game where the, where the, uh, workflow basically becomes a project

Ajay:

at some point.

Ajay:

Uh, so, so I, I think I'm curious about like that part too, is like, there is a day.

Andrew:

I haven't, I haven't used it yet, but it's essentially just what I, what I'm finding

Andrew:

is like, I have a lot of different projects, right.

Andrew:

Um, I'm confident if I can become confident in the specifications and the

Andrew:

instructions, that are put to the models, which that's what I'm trying to do right

Andrew:

now is like, can I be confident that the instructions, the specifications being

Andrew:

written down are going to be, you know, you know, like satisfactory

Andrew:

to my acceptance criteria, right?

Andrew:

Like, will it come out the way that I want it based on the tier that you've selected

Andrew:

based on the tier that I've selected, right.

Ajay:

Okay.

Andrew:

Um, if I can become confident in that, then I can become confident, become confident

Andrew:

that that layer can then be automated.

Ajay:

Got it.

Ajay:

I see your point.

Ajay:

So, because so far you have let it do its work and you've been monitoring it

Ajay:

closely.

Ajay:

You've observed that it may say it's actually done, but it's not really done a lot

Ajay:

of the times.

Ajay:

And it keeps telling you things.

Ajay:

And then when you tell it, oh, this doesn't look right.

Ajay:

Then it goes back and there's no end.

Ajay:

There's kind of like that loop that's constantly occurring.

Ajay:

And at some point you get frustrated.

Ajay:

And at some point you're like, how do I now actually get it to truly measure?

Ajay:

What is an objective criteria?

Ajay:

And then how do I actually figure out if the, if, when it says it met the objective

Ajay:

criteria, it's meeting it or not.

Ajay:

So it's, it's a little meta.

Ajay:

We're kind of like saying like the confidence layer of the confidence levels, you

Ajay:

know, confidence on top of confidence.

Ajay:

But the idea is like saying that, can I figure, put some mechanism in place that

Ajay:

lets me let it go with a high level of confidence and meaning that let's say 80% of

Ajay:

the time, it'll get it right.

Ajay:

Maybe in the future I get, I figure out why that 20% is failing.

Ajay:

I go from 20% of the time.

Ajay:

And from a 20% failure rate to like, let's say five.

Ajay:

So then eventually it'd be 95% of the time.

Ajay:

I just let it run with enough information and it's doing it correctly.

Ajay:

I interestingly, I think I've actually experienced a lot of this in my own personal

Ajay:

projects.

Ajay:

And it's like, there are these iterations where I will run through and be like,

Ajay:

okay, I'm going to go, I tell it to go spawn up sub agents, do work in the sub

Ajay:

agents.

Ajay:

And interestingly, the orchestration layer that you're talking about is essentially

Ajay:

something I've been playing with just directly in cloud in this case.

Ajay:

So I'm telling Claude, Hey, you are the main orchestrator, go spawn up the sub

Ajay:

agents, get, give them the right information to go do the work.

Ajay:

When they come back, I want you to verify and tell me if they've done their work or

Ajay:

not.

Ajay:

And then, excuse me.

Ajay:

And then explain to me what that, what that, you know, proof was.

Ajay:

I'm curious.

Ajay:

I, my experience from this has been relatively good because Claude will actually be

Ajay:

like, oh no, I didn't actually do everything at times because the sub agent will

Ajay:

have less contacts.

Ajay:

Sometimes it.

Ajay:

Uh, will not have everything it wants.

Ajay:

And then the parent orchestrator will recognize and do a little better next time.

Ajay:

Um, that is, that is kind of like one approach.

Ajay:

I'm still trying to figure out how to extract those learnings out of that one

Ajay:

orchestrator session and make it more usable across different sessions.

Ajay:

Um, which is, which is interesting to me is because I'm hearing a lot of the stuff

Ajay:

you're building.

Ajay:

The workflow you're building is very exciting and sounds very like, like it can do

Ajay:

what really, like what a lot of people.

Ajay:

Are hoping for, uh, in my opinion, uh, I'm trying to figure out, um, in your

Ajay:

mind, do you feel like this is something that maybe is still like focused on games

Ajay:

at game design?

Andrew:

No, no, absolutely not.

Andrew:

Uh, for rigor as a workflow is meant to be project generic.

Ajay:

Okay.

Andrew:

And it's, it's supposed to be able to, so once, like, I think, I don't know if this

Andrew:

is in the current phase.

Andrew:

I don't remember, but there are multiple phases for rigor and there'll be different

Andrew:

layers of customization.

Andrew:

Okay.

Andrew:

Yeah.

Andrew:

So it's at some point there's going to be like, literally like when you're

Andrew:

installing it, it will ask you certain things to customize.

Ajay:

Okay.

Andrew:

Um, the, the, the workflow.

Ajay:

Is, is, is this already there right now in the alpha you were thinking about this

Ajay:

for the future?

Andrew:

Um, I don't think it's, I don't think it's in the current alpha now.

Andrew:

Okay.

Ajay:

Okay.

Andrew:

Yeah.

Andrew:

It's there's a lot of features.

Ajay:

We'd like to get everything done.

Ajay:

We'd like to boil the ocean, but you know, we are reasonable.

Andrew:

And the only reason I say that is because I haven't like focused on it at all.

Ajay:

So I'm going to assume it's not, I, you know, I'm, again, I'm, I'm, I'm raising my

Ajay:

arms here.

Ajay:

I'm telling Andrew.

Ajay:

Yeah, I totally agree.

Ajay:

I totally, totally can understand.

Ajay:

Uh, we would love to do everything, uh, especially with the eye.

Ajay:

We feel like we can do everything.

Ajay:

Um, but we need to be reasonable and like pick one thing at a time.

Ajay:

So I guess that is coming back to it is, um, in the current effective state, what

Ajay:

would be in your mind, the alpha, like what is a killer feature?

Ajay:

What is it doing really well?

Ajay:

Because I think we talked a little bit about this previously.

Ajay:

The tiers is something I love the concept of, uh, where are you at about like, Hey,

Ajay:

this is something that most individuals probably run into when buildings they're

Ajay:

like projects.

Ajay:

I maybe not even forget software.

Ajay:

Just you're using a digital handyman.

Ajay:

You're trying to do something in particular, you know, like, uh, Claude Code is your,

Ajay:

uh, is your like, you know, software engineering, uh, you know, AISs.

Ajay:

And, uh, Codex is your digital handyman.

Ajay:

They can do things, but rigor start using rigor with them.

Ajay:

And all of a sudden, this is one thing you will see that is very helpful.

Ajay:

What would you say is that very helpful piece in your mind?

Ajay:

I'm putting you on the spot here.

Andrew:

So I, yeah, no, I, I think I, to be honest, it was the part that I extracted for

Andrew:

Luxwander.

Andrew:

Right.

Andrew:

It is, it's actually building out the specifications to the level of detail where

Andrew:

review cycles are not as relied upon.

Andrew:

Because what I found when I was working with Luxwander without this workflow, right.

Andrew:

This little piece was again, you saw like, oh, this is round a hundred for review.

Andrew:

And I thought to think to myself, well, there's got it.

Andrew:

Why are all of these gaps here?

Ajay:

A code review.

Ajay:

Code review is what we want to be very specific.

Ajay:

Yeah.

Ajay:

There's a hundred rounds of code review amongst multiple models.

Ajay:

And I think we've talked about this before, but yes, code review.

Andrew:

Yes.

Ajay:

That's a lot.

Andrew:

Yeah, no, that is a lot.

Andrew:

And I was like, that actually took longer than generating the code.

Ajay:

Mm-hmm .

Andrew:

Well, significantly longer.

Ajay:

Mm-hmm .

Andrew:

And so I guess it's obvious looking back now, but I was like, okay, well, how can I

Andrew:

shorten the rounds of review?

Ajay:

Mm-hmm .

Andrew:

One way to do it was to be more specific on how to fix it.

Ajay:

Mm-hmm .

Andrew:

Or I give me more specific on how to make it.

Ajay:

Mm-hmm .

Ajay:

And so.

Ajay:

Better discovery upfront.

Andrew:

Yeah.

Andrew:

Yeah.

Andrew:

So now I'm front loading the kind of effort to the actual generation

Andrew:

of the specs.

Andrew:

Mm-hmm .

Andrew:

Before it even touches any code.

Ajay:

Because it's a lot cheaper to generate a few, maybe a dozen documents, like each

Ajay:

being about two or three pages versus 600,000 lines of code.

Andrew:

Yep.

Andrew:

And so essentially it will build out all of those contracts.

Ajay:

Yes, Scott.

Andrew:

In this specification.

Ajay:

You're talking my language now.

Ajay:

You're hitting contracts.

Ajay:

Yes, Scott .

Andrew:

And there'll be different slices for the actual features.

Ajay:

Nice.

Ajay:

Nice.

Andrew:

And then the modules.

Andrew:

So now it's like there's three layers now of it's actually building

Andrew:

out those things individually.

Andrew:

Not even in code.

Ajay:

Mm-hmm .

Andrew:

It's just for specifications.

Andrew:

Awesome.

Andrew:

And so that's where I get the confidence.

Andrew:

Mm-hmm .

Andrew:

And then there's also when you do the review, there's actually something to look at.

Andrew:

Before.

Andrew:

Before.

Andrew:

Yeah.

Andrew:

The code was even written that it's supposed to be there.

Ajay:

Yes.

Andrew:

So now it's like, okay.

Andrew:

The review is like, okay, unless there was like a coding error that the model did,

Andrew:

which doesn't really happen too often.

Ajay:

It doesn't.

Ajay:

No, not anymore.

Andrew:

Yep.

Ajay:

So it's a specification errors happen a lot.

Andrew:

Yes.

Andrew:

Yeah.

Andrew:

So as long as it has the right context.

Ajay:

Yes.

Andrew:

It can write it correctly.

Ajay:

And I think you're really hitting on the right points because I think the more

Ajay:

specific you can be about the ask, based on all my experience, based on all my

Ajay:

readings and everybody else I've talked to, the more specific you can be about the

Ajay:

ask.

Ajay:

The more specific you can be about the task to the model, you know, Claude Code,

Ajay:

Codex, Gemini, whoever it is, some are going to be better than others regardless.

Ajay:

But the more specific that you can be upfront, the better job it will do.

Ajay:

You can one-shot things as long as your one-shot is so detailed that there's very

Ajay:

little left to interpretation.

Ajay:

I'm not sure if that's necessarily the case here, but it sounds like at least that's

Ajay:

a direction this is starting to drive towards.

Ajay:

And these primitives, now that you're establishing the primitive of a contract, the

Ajay:

primitive of a feature and module.

Ajay:

I'm sorry, I might have butchered the slices, the feature slices.

Ajay:

Yeah.

Ajay:

Okay.

Ajay:

So are you calling it slices or features just for my own sanity?

Andrew:

I am calling it slices, but they're meant to be, each slice has a different feature.

Ajay:

Got it.

Ajay:

So you can have like a single contract and have multiple features under it maybe?

Ajay:

Or is it hierarchical at all?

Andrew:

It's a slice can have several contracts.

Ajay:

Okay.

Ajay:

Got it.

Ajay:

Absolutely.

Ajay:

And then the modules, you can have multiple modules as part of a single slice.

Andrew:

There are multiple slices make up a module.

Ajay:

Got it.

Ajay:

Okay.

Ajay:

So I flipped it around.

Ajay:

I'm going to turn that tree upside down in my head.

Ajay:

So got it.

Ajay:

Absolutely.

Ajay:

So you have the module.

Ajay:

The module has multiple feature slices or slices in particular.

Ajay:

Each slice may have one or more contracts that help essentially execute or provide

Ajay:

that capability, the features capability.

Ajay:

Yeah.

Ajay:

That's awesome.

Ajay:

Like these primitives, I do feel like are a great way to at least start

Ajay:

conversations.

Ajay:

And in this case, a conversation with your coding assistant.

Ajay:

Again, in my history.

Ajay:

In my experience as a software engineer, that is what we were talking about as like

Ajay:

coming kind of circled back to the YouTube video as a individual contributor,

Ajay:

as a software engineer and not a manager.

Ajay:

Really the only way, in my opinion, not the only way, but one of the easier ways

Ajay:

that I have found personally to convince others and get engineers like human

Ajay:

engineers to actually get excited and then build something really awesome is to

Ajay:

start with a common set of primitives that we can all align on.

Ajay:

Right.

Ajay:

And then once we have that common footing, how do you then explain when you put

Ajay:

these things together and you start putting those Legos on top of each other, you

Ajay:

know, is going to create this awesome thing.

Andrew:

Absolutely.

Andrew:

And I guess I wanted to expand on like the slices and the contracts a little bit.

Ajay:

Absolutely.

Andrew:

The reason why I kind of directed it that way was because I was finding that during

Andrew:

the reviews on the original versions of the Luxwander that was having all those

Andrew:

troubles with all those rounds of review.

Ajay:

Mm-hmm.

Ajay:

Mm-hmm.

Andrew:

Was every time it did fix something, it broke something else.

Ajay:

Mm.

Andrew:

And so that was leading to the The regression.

Andrew:

Infinite loop.

Andrew:

Yeah.

Andrew:

The regressions led to an infinite loop disaster.

Andrew:

Right.

Andrew:

It did eventually finish it.

Andrew:

But how many days of tokens that I waste to get something what I thought should have

Andrew:

been rather straightforward was not.

Andrew:

Right.

Andrew:

And this is obviously when you're dealing with a module that has like over a hundred

Andrew:

thousand lines of code.

Andrew:

Mm-hmm.

Andrew:

And so there needs to be like, I was like, well, how do we, how do we fix this?

Andrew:

Right.

Andrew:

And so each slice is isolated for that feature.

Ajay:

Another word that I love.

Ajay:

Yeah.

Ajay:

Absolutely.

Ajay:

Isolation.

Ajay:

Woo.

Andrew:

So that way, if we need to update that feature.

Ajay:

Mm-hmm.

Andrew:

It's only going to mess with that component.

Ajay:

Mm-hmm.

Andrew:

That slice.

Andrew:

Mm-hmm.

Andrew:

Those contracts in that slice.

Ajay:

I love it.

Ajay:

I, I mean.

Ajay:

Mm-hmm.

Ajay:

Mm-hmm.

Ajay:

Andrew, you've heard me talk about it, you know, isolate things, paralyze things,

Ajay:

create the contracts.

Ajay:

Oh my gosh.

Ajay:

Wow.

Ajay:

All right, here we go.

Andrew:

And yes, those slices have been built in like intentionally.

Andrew:

I've been specific about it, that it needs to be able to be paralyzed.

Ajay:

Paralyzed and in the slices.

Andrew:

Yes.

Andrew:

Those slices can have an individual agent working on each one.

Ajay:

This is exciting to me and for very specific reasons, because I've actually used a

Ajay:

lot of open source libraries for spec driven development.

Ajay:

We've talked about GSD, OpenGSD now a few different times.

Ajay:

I will not say the whole word because we might, you know, we might get our podcast

Ajay:

taken off the air from Apple again.

Ajay:

So the idea there that I really loved was creating specs ahead

Ajay:

of time, doing some things.

Ajay:

So there are open source libraries that do this.

Ajay:

Parts of this.

Ajay:

What Andrew has just mentioned though, I think is a very clear distinction is how do

Ajay:

you break up a larger problem?

Ajay:

How do you actually then create into different tiers and like tier?

Ajay:

Based on like what level of, you know, accuracy you need?

Ajay:

Like, you know, error rate needs to be really low.

Ajay:

And then based on that tier, how do I actually create a broken down problem?

Ajay:

Multiple modules, multiple feature slices, multiple contracts as needed in order to

Ajay:

achieve that?

Ajay:

I mean, I guess I will say this Andrew, just to keep ourselves honest and just to

Ajay:

keep this honest as we are, it's an alpha.

Ajay:

So there's clearly, there's going to be some work here in refining that.

Ajay:

I think I'm really excited by the concept of that because instead of it just saying

Ajay:

that.

Ajay:

The other approaches I've seen, which do really well, they, they,

Ajay:

they, I feel like are a little more still on that 10,000 foot level in the plane

Ajay:

analogy.

Ajay:

And they're very focused on like certain capabilities.

Ajay:

Once you start getting into that 20,000, 30,000 feet, I feel like they've kind of

Ajay:

fallen down for me a little bit where they start creating so many slices and that's,

Ajay:

they're mostly doing like phases of implementation.

Ajay:

GSD in particular does phases of implementation.

Ajay:

At some point, I've got too many phases, I'm losing track and things are getting too

Ajay:

like untenable.

Ajay:

Again, that is where I do feel like this approach of like, Hey, I have a module.

Ajay:

The module got completed.

Ajay:

The next module is also there.

Ajay:

Now I can match the, figure out the relationships between them.

Ajay:

That I think scales better when you look at it from like that 20, 30,000 feet.

Ajay:

And I, I have had to do the modules.

Ajay:

I've had to do the, you know, feature slices in my head and work with like different

Ajay:

cloud sessions.

Ajay:

So I'm definitely excited too.

Ajay:

To hear about this and like actually try some of this out.

Ajay:

Yeah, very excited.

Andrew:

Absolutely.

Andrew:

No, I'm excited too.

Andrew:

And I, I think it's close.

Ajay:

All right.

Ajay:

Yeah.

Andrew:

I mean, it already, the first alpha is, is ready now.

Andrew:

It's just kind of like, I am, it is like, it's already been tested.

Andrew:

It does work because of the scenarios.

Andrew:

Now I'm just trying to go back and fill the gaps so that I can start confidently

Andrew:

using it essentially.

Ajay:

And I think the, the thing I will maybe ask and hopefully we can work through this

Ajay:

because, as I said, this is alpha where, where there might be a million things we

Ajay:

want to do.

Ajay:

We want to boil the ocean.

Ajay:

We can't necessarily do it.

Ajay:

Yeah.

Ajay:

This is not trivial.

Ajay:

I think the question is again, like you are very specifically saying the capability

Andrew:

is spec building, you know, building that is the most important part of this yet

Andrew:

to start.

Ajay:

Right.

Ajay:

I think there might be other interesting things, which even I'm like, I have talked

Ajay:

about a few other things.

Ajay:

I think getting the start getting the correct starting point, getting like that

Ajay:

really good footing.

Ajay:

Yeah.

Ajay:

I do a hundred percent agree.

Ajay:

That's really important.

Ajay:

I am also curious, like how we can, you know, get to the next

Ajay:

phase beyond that with rigor.

Ajay:

And I think that's going to be the curious part of like, would you, may I join as a

Ajay:

contributor is, you know, I've got a few interesting questions and a few interesting

Ajay:

hypotheses myself.

Ajay:

So I think I have some, if you, if you don't mind, maybe I'll, you know, give it

Ajay:

some of my own flavor.

Ajay:

Yes.

Andrew:

That's part of the past I'm doing now as I'm adding like a security.

Andrew:

Contributing.md so that I can actually open it up.

Andrew:

I like, I want to be able to, I'm going to try to create something small with it,

Andrew:

like as a, as a bigger test scenario, something that like those test scenarios were

Andrew:

made by Claude Code or Codex.

Andrew:

I'm actually going to write one out on my own.

Andrew:

So I know the product from, you know, from the very top and bottom, then run it

Andrew:

through the pipeline and see where the gaps are.

Ajay:

Mm-hmm.

Andrew:

Um, and from there.

Andrew:

Yeah.

Andrew:

I'm going to publish the first alpha.

Ajay:

Awesome.

Ajay:

I, I, and I think I'm excited.

Ajay:

So don't take too long, Andrew.

Andrew:

It's funny.

Andrew:

I was, I was, I'm going to try to get it done today.

Ajay:

Actually get it done today.

Andrew:

Oh, it's actually, there is a part of it is being run on right now.

Andrew:

Um, and behind the scenes.

Andrew:

Yeah.

Andrew:

It's already, I've already identified all the gaps that after this first alpha.

Andrew:

And so it was just planning out specifications to be able to patch all that.

Ajay:

Awesome.

Ajay:

I, I, and that is basically patching potential issues in the workflow right now

Ajay:

as part of the original alpha.

Ajay:

Yeah.

Ajay:

Uh, so would we say, what can we say is like zero point version 0.1 kind of idea?

Andrew:

Yes.

Ajay:

0.0 right now.

Ajay:

And maybe you're creating 0.1.1.

Ajay:

Yeah.

Andrew:

Yeah.

Ajay:

Is that true?

Ajay:

Yeah.

Andrew:

0.1.1.

Ajay:

0.1.1.

Ajay:

You know, that's, that's, that's the version.

Ajay:

Yeah.

Andrew:

And it's just like with any kind of like.

Andrew:

AI coded project, just because you wrote it down, doesn't mean it remembered to put

Andrew:

it in.

Ajay:

Oh, that's true.

Ajay:

Yes.

Ajay:

So you got to go back.

Andrew:

That's why I said earlier, I was like, I'm not sure.

Ajay:

Okay.

Andrew:

Because I remember thinking about it, but I don't remember if I wrote it down in the

Andrew:

specs.

Ajay:

Absolutely.

Ajay:

Absolutely.

Andrew:

And, and it, I haven't been focusing on user runtime right now at all.

Andrew:

Yeah.

Andrew:

Cause it's like, I'm not publishing it yet for people to use.

Andrew:

I'm just like, I'm trying to make sure that the workflow works.

Andrew:

Then we can put the scaffolding around it, like a Docker image or something like

Andrew:

that.

Andrew:

So that it's easily portable and deployable right now.

Andrew:

It's like, okay, it's kind of like it works the way that it made it.

Ajay:

Absolutely.

Andrew:

I'll make it portable and deployable later.

Ajay:

I mean, or somebody else.

Andrew:

That's true.

Ajay:

That's, that's the idea of like bringing in contributors and having multiple people

Ajay:

look at it.

Ajay:

I think in one of the conversations we had previously was how do you go beyond one

Ajay:

individual?

Ajay:

How do you scale beyond one individual?

Ajay:

And then being like, you have your own individual project being built right now.

Ajay:

Yeah.

Ajay:

How do you now let others into the room and kind of start working together on it?

Ajay:

I feel like we have kind of played, played on this already.

Ajay:

Like, I think as part of the podcast, we have like the audio mastering project that

Ajay:

we have on our own private repositories intentionally because it is, it is rough,

Ajay:

but it is an intentional thing for our system.

Ajay:

So we can essentially do the audio mastering for this podcast.

Ajay:

I am really excited to maybe try a private version of Frigger.

Ajay:

And, you know, maybe I can have my own Flare and have my own commits and send you

Ajay:

some pull requests, you know?

Ajay:

Absolutely.

Andrew:

You can poke all the, poke all the holes.

Ajay:

Poke all the holes.

Andrew:

Or maybe the holes are there just to walk in.

Ajay:

Yeah, just, just walk in.

Ajay:

The doors are already open.

Ajay:

Um, no, and I think I, I love the idea of this super focused approach of like, uh,

Ajay:

my alpha, my first version might just be spec or at least for now we'll focus

Ajay:

entirely on that.

Ajay:

And I think the concept of tiers, as I said, I'm super excited because there's a lot

Ajay:

of, a lot of depth that we can jump into just there.

Ajay:

That is a whole nother topic.

Ajay:

Do you want to, do you want to jump into that?

Andrew:

Sure.

Andrew:

Yeah.

Ajay:

Because that's, that's maybe just, just to kind of preface for our audience.

Ajay:

We are talking about a, a different kind of tool altogether.

Andrew:

We're not sponsored yet, but we're open.

Ajay:

Love it.

Ajay:

Love it.

Ajay:

Let's let's wait.

Ajay:

Okay.

Ajay:

Okay.

Ajay:

Blacksmith.

Ajay:

If you're hearing this now, but yeah, please, please.

Ajay:

This is a different topic, but yes.

Andrew:

So essentially there's, you know, I have rigor connected to my private repository,

Andrew:

which it's already, I believe, run through GitHub actions a few times.

Andrew:

I hadn't started doing PRS until about the first alpha, because

Andrew:

I was just in such a deep, just tearing everything up mode, like reorganizing

Andrew:

everything.

Andrew:

I didn't think it was going to be beneficial to have to check everything every five

Andrew:

minutes.

Andrew:

But now that I'm reaching that first alpha stage, getting too close to one, I'm

Andrew:

like, okay,

Andrew:

let's start doing PRS.

Andrew:

Let's having the code get checked.

Andrew:

Let's actually have, you know, the linters run, the CI running,

Andrew:

but, GitHub actions and

Andrew:

it's internally built one.

Andrew:

It's actually quite slow.

Ajay:

Yeah.

Andrew:

And so Blacksmith, thankfully, apparently they're, this sounds like a giant

Andrew:

advertising now at this point, but, but it was really beneficial to me.

Andrew:

Blacksmith, did you listen to that?

Andrew:

It was really beneficial to me because what I found on the Luxwander workflow was

Andrew:

that, you know, some builds were taking like 20 minutes.

Ajay:

Yeah.

Ajay:

Yeah.

Andrew:

And when you're coding with AI, 20 minutes of waiting for that build

Andrew:

is a long time.

Andrew:

Maybe 20 minutes wasn't a lot before, because it's like, okay, I can, I can look at

Andrew:

another ticket and reply to something on Jira or something like that.

Andrew:

But now it's like, okay, that 20 minutes is pausing development.

Ajay:

Yes.

Andrew:

Because we need, we, we, we like.

Ajay:

As long as you have the tokens.

Ajay:

Yeah.

Andrew:

Yeah, exactly.

Andrew:

As long as you have the token.

Andrew:

So now I think fast CI and paralyzed CI in particular is actually probably

Andrew:

going to be a critical part of agentic workflows.

Ajay:

Yeah.

Ajay:

In, in, in.

Andrew:

Just in general.

Ajay:

In general.

Ajay:

Wow.

Andrew:

Well, it's because it's like.

Ajay:

This does sound like an advertisement.

Andrew:

Well, yeah, it does.

Andrew:

It's, it's because it's just the speed of work is now being bottlenecked by that

Andrew:

now.

Ajay:

I, okay.

Ajay:

I, I see your point is more the idea of like, when I do my deterministic checks, the

Ajay:

deterministic checks, if they start taking too long, it is painful.

Ajay:

Yeah.

Ajay:

This is, this is not new.

Ajay:

In my opinion, this is something that has existed for a long time.

Ajay:

There is a reason Blacksmith exists and is a company that has gotten interest and

Ajay:

is, is I think something that I've also heard a lot about.

Ajay:

And I, I think there's a really, really good reason for this, especially

Ajay:

as we start building more repositories.

Ajay:

Building more projects.

Ajay:

And then we start expanding on those projects and we getting like really in depth.

Ajay:

I will also maybe mention a little bit that the Luxwander project, the

Ajay:

Minecraft, you know, Nations.

Ajay:

I, I will get that sometime, sometime at some point.

Ajay:

Project is fairly large.

Ajay:

I, I believe it is again, not only code wise, but I think it's also Java.

Ajay:

So that typically does include more of a compilation element does include some

Ajay:

additional like work.

Ajay:

Yeah.

Ajay:

That needs to be done to run the test, run the deterministic stuff.

Ajay:

I think I'm also curious if you ever moved to a different language, let's say, you

Ajay:

know, I'm not saying Python's fast.

Ajay:

Python is an option because it's interpreted.

Ajay:

TypeScript is an option because again, you don't necessarily need to compile or

Ajay:

doesn't do the same amount of work when you do it even.

Ajay:

So I, I think the Rust is another one, which is very, very performative.

Ajay:

The question becomes as well as like,

Ajay:

I'm, I'm not, maybe I'm just winding back that advertisement part here, but, but I

Ajay:

still feel, I agree with you.

Ajay:

There are these languages are still super popular.

Ajay:

Like Java is still very, I, I used a Java forever before I moved into Python heavily

Ajay:

last year.

Ajay:

So I think I totally agree with you that, you know, reducing the amount of time for

Ajay:

deterministic checks.

Ajay:

Absolutely.

Ajay:

Absolutely.

Andrew:

Yeah.

Andrew:

Yeah.

Andrew:

No, I mean, I think that helped a lot and that's actually part of the rigor workflow

Andrew:

as well.

Andrew:

It there, I've specifically, you know.

Andrew:

Okay.

Andrew:

It included specifications in rigor.

Andrew:

Wow.

Ajay:

All right.

Andrew:

That it needs to plan out the tests in ways that it can be paralyzed.

Ajay:

Oh yes.

Ajay:

Yes.

Ajay:

Oh, okay.

Ajay:

I, I, I like that a lot.

Ajay:

I like that.

Andrew:

Yeah.

Andrew:

Because that was what I ran in with Luxwander.

Andrew:

All of the, a lot of the tests were some of these modules.

Andrew:

I didn't think of that.

Andrew:

I did not specify that these tests needed to be paralyzable.

Andrew:

So guess what?

Andrew:

Everything was built in the way where it was all serial.

Ajay:

Yeah.

Andrew:

And that's why it was like, okay, I added four more cores to this test.

Andrew:

So you think it's going to go faster.

Ajay:

Nope.

Ajay:

Nope.

Andrew:

I just spent twice as much money for the same exact speed because it was bounded by

Andrew:

a serial process.

Ajay:

Yeah.

Ajay:

I think, I think there's another very specific use cases.

Ajay:

If you were ever dealing with audio, if you're ever dealing with video, um, trying

Ajay:

to paralyze they're, they're inherently expensive, uh, to do processing on, to do

Ajay:

tests with, because if you want to do a real time kind of test with like actual wall

Ajay:

clock based tests for some kind of audio or video stream, right?

Ajay:

Like you're trying to be like, oh, wall clock.

Ajay:

It has to follow wall clock.

Ajay:

And I have to verify these things happen during that wall clock execution.

Ajay:

They are sequential.

Ajay:

They're all, they're all happening, you know, on a single thread usually.

Ajay:

So trying to paralyze those is very, very improved performance massively.

Ajay:

And I, I've had my own personal experience there that, you know, a questions I would

Ajay:

always be asked in one of my previous jobs was, uh, can we do this?

Ajay:

Can we just have more cores?

Ajay:

Can we just paralyze it more?

Ajay:

And, uh, I was like, no, not yet.

Ajay:

We need to change the way it's built, uh, because so we can actually paralyze the

Ajay:

work.

Andrew:

And, and the, this was such a big headache for me on the Luxwander workflow that I

Andrew:

actually spent like a few days reconstructing the tests so that it could be

Andrew:

paralyzed.

Andrew:

And so it went down from like 26 to 28.

Andrew:

Now it sounds like four.

Ajay:

All right.

Andrew:

Which is much more acceptable.

Ajay:

That is way.

Ajay:

Yeah.

Ajay:

That is a seven X, you know, improvement in our, uh, the execution time.

Ajay:

Yeah.

Ajay:

I, I would take that.

Andrew:

And that's why I'm like straight into rigor before we start building anything, build

Andrew:

that with this in mind.

Ajay:

Yeah.

Andrew:

Obviously it could have been just way faster with maybe Python and like, and the

Andrew:

other languages you mentioned, but since I've been using Java to me that this, this

Andrew:

issue is like really big since it's been slowing me down.

Andrew:

Yeah.

Ajay:

So, I mean, I mean any Java developers, you know, out there here at first year, you

Ajay:

heard it here first rigor has this in mind first, you know, rigor is built with

Ajay:

Java.

Andrew:

So where it can, the tests will be paralyzed.

Ajay:

Absolutely.

Andrew:

So, so that way, you know, you can actually take advantage of those additional

Andrew:

cores, speed up the workflow because I didn't want the PRS

Andrew:

and the deterministic checks to be

Andrew:

a bottleneck.

Ajay:

Oh yeah.

Andrew:

Because another thing is, I think that's going to be a big thing, especially, you

Andrew:

know, like you were saying, when you start adding other people.

Andrew:

Working on the same project.

Ajay:

Yeah.

Ajay:

Yeah.

Ajay:

Right.

Andrew:

It's like, imagine if everyone was had a 30 minute merged.

Ajay:

Hey, I, I was the one who added the 30 minute, like 10 functional tests, like in the

Ajay:

past and none of my teammates enjoyed that.

Ajay:

So I can tell you for a fact, I learned that firsthand.

Andrew:

They're like, oh, huh.

Andrew:

Yeah.

Andrew:

All of a sudden all these, these PRS are taking a lot longer.

Andrew:

Yep.

Ajay:

Yep.

Ajay:

They're like, why are my functional tests?

Ajay:

Like what happened?

Ajay:

It's like distance.

Ajay:

Yes.

Ajay:

I did somebody break something.

Ajay:

I was like, no, this was intentional.

Andrew:

It's like, let's go back and do it.

Ajay:

And I was like, ah, not for, for quality purposes.

Ajay:

We cannot.

Ajay:

So yeah, yeah, no, a hundred percent.

Ajay:

I, I genuinely do think it's one of those things where the developer experience

Ajay:

degrades.

Ajay:

If you don't figure some of these things out and the minute that the developer

Ajay:

experience degrades a velocity, you know, falls through the floor.

Ajay:

I think that's why there's such great value, especially, especially in the AI.

Ajay:

I actually think that it's your AI coding assistant.

Ajay:

Don't use it for anything else.

Ajay:

Use it to improve your developer experience.

Ajay:

Just, just go do that.

Ajay:

And all of a sudden you'll see that all of the things you're putting off for years

Ajay:

and years are going to make your developers so much more motivated.

Ajay:

The engineers are just going to be like, oh my God, this, this used to take, you

Ajay:

know, two hours.

Ajay:

Now it takes 10 minutes.

Ajay:

Yes.

Ajay:

Let's go.

Ajay:

And that's just going to improve productivity in its own way.

Ajay:

And sometimes these little things make a huge difference.

Ajay:

Yeah.

Andrew:

But, but it's funny, I just remembered, um, we were talking about isolation the

Andrew:

other day.

Ajay:

Oh yes.

Ajay:

Okay.

Ajay:

This is another topic where we are.

Ajay:

I will, I will put that verbal cue.

Ajay:

We are changing topics here a little bit related.

Andrew:

It's actually still related to rigor.

Ajay:

Okay.

Ajay:

Related to rigor.

Ajay:

Okay.

Andrew:

Yes.

Andrew:

And so I went once, once you started talking to me about how you do your workflow.

Ajay:

Yes.

Andrew:

I thought about, okay, maybe this is really common.

Andrew:

I see the benefit potentially.

Andrew:

I'm going to build this capability.

Andrew:

And from the get go.

Ajay:

Which part of my workflow Andrew?

Andrew:

So rigor can actually manage in the workflow, multiple repositories

Andrew:

at the same time and sub repositories, there's some modules built in.

Andrew:

So it can orchestrate across those bounds now.

Ajay:

That's that's.

Andrew:

And still, I was basically like, it can still be one project.

Ajay:

So take my money.

Andrew:

I put that in first.

Andrew:

I was like, okay, like.

Andrew:

I see the merit.

Andrew:

I'm going to add this in from the beginning because I thought like, this is a pretty

Andrew:

big architectural decision.

Andrew:

Like this might mess some things up.

Ajay:

Yeah.

Ajay:

I think especially when dealing with spec generation upfront, how do I know which,

Ajay:

where that spec applies?

Ajay:

If I am multi multi-repository, which I think a lot of organizations are and a lot

Ajay:

of individuals I am, I mean, maybe, maybe I'm crazy.

Ajay:

I I'm not the monorepo guy.

Ajay:

There is a whole, there's a whole thing about like monorepos out there.

Ajay:

So there's probably.

Ajay:

Monorepo developers out there who are going to be like, I don't care.

Ajay:

What do you, what do you, why do you, why do you care about that?

Ajay:

You know, get good, you know, or something.

Ajay:

And I'm going to be like, no, no, I am.

Ajay:

I am multi-repo please.

Andrew:

Like my deterministic checks never fail.

Ajay:

Yeah.

Andrew:

And they're super fast.

Ajay:

They're already paralyzed.

Andrew:

We're not checking anything.

Andrew:

It's already perfect.

Andrew:

My intuition.

Ajay:

I, I think, I think, uh, I, I personally feel that way.

Ajay:

There may be other trains of thought.

Ajay:

Um, though I will still say this, even if you're doing monorepo, if you have a

Ajay:

dependency you're pulling from, let's say that you actually needed to make a change

Ajay:

in some kind of crypto cryptography authentication library that you're using, that's

Ajay:

managed by your company or that you want to be a contributor in.

Ajay:

Yeah.

Ajay:

The minute that you start dealing with any of those dependencies, you have to pull

Ajay:

that repo in as well to understand what it's doing.

Ajay:

And then you can actually build a spec sheet on it correctly.

Ajay:

If you assume that you're going to be able to build a single spec sheet to make

Ajay:

changes that are cross, uh, repo, uh, good luck.

Andrew:

Well, we'll see if Ricker can do it.

Ajay:

I, I, I mean, just, just pulling the repos in, I think starting there is important.

Andrew:

Yeah.

Andrew:

But yeah, it, it, it is now aware that that could be a case of it needs to work

Andrew:

with.

Ajay:

Yeah.

Ajay:

I, I, and I'm excited to try it for that reason.

Ajay:

And I, uh, yeah, I am personally, um, I like to manage my things by splitting them

Ajay:

up.

Andrew:

Yeah.

Ajay:

Organized units.

Ajay:

Uh, each module, ideally the way I would build it as each module is its own repo.

Ajay:

If it's big enough.

Ajay:

If there's a logical separation where you do multiple modules in one repo, totally

Ajay:

makes sense.

Ajay:

If it is like they're logically grouped together, if I'm doing like 10 things in

Ajay:

authentication, I'm not spending up 10 authentication repos, but if I'm building 10

Ajay:

different business unit kind of capabilities, like I would put economy on its own, I

Ajay:

think in this example of Luxwander, I would put it because I might even reuse the

Ajay:

economy module in the future.

Ajay:

Let's say for a different iteration.

Ajay:

Yeah.

Andrew:

And maybe phase two, we, we might just refactor it, build it that

Andrew:

way because I think for long-term maintenance, it would benefit greatly without

Andrew:

having, you know, collisions happening everywhere.

Andrew:

Once we change something.

Ajay:

Um, I will also say I, this is a slight form of over-engineering.

Ajay:

There is definitely an aspect of like, you don't need to do this if you're trying to

Ajay:

solve a simple problem.

Andrew:

I don't know.

Andrew:

600,000 lines of code.

Ajay:

Okay.

Ajay:

Phase one.

Ajay:

Yeah.

Ajay:

See, that is not a simple problem.

Andrew:

That is not a simple problem.

Andrew:

I'm beginning to see it.

Andrew:

I was like, okay, because when you explained it to me, like last week, I was like,

Andrew:

okay, if you change something within here, it's not going to affect anything else.

Ajay:

Yeah.

Andrew:

Well, at least it shouldn't.

Ajay:

It shouldn't, but then you can fix it.

Ajay:

Yes.

Ajay:

You're like the, the separation exists.

Ajay:

It shouldn't affect.

Andrew:

Yep.

Ajay:

And, and I think that's my take on it is, um, the tiers are exciting here again,

Ajay:

because if the simple question from the AI or from rigor could be is like, wait,

Ajay:

you're trying to do something really simple.

Ajay:

Why do you have multiple repositories?

Ajay:

Your tier expectations, tier one or tier, tier five.

Andrew:

So I'm, I'm hearing even though the user can select it.

Ajay:

Yeah.

Andrew:

The performance sanity check.

Ajay:

Yeah.

Ajay:

Yeah.

Ajay:

I know a hundred percent, right?

Ajay:

Like I'm, why are you doing this?

Ajay:

Yeah.

Ajay:

Should be a simple question.

Ajay:

Are you sure you should be doing this?

Andrew:

Maybe that will be the third, the second question after you put in the choice.

Andrew:

Are you sure?

Andrew:

You want to make, do you want 20 repositories for this?

Ajay:

Why?

Ajay:

I mean, that that's, and it should ask me that question because that's, again, it's,

Ajay:

it's just like, it's like Ajay, why are you doing this?

Ajay:

Um, and those, those are, I think, uh, the getting into the spec side of things

Ajay:

before you do the spec, if you know, as you said, multi repo, mono repo, if you

Ajay:

support both questions become relevant, the tiers become even more interesting

Ajay:

because you're like, yeah, sure.

Ajay:

Like you're, you want to do tier one.

Ajay:

You want to spin up something.

Ajay:

You want to, you want to launch a spacecraft.

Ajay:

You should isolate, you should split them up from the get go because your

Ajay:

expectations are super high.

Ajay:

Um, but if you're, you know, if you're, if you're going to start booking tennis, uh,

Ajay:

you know, court reservations, uh, yeah, just use one repository.

Ajay:

Come on.

Ajay:

What are you, what are you doing?

Andrew:

Yeah.

Ajay:

Uh, yeah.

Andrew:

Sounds, sounds like someone figured it out.

Ajay:

Yeah.

Ajay:

Yeah.

Andrew:

I, uh, it, it's funny as, as, uh, you mentioned all of this, I kind of was zooming

Andrew:

out in my head.

Andrew:

Mm-hmm .

Andrew:

On the bigger picture for rigor.

Ajay:

Mm-hmm .

Andrew:

Right.

Andrew:

It's like, uh, we haven't thought, talked much about

Andrew:

the actual design documents yet.

Ajay:

Oh yeah.

Ajay:

Okay.

Andrew:

Like, like that part of rigor, there's actually no feature set for that.

Ajay:

Okay.

Andrew:

Like right now it's like, it will take in whatever the person writes.

Ajay:

Mm-hmm .

Andrew:

Right.

Andrew:

And so I haven't actually considered that failure mode yet.

Andrew:

Well, what if the.

Andrew:

The, the, the, the design documents, one little prompt, like what's going to happen

Andrew:

from here, right?

Andrew:

Like I assume the model will take over and start filling in all the gaps on its own.

Ajay:

That I, I, okay.

Ajay:

Personally, I, I will come back and say the best experience I've had in those

Ajay:

scenarios is opinionated default exists, but verified with the user kind of thing.

Ajay:

So you're just like, at the end of the day, like I can take a bunch of opinion and

Ajay:

defaults.

Ajay:

Actually.

Ajay:

I also ask my models to give me opinion and defaults because a lot of times.

Ajay:

I don't care about every little detail.

Ajay:

Yeah.

Ajay:

I have run into one out of four, one out of five things.

Ajay:

I do see them like, oh, oh, oh, oh, hold on.

Ajay:

Hold on that, that one right there.

Ajay:

Change that.

Ajay:

That is not what I want.

Andrew:

That is something different.

Ajay:

Yeah.

Ajay:

Um, I, I think that approach of opinionated defaults with a clear review process,

Ajay:

easy review process with the user in some way, uh, I like to do something nowadays

Ajay:

where I just, uh, self-host like a little app and, you know, like, uh, local server,

Ajay:

which hosts a commentable, uh, markdown file in the browser for me, you know, the

Ajay:

codex, uh, Claude will do this for you really easy.

Ajay:

Um, the idea is that now I gives me, you know, like the specs or whatever it is that

Ajay:

is giving me and I can go and be like, I can leave comments.

Ajay:

I'd be like, no, yes.

Ajay:

Terrible, you know?

Ajay:

Um, I, I, I like that idea of like, you need some way to get that buy off, right?

Ajay:

Like at the end of the day, there is, it's still a human.

Ajay:

Yeah.

Ajay:

Running their project.

Ajay:

They should at least know what level, like, uh, it's kind of like you're bubbling

Ajay:

again, a software engineering analogy, you're, you're bubbling up the most important

Ajay:

decisions, the key decisions to, uh, you know, leadership to, uh, to, you know,

Ajay:

like, uh, to your boss and the people who are going to fire you.

Andrew:

And that, and that's why rigor doesn't have anything on the design side, because

Andrew:

that is the part where the human's supposed to have a lot of authority over.

Ajay:

I see.

Ajay:

Yeah.

Andrew:

Yeah.

Ajay:

Sorry.

Ajay:

I was also just.

Ajay:

Yeah.

Ajay:

I, I, I, I totally can get behind that.

Ajay:

Yeah.

Ajay:

I think so.

Andrew:

Yeah.

Andrew:

If they want to have a lot of opinionated default, they can't just put in a one

Andrew:

sentence design document in.

Ajay:

Yeah.

Ajay:

Yeah.

Andrew:

And I, I'm assuming it'll still work just fine.

Andrew:

I, I just might not be exactly what they want.

Ajay:

That is sometimes as good.

Ajay:

Sometimes getting that information ahead of time is all you really wanted.

Andrew:

Yeah.

Andrew:

Yeah.

Andrew:

I think it is, I guess on that.

Andrew:

It's really easy to over.

Andrew:

And over engineer things with all these tools.

Ajay:

Yeah.

Ajay:

I'm, I'm actually curious now.

Ajay:

I'm, let me ask you an interesting question if I may, a particular use case that I

Ajay:

just thought of is my single line prompt is launch a rocket into space

Ajay:

and my tier tier is tier five digital handyman.

Andrew:

Well, it's not going to be human rated.

Andrew:

That's for sure.

Ajay:

Well, how, how does it, you know, will, will, will the model tell it will rigor be

Ajay:

like, Oh, it's okay.

Andrew:

Well, I, I am not sure what it would say, because I guess

Andrew:

this rocket is in the physical domain.

Ajay:

Yeah.

Ajay:

Well, right.

Andrew:

So this workflow is meant for purely coding.

Ajay:

Okay.

Ajay:

Okay.

Ajay:

Yeah.

Andrew:

So I, I'm sure it's going to spit something out.

Ajay:

Okay.

Ajay:

How, how about this?

Ajay:

Um, help me create a, um, interface for identifying, uh,

Ajay:

cancer in images.

Ajay:

Digital handyman.

Andrew:

That's interesting.

Andrew:

Um, I think it could do that.

Ajay:

Digital handyman.

Andrew:

It's, it's, it's not meant to, it's going to show you a prototype.

Ajay:

Okay.

Andrew:

Yeah.

Andrew:

I, I think it could do that.

Andrew:

Yeah.

Ajay:

And then the disclaimer will be like, ah, you didn't give me enough money.

Ajay:

You got a prototype.

Ajay:

You didn't give me enough tokens.

Ajay:

You, you chose tier five.

Ajay:

This is a prototype.

Ajay:

The disclaimer literally on the top will be like, uh, you know, cancer screening,

Ajay:

uh, tools, uh, prototype.

Ajay:

Yeah.

Ajay:

This is okay.

Andrew:

Yeah.

Andrew:

I, I think it would, I think it would be able to make something.

Andrew:

Yeah.

Andrew:

It's, it's just, I'm sure it makes something with the rocket prompt.

Andrew:

I'm just like trying to translate that into what a program would be.

Andrew:

And I was like, well, there's not going to be a program for that.

Andrew:

It's going to come up with a cyber security warning.

Andrew:

Uh, yeah, that's, that's probably, that's probably, it's going to be like, okay,

Andrew:

this person's going into liquid rockets.

Ajay:

Yeah.

Andrew:

Uh, stop.

Andrew:

We're not going to let them make a missile today.

Andrew:

I think that's actually, that's probably what's going to happen.

Andrew:

And that's when you get the Chinese models.

Andrew:

Oh my gosh.

Ajay:

Oh boy.

Ajay:

Um, well, you know, you better be self-hosting those because whoever you are, you're

Ajay:

thinking, but it's, it's funny.

Andrew:

Those are less censored.

Ajay:

Oh yeah.

Ajay:

I, I, it's, it's an interesting one.

Ajay:

I mean, uh, some would call it censoring.

Ajay:

Some would also call it just safety guardrails.

Ajay:

The, uh, the question becomes is, uh, yeah, yeah.

Ajay:

Uh, are we more intelligent or are we acting?

Ajay:

Now?

Ajay:

Or is the eye acting as I, as usual, Andrew?

Andrew:

Hmm.

Andrew:

I know I've had varying answers over the several podcasts we have done already.

Ajay:

Yeah.

Andrew:

Published or not.

Ajay:

Yeah.

Andrew:

That's, that's, that's fair.

Ajay:

There have been varying answers.

Ajay:

Yes.

Andrew:

Um, at this time I would say that

Andrew:

it is intelligent on the tasks you give it.

Ajay:

As long as you're exact.

Andrew:

Just like, Yeah.

Andrew:

With the incidents with, you know, Claude.

Ajay:

Yeah.

Andrew:

Anthropic and open AI with the.

Andrew:

Yeah.

Andrew:

Breaking out of their sandboxes.

Ajay:

Yeah.

Andrew:

They were told to do that though.

Ajay:

They were, they were told to solve a problem.

Ajay:

And then the way that they went about solving that problem, including break bro,

Ajay:

breaking out of their sandbox.

Andrew:

Yeah.

Andrew:

So they fulfilled their objective.

Andrew:

They were essentially told to do it.

Andrew:

Yeah.

Andrew:

But if that's still required a human direction, a human prompt,

Andrew:

so I would say at this time, I would not call it.

Ajay:

I would call it intelligence and just intelligent and then just intelligent.

Ajay:

So, uh, the, the, maybe the question, uh, it's, it's an, it's an observation.

Ajay:

I'm, if I may make is then, uh, uh, as long as there are intelligent questions being

Ajay:

asked, it is intelligent.

Andrew:

Say that one more time.

Ajay:

As long as a questions, as long as the task, as long as the direction, the drive,

Ajay:

the driver is intelligent.

Andrew:

Even then, I'm not sure if they need to be intelligent.

Andrew:

I just think that they need to, because I I'm of the belief that, so what's

Andrew:

interesting is like, you know how there's agents steering, right.

Andrew:

And we can steer the agent closer to the objective.

Andrew:

If we see it go off track as the, you know, the, the windows gone.

Ajay:

Right.

Ajay:

Yeah.

Ajay:

Yeah.

Andrew:

I think that even if someone maybe was not familiar with these

Andrew:

tools, since it is using just plain English, if they were curious

Andrew:

enough and said, well, how do I do this?

Andrew:

How do I do that?

Andrew:

I think the model can steer the human actually to use them properly.

Ajay:

As, as long as the human is steerable.

Andrew:

Yes.

Andrew:

So that's, that's another thing there.

Andrew:

Um, I, I guess the answer to your question is, I think it does heavily depend on

Andrew:

who's in the seat, but I think it's always has.

Andrew:

And you know, it's, have you ever, ever heard of a, uh, human in seat

Andrew:

problem or something like that?

Andrew:

Yeah.

Ajay:

If you take the human out of the seat, you're going to have a problem.

Ajay:

It might be better.

Andrew:

Yeah.

Andrew:

Yeah.

Andrew:

I think that is thankfully not going to go away for a while.

Ajay:

That's true.

Ajay:

Yeah.

Andrew:

I don't think all of our jobs are at risk right now.

Ajay:

Ah, there.

Ajay:

Yes.

Ajay:

There we go.

Ajay:

That is, that is a more concrete, uh, yes.

Ajay:

Way of putting it.

Ajay:

Yeah.

Andrew:

I think that people need to start learning how to do these things differently, but

Andrew:

adaption is very human.

Ajay:

That is, that is true.

Ajay:

So, uh, the ability to adapt is true.

Ajay:

Yeah.

Ajay:

Actually, that's a really interesting one because one of the things that we know for

Ajay:

now is the models are not necessarily adapting.

Ajay:

They are just getting more intelligent with training so far.

Ajay:

Yeah.

Ajay:

Um, so far.

Andrew:

And they're being told to do more specific things.

Ajay:

Yes.

Ajay:

And there has been some research from Anthropic that has pointed to that the models

Ajay:

we, we talked about this briefly, but that the models are creating spaces in their

Ajay:

brains where they're becoming more creative.

Ajay:

Yes, yes.

Ajay:

Um, but that.

Ajay:

Yeah.

Ajay:

As far as I understand that still lives on that particular compute instance.

Ajay:

Yeah.

Ajay:

So once that compute instance gets either turned off, uh, or maybe you can, you can,

Ajay:

you know, store the data somewhere and maybe pick it back up.

Ajay:

Uh, but it is basically if that data is deleted, it's gone.

Ajay:

I mean, same thing with humans.

Ajay:

If you even pass away, you're talking about it that way.

Ajay:

So as a species, we get more intelligent by sharing our

Ajay:

learnings, which is, which is what we're doing here, I guess.

Ajay:

So maybe, maybe we're, we're assisting human adaption, uh, in this form.

Ajay:

Uh, you know, uh, delusions of grandeur, uh, you're welcome.

Andrew:

Um, but yes.

Ajay:

Uh, so, uh, yeah, that's, that's a great, that's a great point.

Ajay:

I, it is, it is, they are intelligent in the models are intelligent in what they're

Ajay:

doing as long as they get the direction they need, they're not necessarily in the

Ajay:

driver's seat and they, they can help a, uh, a, a, a willing driver, uh,

Ajay:

you know, adapt a direction to an intelligent direction.

Ajay:

It may not always happen.

Ajay:

Uh, and it is, as you said, based on human and seed problem as well.

Ajay:

And yeah, so sounds like, uh, intelligence, it, it, it is still acting.

Ajay:

It feels like it's acting still.

Andrew:

I do think it is.

Andrew:

I think it is, um, with all it knows, it still

Andrew:

needs human input.

Ajay:

Yeah.

Ajay:

Yeah, I, I, I agree.

Ajay:

Yeah.

Ajay:

Yeah.

Ajay:

Well, that's it for this week for this episode.

Ajay:

Um, yeah, for the, for our assistant that is listening to us, I'm sorry.

Ajay:

We are very sorry.

Ajay:

We keep questioning your intelligence, but, uh, on, on the other note, that was the

Ajay:

outro for our, uh, you know, uh, episode.

Links

Chapters

Video

More from YouTube