What does it take to stop babysitting your coding agents? Ajay and Andrew open with how big-tech office politics quietly manage people out, then get into the real news: Luxwander finally has a true progress number (95%), and the workflow that made it measurable has been split out into Rigr — a spec-first system with assurance tiers that let you dial expected quality from NASA-grade down to digital handyman. Along the way: a Minecraft server with a physical gold economy, why front-loading specifications kills a hundred rounds of code review, parallel CI as the new agentic bottleneck, the multi-repo versus monorepo argument, and a closing debate on whether today's models are intelligent or just acting.
In this episode:
How people get managed out, and what an IC can move without authority
Luxwander at 95 percent, and what a real progress bar took
Minecraft Nations: guilds, territory, and a physical in-game gold economy
Assurance tiers: matching AI effort and cost to the stakes of the job
Rigr: specs, slices, and contracts before a line of code is written
Parallel CI, multi-repo orchestration, and the monorepo debate
Are we the intelligent ones, or is the AI acting?
Chapters:
(00:00:00) - Teaser: launch a rocket on tier five
(00:00:18) - Office politics and how people get managed out
(00:06:37) - What an IC can actually move without authority
(00:07:42) - Luxwander at 95%: finally a real progress number
(00:10:36) - From "just build it" to eighteen modules
(00:11:52) - Minecraft Nations: guilds, territory, a physical gold economy
(00:19:28) - Assurance tiers: NASA at one, digital handyman at five
(00:25:39) - Why Rigr got split out of Luxwander
(00:31:39) - Zooming out to an orchestration layer over the agents
(00:38:30) - Front-loading specs to kill a hundred rounds of review
(00:40:55) - Modules, slices, contracts, and isolation
(00:51:16) - Parallel CI becomes the agentic bottleneck
(01:00:25) - Multi-repo orchestration and the monorepo argument
(01:06:23) - Opinionated defaults, and why design stays human
(01:08:43) - Tier thought experiments: rockets and cancer screening
(01:10:58) - Are we the intelligent ones?
Um, I guess I can just talk about real quick about this YouTube video I've been
Andrew:watching.
Andrew:Okay.
Andrew:It's interesting.
Andrew:It's about office politics, particularly Amazon, which you're familiar with.
Andrew:There's this retired VP, and I'm only about two hours into the video.
Andrew:It's three hours.
Andrew:Oh, okay.
Andrew:And they're just talking about like how they manage people, fire people.
Andrew:Oh, yeah.
Andrew:Okay.
Andrew:You know, they, you know, they move people around to fire them.
Ajay:Um, it's, it's good to know.
Ajay:That's, that's, I mean, a VP individual, that's, I'm curious because that's a level
Ajay:where they probably see a lot more of it.
Andrew:Yeah, yeah.
Ajay:Just like, just like they probably have, a VP would probably be like four or five
Ajay:hundred people in an organization.
Ajay:And it's, if you assume like a five percent, you know, year over year of their VP
Ajay:for, let's say, four years, that's a hundred people at least.
Ajay:So that's, that's quite a few.
Andrew:Yeah, no, I, for me, what I was taking from it, I was like, wow.
Andrew:Wow.
Andrew:Like, these people are vicious.
Ajay:I mean, yeah, it's, it's, yeah.
Andrew:Like, the way he talks about some of the concepts, like explaining like how to, like
Andrew:how things work in the office or how do you get someone to do something, you know,
Andrew:and stuff like, like, kind of like really, really like pointed conversations, right?
Andrew:Like, it's just like, wow, like these are like, kind of like conversations that.
Ajay:Okay.
Andrew:Like, you would not want to have done.
Andrew:Like, in person at the workplace in front of other people.
Ajay:Yeah, in front of other people.
Ajay:Yeah, I was gonna, I was gonna say, that's very interesting.
Andrew:So he's retired.
Andrew:And I think that's another thing is that I, he wouldn't be talking about it this way
Andrew:if he wasn't retired, I think.
Ajay:Yeah, I mean, if you're, if you're gonna work, continue working with people, you
Ajay:probably don't want to be having these kind of like letting these things out of the
Ajay:bag kind of approach.
Ajay:I, it's very interesting.
Ajay:I had never have any, I had one experience from a non
Ajay:-engineering person.
Ajay:And it was very much a, hey, this needs to get done by this date.
Ajay:And I was like, yeah, that's the target.
Ajay:That's what we're gonna do.
Ajay:And they were like, okay, I have heard of other individuals who had more, um,
Ajay:strained experiences.
Andrew:Yeah.
Ajay:I don't think I've really experienced so many of them personally.
Ajay:I really will say it's an interesting thing is, uh, I don't know.
Ajay:Maybe, maybe it was just the fact that I was usually just saying yes to everything.
Ajay:That could just be what I was doing.
Andrew:Yeah.
Andrew:Yeah.
Andrew:I think it was, it was more so from like a management perspective since it was the
Andrew:ODP.
Andrew:Probably.
Ajay:Probably.
Andrew:Like there's a lot of politics to be done.
Ajay:Yeah.
Andrew:And I think just kind of revealing that side of it to me that I haven't really seen
Andrew:or heard of before.
Andrew:It was, it was just interesting to hear about.
Ajay:I feel like though it happens everywhere.
Ajay:Like some level of that.
Ajay:Uh.
Andrew:Oh yeah.
Ajay:Yeah.
Ajay:I feel like you get into the multiple hundreds of people.
Ajay:You get into thousands of individuals.
Ajay:At some point you kind of don't have a direct line to every individual in your
Ajay:organization and I wouldn't be surprised.
Ajay:I mean, I honestly have heard similar weird experiences outside of tech.
Ajay:Um, clearly I think if you're, especially on a manufacturing line, I think it would
Ajay:be very difficult to get that experience like of a personalized experience.
Andrew:Yeah.
Ajay:Um, with that, with that being said, I'm, I'm curious.
Ajay:So like, were there, were there.
Ajay:Were there mechanisms or something that they talked about?
Ajay:Was it just like every time things are just super harsh?
Ajay:Like what, what does, what would the learnings or what was their approach?
Andrew:So for example, like when, um, they wanted to like
Andrew:get someone to quit.
Andrew:Oh, right.
Andrew:They would just move this person to like a different org that people
Andrew:considered like other.
Ajay:Oh, interesting.
Andrew:Yeah.
Andrew:It's like, it's not an org that is like doing anything in particular.
Andrew:Yeah.
Andrew:Like for example, they weren't like working on like the Kindle or, or, or something
Andrew:like that or the fire stick or whatever.
Andrew:Right.
Andrew:They were working on like something that's not seen from the public.
Andrew:It's just other, they're like, okay, it's just something that has to be done, but
Andrew:it's not going to get used like visibility, visibility anywhere.
Andrew:So it's basically a dead end.
Ajay:So it's a, some deep internal service somewhere that, you know, probably other
Ajay:individuals who are, you know, internal users exist.
Ajay:Some subsystems that may be public facing exist, uh, though the actual system that
Ajay:you're working on might be three levels removed from any external customer.
Andrew:Yeah.
Andrew:Yeah.
Andrew:And I, and I was just like, oh yeah, so that's a, that's a way to, they were just
Andrew:saying like, okay, this is how we get rid of people like without firing them.
Ajay:I mean, it is a discouraging motive, right?
Ajay:Like, I mean, no, nobody in the tech industry who I think is came in with a lot of
Ajay:energy and a lot of motivation wants to work.
Ajay:Kind of in that position, um, there are individuals who feel very comfortable in, in
Ajay:their career, comfortable where they are, who may pick that up and just be, I have
Ajay:said this before on this podcast is like, uh, engineers, honestly, a lot of times
Ajay:are janitors.
Ajay:Those that embrace the janitorial duties actually make out very well if they are
Ajay:accepting that that is what they're going to be doing.
Ajay:You can earn a really good paycheck and not care about like, what is your day to
Ajay:day.
Ajay:Right.
Ajay:Right.
Ajay:Um, but that, that is a different place to be.
Ajay:So.
Ajay:So if you're coming into the industry and you're hoping to get like a really cool,
Ajay:you know, in a big organization, working on Kindle, working on other things like
Ajay:that, um, yeah, it can be really discouraging.
Ajay:And I think it can be really like, oh, I'm not getting the interesting work that I
Ajay:want, especially if you're a high performer and you're somebody who's used to being
Ajay:like, I'm going to build this stuff.
Ajay:I'm going to send it out.
Andrew:Yeah.
Ajay:Yeah.
Ajay:I can see that, that being away to push them out quietly.
Ajay:Yeah.
Andrew:Yeah.
Andrew:Yeah.
Andrew:And there was a lot of other things he spoke of.
Andrew:Um, but yeah, overall I was just, it was interesting to hear about like high level
Andrew:office politics and how there were some talk of some ways to,
Andrew:you know, get into that, like at an engineer level.
Ajay:Okay.
Andrew:Um, but, uh, I think we're just getting into that now, so yeah, about an
Andrew:hour left.
Andrew:Yeah.
Ajay:Oh yeah.
Ajay:I think so.
Ajay:That's, that's a curious one.
Ajay:Like from an IC perspective.
Ajay:Yeah.
Ajay:Okay.
Andrew:Yeah.
Ajay:So, um, this is a lot different than, I mean, if you're, if you're a people manager,
Ajay:you, you have, that is your role.
Ajay:That is your, you have leverage to do things that you have control.
Ajay:Uh, as an individual contributor, I really don't think you can force people to do
Ajay:things.
Ajay:Um, you can work with managers to get things done.
Andrew:Mm-hmm .
Ajay:Um, I think the one thing I have honestly seen be the most effective
Ajay:is how do you galvanize individuals?
Ajay:How do you excite them?
Ajay:You have to kind of figure out the right, um, common, you have to find common
Ajay:footing.
Ajay:Then you have to build on that common footing.
Andrew:Yeah.
Ajay:And then you gotta excite that this is the common footing that will help us build
Ajay:that awesome feature that will get a lot of excitement and really drive, you know,
Ajay:that feature, uh, and, and drive engagement.
Ajay:And I don't think I've met too many engineers who hate the idea of driving
Ajay:engagement.
Ajay:So I don't know how do you, how you feel though?
Ajay:I mean, Andrew, you, you, you're, you're aspiring, right?
Ajay:Like here in that same space.
Andrew:Yeah.
Ajay:If you could drive engagement, if you could build something that people would engage
Ajay:with and try and, you know, use, how would you feel about that?
Andrew:I mean, it would feel great.
Andrew:Yeah.
Andrew:I mean, I, I mean, that is what's motivating me right now with Luxwander.
Ajay:Yeah.
Ajay:Right?
Andrew:Yeah.
Andrew:Like I, for me, it's like, it's a little bit less of a theory since it's already
Andrew:been validated before.
Ajay:Mm-hmm .
Andrew:So there's kind of like that confidence that I know people are waiting for this
Andrew:product right now.
Andrew:Exactly.
Andrew:Like people are going to use this.
Ajay:Yeah.
Andrew:Um, you know, when it's released and, and on that, I'm actually almost done.
Andrew:I, this time I'm going to say almost done.
Andrew:Oh, okay.
Ajay:All right.
Andrew:So with, uh, Rigr, which is, you know.
Andrew:Yes.
Ajay:Yes.
Ajay:Yes.
Andrew:Yes.
Andrew:Um, it, I did, I ported some features back in the Luxwander,
Andrew:like upstream, but not all of it.
Andrew:Obviously it's a whole different system.
Andrew:So, but I took some crucial parts of it that were part of the building out the
Andrew:different systems.
Andrew:Mm-hmm .
Andrew:Um, and so from there I was able to finally get an actual percentage of what's built
Andrew:out.
Andrew:Oh.
Andrew:Yes.
Andrew:Because I actually have a detailed, you know, specifications of everything that's
Andrew:supposed to be in this slice.
Andrew:Like all the, the, the promises that were made.
Andrew:Right.
Andrew:And.
Ajay:Because Rigr gave you what the total spec should be.
Ajay:Yeah.
Ajay:At the end of the day.
Ajay:So at least it gave you a estimated map.
Ajay:Yeah.
Ajay:And now you can genuinely compare against it.
Andrew:Yes.
Andrew:Yeah.
Andrew:Before it was like, oh, well.
Andrew:We don't really know, but now it's like, okay.
Andrew:Like I, I don't necessarily know how long it is between certain things, but at least
Andrew:there's some sort of list now that says, okay, 40 out of 45 objectives.
Andrew:Yes.
Andrew:Have been, you know, it's, it's feature complete.
Ajay:Different items on the list may be weighted differently.
Ajay:Uh, but I'm expecting that just having the number on a piece of paper.
Andrew:Yeah, it's, it's better than just not knowing what's being made.
Ajay:Yes.
Andrew:So, so we're, we're about 95%.
Andrew:Through.
Ajay:I, I, uh, I, I love it.
Ajay:How much is, how much is the weight on the last five percent?
Andrew:Uh, if, uh, we trust Codex's, um,
Andrew:uh, analysis on that, it would say, I think it was like
Andrew:six to eight hours.
Ajay:Okay.
Ajay:Yeah.
Ajay:Six to eight hours is, uh, in Codex land.
Ajay:I mean.
Ajay:Yeah.
Ajay:That'll be like, what, two engineering months or something.
Ajay:Yeah.
Ajay:Um.
Ajay:Okay.
Ajay:Yeah.
Andrew:Yeah.
Andrew:So we'll see.
Andrew:Um, it's been thankfully, you know, thanks to all the resets that have been
Andrew:happening mid way and it's just been running ever since I, you know, set it on its
Andrew:task.
Andrew:So I was like, okay, I like, I check in and I see, okay, we're, we're actually
Andrew:getting somewhere.
Andrew:Um, and I'm really excited to actually use the rigor workflow more formally once
Andrew:it's done.
Andrew:Nice.
Ajay:Yes.
Andrew:Um, and I'm going to be trying to publish it soon, actually like the first alpha
Andrew:version of it.
Andrew:Yeah.
Ajay:I do, um, want to get into that a little more, but before we get into the rigor, um,
Ajay:piece, I do want to ask you, Andrew, I guess maybe the question becomes is maybe too
Ajay:laid out for our audience.
Ajay:Can you talk a little more about like, uh, the number of modules, what rigor gave
Ajay:you, what you were dealing with earlier and like how it helped you reconcile?
Ajay:Like what did, what were you expecting and what did you actually get and how did it
Ajay:help you?
Andrew:Right.
Andrew:So I guess if I start from the beginning, when I started just using Claude Code and I
Andrew:set out to build the project out, I knew from the beginning I needed different
Andrew:modules for different features for at least from an architecture perspective.
Andrew:But as we just built it out, I kind of just said, well, build it,
Andrew:right, right.
Andrew:Here's the modules.
Ajay:One shot, go.
Andrew:Build it.
Andrew:Right.
Andrew:Yeah.
Andrew:And so as you remember, I scrapped all of that.
Andrew:I quickly realized that that was a bad idea.
Andrew:This was way too complex for something like that.
Andrew:Um, it was a, you know, 30 page game design document.
Andrew:There was a lot in there, a lot of different modules.
Andrew:I think about 18 modules and I think, uh,
Andrew:not everything is like in the first phase.
Andrew:So phase one has like a certain amount of modules or a certain amount of features in
Andrew:these modules.
Ajay:And then if I may ask, so specifically we were looking at the game design documents,
Ajay:it was saying that there would be nations, there would be guilds.
Ajay:So it's kind of like a hierarchical, can you maybe talk a little more?
Andrew:Yeah.
Andrew:Yeah.
Ajay:Just a reminder of you.
Ajay:Yeah.
Andrew:So basically the game mode or the server or whatever, it would be called a Minecraft
Andrew:nations.
Andrew:It was actually based on the very first server I ever made.
Andrew:Um, and so groups of people will be able to join one of three nations and
Andrew:from one of those nations, they'll be able to create guilds and you capture land,
Andrew:defend territory towns.
Andrew:There's going to be like a real physical money trading, not like, not like Diablo,
Andrew:like, but in game, there's going to be like an actual gold economy, an in-game gold,
Andrew:in-game gold economy.
Andrew:Yeah.
Andrew:And, and that money will actually, um, it's all physicalized.
Andrew:So there's no like digital inventory, you know, you can't just open up your, uh,
Andrew:thing and see like a number for your like little, like hottest gold or something.
Andrew:Yeah.
Andrew:You actually have to have it in your inventory.
Andrew:We, we'll probably have a function to count what's in your inventory to kind of keep
Andrew:that in line with your inventory.
Andrew:So you're carrying gold with a modern take on it, but you still need the gold with
Andrew:you.
Ajay:So you're carrying gold.
Andrew:You're carrying gold.
Ajay:And you have to basically be able to account for that gold.
Ajay:And that was also one of the modules.
Ajay:Um, and I think that's maybe the thing is like, uh, we were talking about how the
Ajay:nations existed, the guilds existed, um, the economy was its own module there.
Ajay:And so there's all these, uh, features and capabilities that you're enabling.
Ajay:Yeah.
Ajay:Um, essentially when you had the game design documents, I read them more as
Ajay:narratives, kind of like a narrative of explaining what.
Ajay:Yeah.
Ajay:The nation, nation relationship would be what the guilds relationship would be.
Ajay:How guilds would be related to nations.
Ajay:Um, I think there was some graphs also, if I'm remembering right back then, which,
Ajay:so I, I akin to, I was, uh, uh, maybe relating those a lot more to design documents.
Ajay:Yep.
Ajay:I'm curious what, uh, rigor workflow has given you now.
Ajay:Is it similar?
Ajay:Is it different?
Ajay:If I may ask.
Andrew:So for its usage and Luxwander, it's not like a, I haven't actually
Andrew:used rigor for, uh, for Luxwander yet directly.
Andrew:Okay.
Andrew:I only took some of the concepts while I was, I was like, okay, I like this certain
Andrew:piece of rigor.
Andrew:And that piece was the very specific and detailed part where it was like,
Andrew:okay, here's the design documents now from this create a very specific
Andrew:and detailed version of her spec sheets slice by slice.
Ajay:Got it.
Ajay:Okay.
Andrew:So, so that way the, the work was both.
Andrew:Um.
Andrew:Yeah.
Andrew:More portable.
Ajay:Of course.
Ajay:Right.
Ajay:Yeah.
Andrew:Uh, because that didn't happen the first time.
Ajay:Yeah.
Andrew:So, and because it's portable, there is many checkpoints of where we can see how we
Andrew:completed.
Ajay:Go and verify this is work actually done.
Ajay:Can you check a few specific things like in the game open kind of maybe, maybe at
Ajay:some point we haven't done that yet, I believe, but that could be, could have, could
Ajay:be one of the checks you put in the future is like, as you build it, like, can the
Ajay:game be like run kind of thing at that point.
Ajay:Um.
Ajay:Um, I, I think I was gonna jump into one question there as well as like, uh, it, it
Ajay:is great to see that you're able to take slices and actually experiment with them
Ajay:individually.
Ajay:That's amazing.
Ajay:Um, I'm curious, like, uh, in this thing we just talked about, what did the spec
Ajay:sheet give you?
Ajay:Was it more like just a checklist or just specifically like what, what was, what
Ajay:were you looking at when it actually came out with a portable, um, spec?
Andrew:So there is a lot there.
Andrew:I would actually say before I say anything, we should just go take a look later.
Andrew:All right.
Ajay:Okay.
Ajay:Okay.
Andrew:I, I, I have meditated it so much and I haven't actually used the actual workflow.
Ajay:I see.
Ajay:Yeah.
Andrew:Except for in a dog fooding way.
Ajay:Okay.
Andrew:So it is now, it is now successfully building itself.
Ajay:All right.
Ajay:Yeah.
Andrew:So it's actually engaging the workflow, upgrading its own conflict files.
Ajay:Okay.
Ajay:Okay.
Andrew:And stuff like that.
Ajay:So it's, it's, it's kind of like you're saying that, Hey, Claude, go do the original
Ajay:spec.
Ajay:It gave you a bunch of stuff back then.
Ajay:Yeah.
Ajay:This time you're saying, Hey, go rigor, go do the same thing.
Ajay:And now I can actually compare.
Ajay:And as I go along at like, or don't like things, I'll actually go improve.
Ajay:So maybe, maybe I'm putting the, uh, uh, cart in front of the horse a little bit
Ajay:here.
Ajay:Maybe we'll, maybe I'll, I'll give you an opportunity to, you know, release and, uh,
Ajay:you know, and the alpha version and then we can talk about it more.
Andrew:Yeah.
Andrew:Yeah.
Andrew:Once it's like actually done, like I'll be inspecting, um, and
Andrew:critiquing those parts once I can actually see it for now.
Andrew:So now it's like, okay, I can see based on things that it's working.
Andrew:And there was actually, um, part of testing the first alpha for it.
Andrew:There was like 18 different scenarios that we painted out.
Andrew:Um, and we, Claude Code or Codex.
Andrew:Right.
Andrew:And basically created like a web store, um, that was able to, you know, save data,
Andrew:you know, you could render it in a browser.
Ajay:Right.
Ajay:Yes.
Andrew:And so there was like an acceptance criteria for each scenario.
Ajay:Yes.
Ajay:Yes.
Andrew:And then running all of those different scenarios through it, did it accomplish it
Andrew:or not?
Andrew:That was one of the first ways we were testing the workflow to see if it was
Andrew:actually working at all.
Andrew:Because, you know, obviously waiting for it to work for Luxwander is just a big
Andrew:task.
Ajay:Yeah.
Ajay:It's just a big project.
Andrew:So I was just kind of like, okay, how can we have smaller tests where I can at
Andrew:least, you know, get a result today.
Ajay:Oh yeah.
Andrew:And, and, and, and be able to visually see and like start up the web server.
Andrew:Manually inspect it.
Andrew:Say, okay, I see it's working.
Andrew:Like I see it built this out.
Andrew:I can see that it matched up to what we were looking for.
Andrew:Um.
Ajay:Exactly.
Ajay:Yeah.
Ajay:Absolutely.
Ajay:Uh, that is actually, um, exactly what I was, uh, you, you answered my question.
Ajay:So at this point that, that, that is precisely what I was, uh, curious about is
Ajay:like, yeah, you're seeing a specification set along with like a specific acceptance
Ajay:criteria kind of thing.
Ajay:Yeah.
Ajay:Um, software engineering land, you know, and, and.
Ajay:But actually I'm, I'm having, I'm, I'm having my hands right now because that's
Ajay:essentially, you know, it's very hand wavy.
Ajay:Everybody has their own way of representing that.
Ajay:Um.
Ajay:You know, I think I've seen a lot of cases where it's a simple as saying that, oh,
Ajay:this is a heading.
Ajay:This is a short description as to what we're achieving.
Ajay:And the acceptance criteria is when X user can do ABC and sounds very similar
Ajay:at the end of the day to that.
Ajay:Right.
Ajay:Yeah.
Andrew:Yeah.
Andrew:Yeah, so, and the reason why I haven't said, like, what level, because I haven't
Andrew:inspected the spec sheets directly yet.
Ajay:Yeah.
Andrew:Right, and so I don't want to say, like, well, I know how detailed they are,
Andrew:but I haven't done, like, a line-by-line check yet.
Ajay:Got it, and Claude is basically giving you an estimate based on the lines that it
Ajay:generated using Rigger and what has already been completed so far, and that's a 95%.
Andrew:So, for the 94 Luxwander, so that wasn't using the actual, like, Rigger workflow
Andrew:again.
Ajay:Oh, got it, okay, my bad.
Ajay:Well, I went down this whole rabbit hole, and we, okay, my apologies.
Andrew:Yeah, it is, I was talking about that for, like, those, like, scenario tests, test
Andrew:scenarios with, like, the web store front.
Ajay:Okay, okay.
Ajay:I do not know about that.
Ajay:That's an interesting one.
Ajay:Okay, but we have been also, like, I am curious, Dennis.
Ajay:It sounds like Rigger is being iterated on.
Ajay:Yes.
Ajay:It's getting better.
Andrew:I mean, we're, it's already at first alpha.
Andrew:Now we're doing, I'm doing polishing for first publish now.
Ajay:What can one expect with first alpha?
Ajay:Like, can you maybe point to three or three to five, like, feature capability
Ajay:slices?
Andrew:Yeah, yeah, yeah.
Andrew:So, first, it will be able to ingest some
Andrew:documents, design documents, right?
Andrew:From that, again.
Andrew:And you do, you, they're called assurance tiers now.
Ajay:Assurance tiers, yeah.
Andrew:And you'll be able to choose, you know, from one to five, right?
Andrew:And one being the highest, five the lowest.
Ajay:Digital handyman being the five, and, you know, NASA being one, like, expectation of
Ajay:quality.
Ajay:Yeah, yeah.
Andrew:And then, so, let's say you choose three, and that's the standard, like, average
Andrew:production.
Andrew:Like, it's not dealing with money or lives or anything like that.
Andrew:It's just, like, you know, everyday use, right?
Andrew:They'll be good enough, right?
Andrew:So, from there, that standard will be applied to how the model will
Andrew:spit out the actual specifications.
Andrew:Okay.
Andrew:Because there's different levels of detail for each tier, right?
Andrew:So, once it's, you know, puts that out, from there, it will use those specs
Andrew:and actually build it out, right?
Andrew:And then, from there, it will do a short review.
Ajay:Mm-hmm.
Ajay:Mm-hmm.
Andrew:Because it's actually not going to be, the reviews are actually really short now,
Andrew:because the first review happens on the spec sheets.
Ajay:Okay.
Ajay:Yes.
Ajay:I, if, just a, just a really quick recap.
Ajay:So, we're saying, basically, in just my current documents, my current plans.
Ajay:Yep.
Ajay:Figure out what I want to do.
Ajay:Yeah.
Ajay:Rate, would you be rating it?
Ajay:Would I, if I'm the user, would I be rating it saying that the expectation is tier
Ajay:one or tier two up to five?
Andrew:The user is supposed to.
Ajay:So, I'll give it my spec sheet.
Ajay:I'll give it the tier rating.
Ajay:Yep.
Ajay:Um, and then, it'll basically go do a initial, um, generation of some specs.
Ajay:Yeah.
Ajay:And it'll do a self-review of those specs.
Ajay:Yep.
Ajay:And it will have that conversation with you.
Ajay:Like, me as a user.
Andrew:Yeah.
Andrew:Yeah.
Andrew:So, it'll have it like, okay, yeah, if there's anything to check over.
Andrew:Mm-hmm.
Andrew:Thankfully, the spec generation is actually specific enough so far in my usage of
Andrew:it.
Ajay:Mm-hmm.
Andrew:That there hasn't really been, there's actually no need for review anymore.
Andrew:There are review processes.
Ajay:Mm-hmm.
Andrew:Right?
Andrew:Right.
Andrew:And, like, short enough, I'm assuming once we get up to more complex things, it's,
Andrew:we're going to run into hiccups because of context, maybe.
Ajay:Yeah.
Andrew:Um, but, like, the storefront and stuff, those have been validated pretty
Andrew:straightforward things, I think.
Ajay:Which, which is totally reasonable, I think.
Ajay:From, uh, how would I put it?
Ajay:The, you don't want to get too specific too early.
Ajay:No.
Ajay:Yeah.
Ajay:It might be actually distracting and, uh, taking away from the ability to look at it
Ajay:holistically.
Andrew:Yeah.
Andrew:Yeah.
Andrew:Because right now, what I'm trying to do is, like, I've kind of learned from my
Andrew:mistakes earlier with Luxwander, trying to get everything done all at once.
Ajay:And this is Luxwander iteration two or three?
Andrew:Oh, the, the, the, the project as it's going now, like, you know, scrapping all the
Andrew:original code, right?
Ajay:Yeah.
Andrew:Um, I, I'm trying to just get it working as fast as possible now.
Andrew:I, I want to see it play from A to Z.
Ajay:Yeah.
Andrew:And then I'll go back and start to critique it because I already had an idea, it's
Andrew:all played out in my mind.
Andrew:Like, I already have all of it, like, written out of what I wanted it to look like.
Andrew:And basically I'm going to let it finish building out.
Andrew:Then now I'm going to do a pass on actually critiquing each module, like working
Andrew:through it.
Andrew:And that's when I'm going to start looking at the specs, right?
Andrew:Because I can see that the tests had worked, but now I'm going to be like, okay,
Andrew:well, what's in there?
Andrew:What is it missing?
Andrew:What would I like it to be there?
Andrew:You know?
Andrew:Right.
Andrew:, um, like for example, I'm like, oh, well, I remembered, like, for example, this
Andrew:could be, this could be something I find.
Andrew:I was like, oh, for some reason it's choosing the assurance tier on its own.
Andrew:Let's say that I'm like, okay, that's not what I want.
Andrew:And I wanted to be able to select it.
Ajay:Yep.
Ajay:Yep.
Ajay:Because that is an explicit input that you want to gate.
Ajay:So you don't get it to do too much work when you actually don't want it to do too
Ajay:much work.
Ajay:Alternatively, you want it to have a higher bar when it may not assume you should.
Andrew:Yeah.
Ajay:So, um, yeah, are you, are you thinking, so it sounds like it is a particular case
Ajay:where because Codex is doing its own thing, it's going the goal oriented, you know,
Ajay:solutioning that Codex can do, just ignore everything else is YOLO, let's go build.
Ajay:Um, that sounds like it is doing certain things where you want to inject a more
Ajay:specific, um, expectation at each phase.
Ajay:And that is kind of like the part that's missing and you want to, or I guess, what,
Ajay:how are you thinking you're going to solve that?
Andrew:Well, well, I, again, um, like now that we're basically at first alpha,
Andrew:uh, now it's when I'm going to start to manually review and work the process.
Ajay:Got it.
Ajay:So you're going to, you're going to feed it to rigor and then rigor.
Andrew:I'm actually going to start using it and seeing, seeing where it doesn't live up to
Andrew:my expectations and then I'll be able to.
Ajay:Kind of like now is the dogfooding session now that you've, uh, you've been building
Ajay:the main, you know, product for quite a while, which is a Luxwander, you know, game
Ajay:with all of the nations and all the, oh, sorry.
Ajay:What was the name that you gave it?
Andrew:Minecraft nations, Minecraft nations.
Ajay:And, and so you've been building that product for a while now.
Ajay:Uh, you have, uh, now also recognize that there's all these learnings about how to
Ajay:build it.
Ajay:And that is essentially where rigor is becoming this, uh, solution to help build it
Ajay:more effectively in a more organized way that you can track more effect, you know,
Ajay:software engineering, life cycle almost as DLC style almost.
Ajay:And, and, uh, the intention now is to start plugging in rigor and use it in a more
Ajay:organized way.
Ajay:Would you start using it in the remaining portions of the Luxwander or, uh, you
Ajay:know, like, or in this case, I'll say Minecraft nations, or would you say that you
Ajay:will basically
Ajay:restart from scratch maybe?
Andrew:Um, I'm definitely not going to restart Luxwander from scratch.
Andrew:Yeah.
Andrew:Fair enough.
Andrew:Um, but.
Ajay:We did joke about being like a hundred, 200,000 lines of code or something.
Andrew:It's a, it's up to 600 now, but, but, um, yeah, I'm definitely not going
Andrew:to restart that there.
Andrew:I think like there comes a point.
Andrew:There comes a time where, um, you just have to ship it.
Ajay:Mm.
Ajay:Right.
Andrew:And at this point I'm like, okay, I'm not really worried cause I'm not shipping it
Andrew:to like the public yet, but I need to start shipping it internally so I can start
Andrew:testing it.
Ajay:Right.
Andrew:And so it's funny because I was doing so much work with
Andrew:Luxwander and the workflow itself.
Andrew:That's why I separated it out to rigor because I was like, okay, I'm iterating so
Andrew:much on the workflow.
Ajay:Yeah.
Andrew:That now.
Andrew:Luxwander is not getting iterated on cause I keep going back and say, oh, this can
Andrew:be better.
Andrew:That can be better.
Andrew:This can be better.
Ajay:This is one of the fun moments of when we talk about parallelization.
Ajay:This is a valid case of parallelization in software engineering where you're like,
Ajay:okay, we recognize there's a bunch of things we could get better at.
Ajay:Should we stop our product development to do that?
Ajay:No, no.
Ajay:Let's just, let's just go do it at the side when, when it reaches a reasonable
Ajay:version, a usable version, we will now pull it back in and then the next iteration
Ajay:of our solution.
Ajay:So we're not changing.
Ajay:We're not building rebuilding from scratch.
Ajay:We're the solution.
Ajay:The workflow that we build has to accept an existing project or product and
Ajay:essentially build on top is what it sounds like.
Andrew:Yes.
Andrew:Yeah.
Andrew:So, so basically I've, I've ripped out everything that now from there, well, I guess
Andrew:copied and that turned into rigor in a different repository.
Andrew:So now they're both being worked on at the same time, but Luxwander has the older
Andrew:version, the brainchild version.
Ajay:Right.
Andrew:So it's not actually running rigor because it's not implemented there.
Andrew:Right.
Andrew:But it does have its own version with some influences, like some key features that
Andrew:I've extracted out of rigor.
Ajay:Some unavoidable things that you were like, I really need this right now.
Ajay:Exactly.
Ajay:This needs to be there.
Andrew:Just enough to get it going.
Andrew:Yeah.
Andrew:And then after that, I set it off to complete it because I was like, I was like, it
Andrew:would take too long to integrate now at this point.
Andrew:I'll do that on phase two.
Ajay:That is, that is, that's very.
Ajay:Reasonable thing to do.
Ajay:I just bumped my mic stand.
Ajay:So if you heard something, my apologies.
Ajay:The, that is a totally reasonable approach.
Ajay:And, and I think you can't fix everything.
Ajay:No.
Ajay:There might be things that if you fix a use, the benefit is so big or things you
Ajay:just absolutely need to build confidence in what you're doing.
Ajay:Yeah.
Ajay:Therefore you will actually go ahead and implement it or pull it back in.
Andrew:And that's exactly what I did.
Andrew:It was like, it's like you kept asking me, how's it going?
Andrew:Yeah.
Andrew:And I said, I'm not sure.
Ajay:Yes, that's fair enough.
Andrew:And so that's, was one of the things, like, I would like to be sure of how long this
Andrew:is going to take.
Ajay:The confidence levels were low.
Ajay:Yup.
Andrew:But be from taking that feature out of rigor, putting it into there just like that
Andrew:one piece.
Ajay:Yes.
Andrew:I was able to finally get an actual progress bar going.
Andrew:Yeah.
Ajay:And interestingly, I will, um, I'm going to digress just a little bit here.
Ajay:Um, I think the thing I'm thinking about in this particular scenario is, uh, it
Ajay:feels like.
Ajay:Um, we have been talking about, um, Minecraft worlds as a
Ajay:Minecraft nations.
Ajay:Sorry, didn't mean to, again, I'm, I'm going to get used to that name Luxwander.
Ajay:We've been talking about Luxwander as, as a project and kind of been focusing on it
Ajay:from a, uh, 30,000, uh, more, more like actually 5,000 feet view.
Andrew:Yeah.
Ajay:So if I imagine if I use a plane analogy, um, I can see your mic is bothering you
Ajay:there, but I, I can appreciate that, uh, I'm having the same challenge, but.
Andrew:Yeah.
Ajay:Uh, coming back to the plane analogy and, uh, the way you've been operating right
Ajay:now has been actually very close to the code.
Ajay:You've been watching the coding assistants do a lot of the work very closely and
Ajay:tracking their work on a day-to-day basis, almost hourly basis at times.
Ajay:Um, now it almost feels like you are pulling a little bit higher because you're
Ajay:like, okay, it did this in these last few iterations.
Ajay:These were certain behaviors that did not give me any confidence.
Ajay:You, I feel like you've actually gone from, let's say.
Ajay:5,000 to almost 20,000 feet where you're like, okay, what happened the last four
Ajay:times?
Ajay:And tell me now, uh, it's not an exact analogy.
Ajay:It was just, this is just now.
Ajay:Um, and this is sounds like there are certain things which you've discovered where
Ajay:you're like for the next, you know, next few iterations.
Ajay:I need this.
Ajay:I just, I need this capability, even if it's being built in parallel and that other
Ajay:project and the workflow, like in rigor workflow creation, there is certain things I
Ajay:just need as part of Luxwander for me to build that confidence that we can actually
Ajay:get there.
Ajay:And, uh, this is, I think the plain analogy working out where you were, you were
Ajay:monitoring mostly at that 5,000 so far, but now you're coming up and you're
Ajay:observing that there's things going on in many places that I can kind of start
Ajay:putting together.
Ajay:So that is, that is really cool.
Ajay:That is actually part of the also thing in software engineering and software
Ajay:development, where at some point you must recognize that there may be parallel work
Ajay:being done in two separate places that need to unify in a way and need to come
Ajay:together.
Ajay:Um, and I think those are things that really excite me, uh, because as an engineer
Ajay:who has worked in large engineering teams in the past, uh, you know, repeated work
Ajay:in slightly different ways is completely mind boggling and also very impossible
Ajay:to maintain long-term is, is just not tenable.
Ajay:It's just like things just change.
Ajay:Like there's just everything.
Ajay:Most of the ideas are the same, but then there's just like variations, just like
Ajay:slight cracks going, you know, or slight branches going.
Ajay:Yeah.
Ajay:Left and right.
Ajay:And, uh, in, in the two separate work streams.
Ajay:And I think that's, that becomes really dangerous and unmaintainable and long-term.
Ajay:So I think what you're doing now is awesome.
Ajay:Like in terms of recognizing that there are things that could be unified now
Ajay:providing immediate value while also, uh, being unified in the long-term and,
Ajay:uh, providing a good value in the long-term.
Ajay:So I don't know if that's what you feel like you're doing though, Andrew.
Ajay:I think that is actually what I'm seeing.
Andrew:Yeah.
Andrew:I actually agree completely.
Andrew:Like, uh, I mean, just from how I'm using it now, I used to kind of babysit like
Andrew:the agent, right.
Andrew:I'm like, okay, like, but now it's like, okay, it's, I, I'm confident that the
Andrew:specifications were written out and detailed enough to actually get it done
Andrew:correctly.
Andrew:And now I'm just, just waiting for it to complete it.
Andrew:And so essentially it's been coding itself for, you know,
Andrew:maybe like two weeks.
Andrew:Yeah.
Andrew:Yeah.
Ajay:Yeah.
Ajay:Yeah.
Andrew:Um, the, it's funny as I kind of zoom out more, I see
Andrew:more bottlenecks, right.
Andrew:And so now I'm actually in the process of kind of brainstorming a
Andrew:kind of like automated orchestration layer that has my
Andrew:objectives, broader objectives there.
Andrew:So that way when something occurs at a lower level agent that, uh,
Andrew:you know, broader agent would be able to actually redirect and push them in the
Andrew:right direction.
Ajay:Um, I, I really love the idea.
Ajay:Also dangerous game where the, where the, uh, workflow basically becomes a project
Ajay:at some point.
Ajay:Uh, so, so I, I think I'm curious about like that part too, is like, there is a day.
Andrew:I haven't, I haven't used it yet, but it's essentially just what I, what I'm finding
Andrew:is like, I have a lot of different projects, right.
Andrew:Um, I'm confident if I can become confident in the specifications and the
Andrew:instructions, that are put to the models, which that's what I'm trying to do right
Andrew:now is like, can I be confident that the instructions, the specifications being
Andrew:written down are going to be, you know, you know, like satisfactory
Andrew:to my acceptance criteria, right?
Andrew:Like, will it come out the way that I want it based on the tier that you've selected
Andrew:based on the tier that I've selected, right.
Ajay:Okay.
Andrew:Um, if I can become confident in that, then I can become confident, become confident
Andrew:that that layer can then be automated.
Ajay:Got it.
Ajay:I see your point.
Ajay:So, because so far you have let it do its work and you've been monitoring it
Ajay:closely.
Ajay:You've observed that it may say it's actually done, but it's not really done a lot
Ajay:of the times.
Ajay:And it keeps telling you things.
Ajay:And then when you tell it, oh, this doesn't look right.
Ajay:Then it goes back and there's no end.
Ajay:There's kind of like that loop that's constantly occurring.
Ajay:And at some point you get frustrated.
Ajay:And at some point you're like, how do I now actually get it to truly measure?
Ajay:What is an objective criteria?
Ajay:And then how do I actually figure out if the, if, when it says it met the objective
Ajay:criteria, it's meeting it or not.
Ajay:So it's, it's a little meta.
Ajay:We're kind of like saying like the confidence layer of the confidence levels, you
Ajay:know, confidence on top of confidence.
Ajay:But the idea is like saying that, can I figure, put some mechanism in place that
Ajay:lets me let it go with a high level of confidence and meaning that let's say 80% of
Ajay:the time, it'll get it right.
Ajay:Maybe in the future I get, I figure out why that 20% is failing.
Ajay:I go from 20% of the time.
Ajay:And from a 20% failure rate to like, let's say five.
Ajay:So then eventually it'd be 95% of the time.
Ajay:I just let it run with enough information and it's doing it correctly.
Ajay:I interestingly, I think I've actually experienced a lot of this in my own personal
Ajay:projects.
Ajay:And it's like, there are these iterations where I will run through and be like,
Ajay:okay, I'm going to go, I tell it to go spawn up sub agents, do work in the sub
Ajay:agents.
Ajay:And interestingly, the orchestration layer that you're talking about is essentially
Ajay:something I've been playing with just directly in cloud in this case.
Ajay:So I'm telling Claude, Hey, you are the main orchestrator, go spawn up the sub
Ajay:agents, get, give them the right information to go do the work.
Ajay:When they come back, I want you to verify and tell me if they've done their work or
Ajay:not.
Ajay:And then, excuse me.
Ajay:And then explain to me what that, what that, you know, proof was.
Ajay:I'm curious.
Ajay:I, my experience from this has been relatively good because Claude will actually be
Ajay:like, oh no, I didn't actually do everything at times because the sub agent will
Ajay:have less contacts.
Ajay:Sometimes it.
Ajay:Uh, will not have everything it wants.
Ajay:And then the parent orchestrator will recognize and do a little better next time.
Ajay:Um, that is, that is kind of like one approach.
Ajay:I'm still trying to figure out how to extract those learnings out of that one
Ajay:orchestrator session and make it more usable across different sessions.
Ajay:Um, which is, which is interesting to me is because I'm hearing a lot of the stuff
Ajay:you're building.
Ajay:The workflow you're building is very exciting and sounds very like, like it can do
Ajay:what really, like what a lot of people.
Ajay:Are hoping for, uh, in my opinion, uh, I'm trying to figure out, um, in your
Ajay:mind, do you feel like this is something that maybe is still like focused on games
Ajay:at game design?
Andrew:No, no, absolutely not.
Andrew:Uh, for rigor as a workflow is meant to be project generic.
Ajay:Okay.
Andrew:And it's, it's supposed to be able to, so once, like, I think, I don't know if this
Andrew:is in the current phase.
Andrew:I don't remember, but there are multiple phases for rigor and there'll be different
Andrew:layers of customization.
Andrew:Okay.
Andrew:Yeah.
Andrew:So it's at some point there's going to be like, literally like when you're
Andrew:installing it, it will ask you certain things to customize.
Ajay:Okay.
Andrew:Um, the, the, the workflow.
Ajay:Is, is, is this already there right now in the alpha you were thinking about this
Ajay:for the future?
Andrew:Um, I don't think it's, I don't think it's in the current alpha now.
Andrew:Okay.
Ajay:Okay.
Andrew:Yeah.
Andrew:It's there's a lot of features.
Ajay:We'd like to get everything done.
Ajay:We'd like to boil the ocean, but you know, we are reasonable.
Andrew:And the only reason I say that is because I haven't like focused on it at all.
Ajay:So I'm going to assume it's not, I, you know, I'm, again, I'm, I'm, I'm raising my
Ajay:arms here.
Ajay:I'm telling Andrew.
Ajay:Yeah, I totally agree.
Ajay:I totally, totally can understand.
Ajay:Uh, we would love to do everything, uh, especially with the eye.
Ajay:We feel like we can do everything.
Ajay:Um, but we need to be reasonable and like pick one thing at a time.
Ajay:So I guess that is coming back to it is, um, in the current effective state, what
Ajay:would be in your mind, the alpha, like what is a killer feature?
Ajay:What is it doing really well?
Ajay:Because I think we talked a little bit about this previously.
Ajay:The tiers is something I love the concept of, uh, where are you at about like, Hey,
Ajay:this is something that most individuals probably run into when buildings they're
Ajay:like projects.
Ajay:I maybe not even forget software.
Ajay:Just you're using a digital handyman.
Ajay:You're trying to do something in particular, you know, like, uh, Claude Code is your,
Ajay:uh, is your like, you know, software engineering, uh, you know, AISs.
Ajay:And, uh, Codex is your digital handyman.
Ajay:They can do things, but rigor start using rigor with them.
Ajay:And all of a sudden, this is one thing you will see that is very helpful.
Ajay:What would you say is that very helpful piece in your mind?
Ajay:I'm putting you on the spot here.
Andrew:So I, yeah, no, I, I think I, to be honest, it was the part that I extracted for
Andrew:Luxwander.
Andrew:Right.
Andrew:It is, it's actually building out the specifications to the level of detail where
Andrew:review cycles are not as relied upon.
Andrew:Because what I found when I was working with Luxwander without this workflow, right.
Andrew:This little piece was again, you saw like, oh, this is round a hundred for review.
Andrew:And I thought to think to myself, well, there's got it.
Andrew:Why are all of these gaps here?
Ajay:A code review.
Ajay:Code review is what we want to be very specific.
Ajay:Yeah.
Ajay:There's a hundred rounds of code review amongst multiple models.
Ajay:And I think we've talked about this before, but yes, code review.
Andrew:Yes.
Ajay:That's a lot.
Andrew:Yeah, no, that is a lot.
Andrew:And I was like, that actually took longer than generating the code.
Ajay:Mm-hmm .
Andrew:Well, significantly longer.
Ajay:Mm-hmm .
Andrew:And so I guess it's obvious looking back now, but I was like, okay, well, how can I
Andrew:shorten the rounds of review?
Ajay:Mm-hmm .
Andrew:One way to do it was to be more specific on how to fix it.
Ajay:Mm-hmm .
Andrew:Or I give me more specific on how to make it.
Ajay:Mm-hmm .
Ajay:And so.
Ajay:Better discovery upfront.
Andrew:Yeah.
Andrew:Yeah.
Andrew:So now I'm front loading the kind of effort to the actual generation
Andrew:of the specs.
Andrew:Mm-hmm .
Andrew:Before it even touches any code.
Ajay:Because it's a lot cheaper to generate a few, maybe a dozen documents, like each
Ajay:being about two or three pages versus 600,000 lines of code.
Andrew:Yep.
Andrew:And so essentially it will build out all of those contracts.
Ajay:Yes, Scott.
Andrew:In this specification.
Ajay:You're talking my language now.
Ajay:You're hitting contracts.
Ajay:Yes, Scott .
Andrew:And there'll be different slices for the actual features.
Ajay:Nice.
Ajay:Nice.
Andrew:And then the modules.
Andrew:So now it's like there's three layers now of it's actually building
Andrew:out those things individually.
Andrew:Not even in code.
Ajay:Mm-hmm .
Andrew:It's just for specifications.
Andrew:Awesome.
Andrew:And so that's where I get the confidence.
Andrew:Mm-hmm .
Andrew:And then there's also when you do the review, there's actually something to look at.
Andrew:Before.
Andrew:Before.
Andrew:Yeah.
Andrew:The code was even written that it's supposed to be there.
Ajay:Yes.
Andrew:So now it's like, okay.
Andrew:The review is like, okay, unless there was like a coding error that the model did,
Andrew:which doesn't really happen too often.
Ajay:It doesn't.
Ajay:No, not anymore.
Andrew:Yep.
Ajay:So it's a specification errors happen a lot.
Andrew:Yes.
Andrew:Yeah.
Andrew:So as long as it has the right context.
Ajay:Yes.
Andrew:It can write it correctly.
Ajay:And I think you're really hitting on the right points because I think the more
Ajay:specific you can be about the ask, based on all my experience, based on all my
Ajay:readings and everybody else I've talked to, the more specific you can be about the
Ajay:ask.
Ajay:The more specific you can be about the task to the model, you know, Claude Code,
Ajay:Codex, Gemini, whoever it is, some are going to be better than others regardless.
Ajay:But the more specific that you can be upfront, the better job it will do.
Ajay:You can one-shot things as long as your one-shot is so detailed that there's very
Ajay:little left to interpretation.
Ajay:I'm not sure if that's necessarily the case here, but it sounds like at least that's
Ajay:a direction this is starting to drive towards.
Ajay:And these primitives, now that you're establishing the primitive of a contract, the
Ajay:primitive of a feature and module.
Ajay:I'm sorry, I might have butchered the slices, the feature slices.
Ajay:Yeah.
Ajay:Okay.
Ajay:So are you calling it slices or features just for my own sanity?
Andrew:I am calling it slices, but they're meant to be, each slice has a different feature.
Ajay:Got it.
Ajay:So you can have like a single contract and have multiple features under it maybe?
Ajay:Or is it hierarchical at all?
Andrew:It's a slice can have several contracts.
Ajay:Okay.
Ajay:Got it.
Ajay:Absolutely.
Ajay:And then the modules, you can have multiple modules as part of a single slice.
Andrew:There are multiple slices make up a module.
Ajay:Got it.
Ajay:Okay.
Ajay:So I flipped it around.
Ajay:I'm going to turn that tree upside down in my head.
Ajay:So got it.
Ajay:Absolutely.
Ajay:So you have the module.
Ajay:The module has multiple feature slices or slices in particular.
Ajay:Each slice may have one or more contracts that help essentially execute or provide
Ajay:that capability, the features capability.
Ajay:Yeah.
Ajay:That's awesome.
Ajay:Like these primitives, I do feel like are a great way to at least start
Ajay:conversations.
Ajay:And in this case, a conversation with your coding assistant.
Ajay:Again, in my history.
Ajay:In my experience as a software engineer, that is what we were talking about as like
Ajay:coming kind of circled back to the YouTube video as a individual contributor,
Ajay:as a software engineer and not a manager.
Ajay:Really the only way, in my opinion, not the only way, but one of the easier ways
Ajay:that I have found personally to convince others and get engineers like human
Ajay:engineers to actually get excited and then build something really awesome is to
Ajay:start with a common set of primitives that we can all align on.
Ajay:Right.
Ajay:And then once we have that common footing, how do you then explain when you put
Ajay:these things together and you start putting those Legos on top of each other, you
Ajay:know, is going to create this awesome thing.
Andrew:Absolutely.
Andrew:And I guess I wanted to expand on like the slices and the contracts a little bit.
Ajay:Absolutely.
Andrew:The reason why I kind of directed it that way was because I was finding that during
Andrew:the reviews on the original versions of the Luxwander that was having all those
Andrew:troubles with all those rounds of review.
Ajay:Mm-hmm.
Ajay:Mm-hmm.
Andrew:Was every time it did fix something, it broke something else.
Ajay:Mm.
Andrew:And so that was leading to the The regression.
Andrew:Infinite loop.
Andrew:Yeah.
Andrew:The regressions led to an infinite loop disaster.
Andrew:Right.
Andrew:It did eventually finish it.
Andrew:But how many days of tokens that I waste to get something what I thought should have
Andrew:been rather straightforward was not.
Andrew:Right.
Andrew:And this is obviously when you're dealing with a module that has like over a hundred
Andrew:thousand lines of code.
Andrew:Mm-hmm.
Andrew:And so there needs to be like, I was like, well, how do we, how do we fix this?
Andrew:Right.
Andrew:And so each slice is isolated for that feature.
Ajay:Another word that I love.
Ajay:Yeah.
Ajay:Absolutely.
Ajay:Isolation.
Ajay:Woo.
Andrew:So that way, if we need to update that feature.
Ajay:Mm-hmm.
Andrew:It's only going to mess with that component.
Ajay:Mm-hmm.
Andrew:That slice.
Andrew:Mm-hmm.
Andrew:Those contracts in that slice.
Ajay:I love it.
Ajay:I, I mean.
Ajay:Mm-hmm.
Ajay:Mm-hmm.
Ajay:Andrew, you've heard me talk about it, you know, isolate things, paralyze things,
Ajay:create the contracts.
Ajay:Oh my gosh.
Ajay:Wow.
Ajay:All right, here we go.
Andrew:And yes, those slices have been built in like intentionally.
Andrew:I've been specific about it, that it needs to be able to be paralyzed.
Ajay:Paralyzed and in the slices.
Andrew:Yes.
Andrew:Those slices can have an individual agent working on each one.
Ajay:This is exciting to me and for very specific reasons, because I've actually used a
Ajay:lot of open source libraries for spec driven development.
Ajay:We've talked about GSD, OpenGSD now a few different times.
Ajay:I will not say the whole word because we might, you know, we might get our podcast
Ajay:taken off the air from Apple again.
Ajay:So the idea there that I really loved was creating specs ahead
Ajay:of time, doing some things.
Ajay:So there are open source libraries that do this.
Ajay:Parts of this.
Ajay:What Andrew has just mentioned though, I think is a very clear distinction is how do
Ajay:you break up a larger problem?
Ajay:How do you actually then create into different tiers and like tier?
Ajay:Based on like what level of, you know, accuracy you need?
Ajay:Like, you know, error rate needs to be really low.
Ajay:And then based on that tier, how do I actually create a broken down problem?
Ajay:Multiple modules, multiple feature slices, multiple contracts as needed in order to
Ajay:achieve that?
Ajay:I mean, I guess I will say this Andrew, just to keep ourselves honest and just to
Ajay:keep this honest as we are, it's an alpha.
Ajay:So there's clearly, there's going to be some work here in refining that.
Ajay:I think I'm really excited by the concept of that because instead of it just saying
Ajay:that.
Ajay:The other approaches I've seen, which do really well, they, they,
Ajay:they, I feel like are a little more still on that 10,000 foot level in the plane
Ajay:analogy.
Ajay:And they're very focused on like certain capabilities.
Ajay:Once you start getting into that 20,000, 30,000 feet, I feel like they've kind of
Ajay:fallen down for me a little bit where they start creating so many slices and that's,
Ajay:they're mostly doing like phases of implementation.
Ajay:GSD in particular does phases of implementation.
Ajay:At some point, I've got too many phases, I'm losing track and things are getting too
Ajay:like untenable.
Ajay:Again, that is where I do feel like this approach of like, Hey, I have a module.
Ajay:The module got completed.
Ajay:The next module is also there.
Ajay:Now I can match the, figure out the relationships between them.
Ajay:That I think scales better when you look at it from like that 20, 30,000 feet.
Ajay:And I, I have had to do the modules.
Ajay:I've had to do the, you know, feature slices in my head and work with like different
Ajay:cloud sessions.
Ajay:So I'm definitely excited too.
Ajay:To hear about this and like actually try some of this out.
Ajay:Yeah, very excited.
Andrew:Absolutely.
Andrew:No, I'm excited too.
Andrew:And I, I think it's close.
Ajay:All right.
Ajay:Yeah.
Andrew:I mean, it already, the first alpha is, is ready now.
Andrew:It's just kind of like, I am, it is like, it's already been tested.
Andrew:It does work because of the scenarios.
Andrew:Now I'm just trying to go back and fill the gaps so that I can start confidently
Andrew:using it essentially.
Ajay:And I think the, the thing I will maybe ask and hopefully we can work through this
Ajay:because, as I said, this is alpha where, where there might be a million things we
Ajay:want to do.
Ajay:We want to boil the ocean.
Ajay:We can't necessarily do it.
Ajay:Yeah.
Ajay:This is not trivial.
Ajay:I think the question is again, like you are very specifically saying the capability
Andrew:is spec building, you know, building that is the most important part of this yet
Andrew:to start.
Ajay:Right.
Ajay:I think there might be other interesting things, which even I'm like, I have talked
Ajay:about a few other things.
Ajay:I think getting the start getting the correct starting point, getting like that
Ajay:really good footing.
Ajay:Yeah.
Ajay:I do a hundred percent agree.
Ajay:That's really important.
Ajay:I am also curious, like how we can, you know, get to the next
Ajay:phase beyond that with rigor.
Ajay:And I think that's going to be the curious part of like, would you, may I join as a
Ajay:contributor is, you know, I've got a few interesting questions and a few interesting
Ajay:hypotheses myself.
Ajay:So I think I have some, if you, if you don't mind, maybe I'll, you know, give it
Ajay:some of my own flavor.
Ajay:Yes.
Andrew:That's part of the past I'm doing now as I'm adding like a security.
Andrew:Contributing.md so that I can actually open it up.
Andrew:I like, I want to be able to, I'm going to try to create something small with it,
Andrew:like as a, as a bigger test scenario, something that like those test scenarios were
Andrew:made by Claude Code or Codex.
Andrew:I'm actually going to write one out on my own.
Andrew:So I know the product from, you know, from the very top and bottom, then run it
Andrew:through the pipeline and see where the gaps are.
Ajay:Mm-hmm.
Andrew:Um, and from there.
Andrew:Yeah.
Andrew:I'm going to publish the first alpha.
Ajay:Awesome.
Ajay:I, I, and I think I'm excited.
Ajay:So don't take too long, Andrew.
Andrew:It's funny.
Andrew:I was, I was, I'm going to try to get it done today.
Ajay:Actually get it done today.
Andrew:Oh, it's actually, there is a part of it is being run on right now.
Andrew:Um, and behind the scenes.
Andrew:Yeah.
Andrew:It's already, I've already identified all the gaps that after this first alpha.
Andrew:And so it was just planning out specifications to be able to patch all that.
Ajay:Awesome.
Ajay:I, I, and that is basically patching potential issues in the workflow right now
Ajay:as part of the original alpha.
Ajay:Yeah.
Ajay:Uh, so would we say, what can we say is like zero point version 0.1 kind of idea?
Andrew:Yes.
Ajay:0.0 right now.
Ajay:And maybe you're creating 0.1.1.
Ajay:Yeah.
Andrew:Yeah.
Ajay:Is that true?
Ajay:Yeah.
Andrew:0.1.1.
Ajay:0.1.1.
Ajay:You know, that's, that's, that's the version.
Ajay:Yeah.
Andrew:And it's just like with any kind of like.
Andrew:AI coded project, just because you wrote it down, doesn't mean it remembered to put
Andrew:it in.
Ajay:Oh, that's true.
Ajay:Yes.
Ajay:So you got to go back.
Andrew:That's why I said earlier, I was like, I'm not sure.
Ajay:Okay.
Andrew:Because I remember thinking about it, but I don't remember if I wrote it down in the
Andrew:specs.
Ajay:Absolutely.
Ajay:Absolutely.
Andrew:And, and it, I haven't been focusing on user runtime right now at all.
Andrew:Yeah.
Andrew:Cause it's like, I'm not publishing it yet for people to use.
Andrew:I'm just like, I'm trying to make sure that the workflow works.
Andrew:Then we can put the scaffolding around it, like a Docker image or something like
Andrew:that.
Andrew:So that it's easily portable and deployable right now.
Andrew:It's like, okay, it's kind of like it works the way that it made it.
Ajay:Absolutely.
Andrew:I'll make it portable and deployable later.
Ajay:I mean, or somebody else.
Andrew:That's true.
Ajay:That's, that's the idea of like bringing in contributors and having multiple people
Ajay:look at it.
Ajay:I think in one of the conversations we had previously was how do you go beyond one
Ajay:individual?
Ajay:How do you scale beyond one individual?
Ajay:And then being like, you have your own individual project being built right now.
Ajay:Yeah.
Ajay:How do you now let others into the room and kind of start working together on it?
Ajay:I feel like we have kind of played, played on this already.
Ajay:Like, I think as part of the podcast, we have like the audio mastering project that
Ajay:we have on our own private repositories intentionally because it is, it is rough,
Ajay:but it is an intentional thing for our system.
Ajay:So we can essentially do the audio mastering for this podcast.
Ajay:I am really excited to maybe try a private version of Frigger.
Ajay:And, you know, maybe I can have my own Flare and have my own commits and send you
Ajay:some pull requests, you know?
Ajay:Absolutely.
Andrew:You can poke all the, poke all the holes.
Ajay:Poke all the holes.
Andrew:Or maybe the holes are there just to walk in.
Ajay:Yeah, just, just walk in.
Ajay:The doors are already open.
Ajay:Um, no, and I think I, I love the idea of this super focused approach of like, uh,
Ajay:my alpha, my first version might just be spec or at least for now we'll focus
Ajay:entirely on that.
Ajay:And I think the concept of tiers, as I said, I'm super excited because there's a lot
Ajay:of, a lot of depth that we can jump into just there.
Ajay:That is a whole nother topic.
Ajay:Do you want to, do you want to jump into that?
Andrew:Sure.
Andrew:Yeah.
Ajay:Because that's, that's maybe just, just to kind of preface for our audience.
Ajay:We are talking about a, a different kind of tool altogether.
Andrew:We're not sponsored yet, but we're open.
Ajay:Love it.
Ajay:Love it.
Ajay:Let's let's wait.
Ajay:Okay.
Ajay:Okay.
Ajay:Blacksmith.
Ajay:If you're hearing this now, but yeah, please, please.
Ajay:This is a different topic, but yes.
Andrew:So essentially there's, you know, I have rigor connected to my private repository,
Andrew:which it's already, I believe, run through GitHub actions a few times.
Andrew:I hadn't started doing PRS until about the first alpha, because
Andrew:I was just in such a deep, just tearing everything up mode, like reorganizing
Andrew:everything.
Andrew:I didn't think it was going to be beneficial to have to check everything every five
Andrew:minutes.
Andrew:But now that I'm reaching that first alpha stage, getting too close to one, I'm
Andrew:like, okay,
Andrew:let's start doing PRS.
Andrew:Let's having the code get checked.
Andrew:Let's actually have, you know, the linters run, the CI running,
Andrew:but, GitHub actions and
Andrew:it's internally built one.
Andrew:It's actually quite slow.
Ajay:Yeah.
Andrew:And so Blacksmith, thankfully, apparently they're, this sounds like a giant
Andrew:advertising now at this point, but, but it was really beneficial to me.
Andrew:Blacksmith, did you listen to that?
Andrew:It was really beneficial to me because what I found on the Luxwander workflow was
Andrew:that, you know, some builds were taking like 20 minutes.
Ajay:Yeah.
Ajay:Yeah.
Andrew:And when you're coding with AI, 20 minutes of waiting for that build
Andrew:is a long time.
Andrew:Maybe 20 minutes wasn't a lot before, because it's like, okay, I can, I can look at
Andrew:another ticket and reply to something on Jira or something like that.
Andrew:But now it's like, okay, that 20 minutes is pausing development.
Ajay:Yes.
Andrew:Because we need, we, we, we like.
Ajay:As long as you have the tokens.
Ajay:Yeah.
Andrew:Yeah, exactly.
Andrew:As long as you have the token.
Andrew:So now I think fast CI and paralyzed CI in particular is actually probably
Andrew:going to be a critical part of agentic workflows.
Ajay:Yeah.
Ajay:In, in, in.
Andrew:Just in general.
Ajay:In general.
Ajay:Wow.
Andrew:Well, it's because it's like.
Ajay:This does sound like an advertisement.
Andrew:Well, yeah, it does.
Andrew:It's, it's because it's just the speed of work is now being bottlenecked by that
Andrew:now.
Ajay:I, okay.
Ajay:I, I see your point is more the idea of like, when I do my deterministic checks, the
Ajay:deterministic checks, if they start taking too long, it is painful.
Ajay:Yeah.
Ajay:This is, this is not new.
Ajay:In my opinion, this is something that has existed for a long time.
Ajay:There is a reason Blacksmith exists and is a company that has gotten interest and
Ajay:is, is I think something that I've also heard a lot about.
Ajay:And I, I think there's a really, really good reason for this, especially
Ajay:as we start building more repositories.
Ajay:Building more projects.
Ajay:And then we start expanding on those projects and we getting like really in depth.
Ajay:I will also maybe mention a little bit that the Luxwander project, the
Ajay:Minecraft, you know, Nations.
Ajay:I, I will get that sometime, sometime at some point.
Ajay:Project is fairly large.
Ajay:I, I believe it is again, not only code wise, but I think it's also Java.
Ajay:So that typically does include more of a compilation element does include some
Ajay:additional like work.
Ajay:Yeah.
Ajay:That needs to be done to run the test, run the deterministic stuff.
Ajay:I think I'm also curious if you ever moved to a different language, let's say, you
Ajay:know, I'm not saying Python's fast.
Ajay:Python is an option because it's interpreted.
Ajay:TypeScript is an option because again, you don't necessarily need to compile or
Ajay:doesn't do the same amount of work when you do it even.
Ajay:So I, I think the Rust is another one, which is very, very performative.
Ajay:The question becomes as well as like,
Ajay:I'm, I'm not, maybe I'm just winding back that advertisement part here, but, but I
Ajay:still feel, I agree with you.
Ajay:There are these languages are still super popular.
Ajay:Like Java is still very, I, I used a Java forever before I moved into Python heavily
Ajay:last year.
Ajay:So I think I totally agree with you that, you know, reducing the amount of time for
Ajay:deterministic checks.
Ajay:Absolutely.
Ajay:Absolutely.
Andrew:Yeah.
Andrew:Yeah.
Andrew:No, I mean, I think that helped a lot and that's actually part of the rigor workflow
Andrew:as well.
Andrew:It there, I've specifically, you know.
Andrew:Okay.
Andrew:It included specifications in rigor.
Andrew:Wow.
Ajay:All right.
Andrew:That it needs to plan out the tests in ways that it can be paralyzed.
Ajay:Oh yes.
Ajay:Yes.
Ajay:Oh, okay.
Ajay:I, I, I like that a lot.
Ajay:I like that.
Andrew:Yeah.
Andrew:Because that was what I ran in with Luxwander.
Andrew:All of the, a lot of the tests were some of these modules.
Andrew:I didn't think of that.
Andrew:I did not specify that these tests needed to be paralyzable.
Andrew:So guess what?
Andrew:Everything was built in the way where it was all serial.
Ajay:Yeah.
Andrew:And that's why it was like, okay, I added four more cores to this test.
Andrew:So you think it's going to go faster.
Ajay:Nope.
Ajay:Nope.
Andrew:I just spent twice as much money for the same exact speed because it was bounded by
Andrew:a serial process.
Ajay:Yeah.
Ajay:I think, I think there's another very specific use cases.
Ajay:If you were ever dealing with audio, if you're ever dealing with video, um, trying
Ajay:to paralyze they're, they're inherently expensive, uh, to do processing on, to do
Ajay:tests with, because if you want to do a real time kind of test with like actual wall
Ajay:clock based tests for some kind of audio or video stream, right?
Ajay:Like you're trying to be like, oh, wall clock.
Ajay:It has to follow wall clock.
Ajay:And I have to verify these things happen during that wall clock execution.
Ajay:They are sequential.
Ajay:They're all, they're all happening, you know, on a single thread usually.
Ajay:So trying to paralyze those is very, very improved performance massively.
Ajay:And I, I've had my own personal experience there that, you know, a questions I would
Ajay:always be asked in one of my previous jobs was, uh, can we do this?
Ajay:Can we just have more cores?
Ajay:Can we just paralyze it more?
Ajay:And, uh, I was like, no, not yet.
Ajay:We need to change the way it's built, uh, because so we can actually paralyze the
Ajay:work.
Andrew:And, and the, this was such a big headache for me on the Luxwander workflow that I
Andrew:actually spent like a few days reconstructing the tests so that it could be
Andrew:paralyzed.
Andrew:And so it went down from like 26 to 28.
Andrew:Now it sounds like four.
Ajay:All right.
Andrew:Which is much more acceptable.
Ajay:That is way.
Ajay:Yeah.
Ajay:That is a seven X, you know, improvement in our, uh, the execution time.
Ajay:Yeah.
Ajay:I, I would take that.
Andrew:And that's why I'm like straight into rigor before we start building anything, build
Andrew:that with this in mind.
Ajay:Yeah.
Andrew:Obviously it could have been just way faster with maybe Python and like, and the
Andrew:other languages you mentioned, but since I've been using Java to me that this, this
Andrew:issue is like really big since it's been slowing me down.
Andrew:Yeah.
Ajay:So, I mean, I mean any Java developers, you know, out there here at first year, you
Ajay:heard it here first rigor has this in mind first, you know, rigor is built with
Ajay:Java.
Andrew:So where it can, the tests will be paralyzed.
Ajay:Absolutely.
Andrew:So, so that way, you know, you can actually take advantage of those additional
Andrew:cores, speed up the workflow because I didn't want the PRS
Andrew:and the deterministic checks to be
Andrew:a bottleneck.
Ajay:Oh yeah.
Andrew:Because another thing is, I think that's going to be a big thing, especially, you
Andrew:know, like you were saying, when you start adding other people.
Andrew:Working on the same project.
Ajay:Yeah.
Ajay:Yeah.
Ajay:Right.
Andrew:It's like, imagine if everyone was had a 30 minute merged.
Ajay:Hey, I, I was the one who added the 30 minute, like 10 functional tests, like in the
Ajay:past and none of my teammates enjoyed that.
Ajay:So I can tell you for a fact, I learned that firsthand.
Andrew:They're like, oh, huh.
Andrew:Yeah.
Andrew:All of a sudden all these, these PRS are taking a lot longer.
Andrew:Yep.
Ajay:Yep.
Ajay:They're like, why are my functional tests?
Ajay:Like what happened?
Ajay:It's like distance.
Ajay:Yes.
Ajay:I did somebody break something.
Ajay:I was like, no, this was intentional.
Andrew:It's like, let's go back and do it.
Ajay:And I was like, ah, not for, for quality purposes.
Ajay:We cannot.
Ajay:So yeah, yeah, no, a hundred percent.
Ajay:I, I genuinely do think it's one of those things where the developer experience
Ajay:degrades.
Ajay:If you don't figure some of these things out and the minute that the developer
Ajay:experience degrades a velocity, you know, falls through the floor.
Ajay:I think that's why there's such great value, especially, especially in the AI.
Ajay:I actually think that it's your AI coding assistant.
Ajay:Don't use it for anything else.
Ajay:Use it to improve your developer experience.
Ajay:Just, just go do that.
Ajay:And all of a sudden you'll see that all of the things you're putting off for years
Ajay:and years are going to make your developers so much more motivated.
Ajay:The engineers are just going to be like, oh my God, this, this used to take, you
Ajay:know, two hours.
Ajay:Now it takes 10 minutes.
Ajay:Yes.
Ajay:Let's go.
Ajay:And that's just going to improve productivity in its own way.
Ajay:And sometimes these little things make a huge difference.
Ajay:Yeah.
Andrew:But, but it's funny, I just remembered, um, we were talking about isolation the
Andrew:other day.
Ajay:Oh yes.
Ajay:Okay.
Ajay:This is another topic where we are.
Ajay:I will, I will put that verbal cue.
Ajay:We are changing topics here a little bit related.
Andrew:It's actually still related to rigor.
Ajay:Okay.
Ajay:Related to rigor.
Ajay:Okay.
Andrew:Yes.
Andrew:And so I went once, once you started talking to me about how you do your workflow.
Ajay:Yes.
Andrew:I thought about, okay, maybe this is really common.
Andrew:I see the benefit potentially.
Andrew:I'm going to build this capability.
Andrew:And from the get go.
Ajay:Which part of my workflow Andrew?
Andrew:So rigor can actually manage in the workflow, multiple repositories
Andrew:at the same time and sub repositories, there's some modules built in.
Andrew:So it can orchestrate across those bounds now.
Ajay:That's that's.
Andrew:And still, I was basically like, it can still be one project.
Ajay:So take my money.
Andrew:I put that in first.
Andrew:I was like, okay, like.
Andrew:I see the merit.
Andrew:I'm going to add this in from the beginning because I thought like, this is a pretty
Andrew:big architectural decision.
Andrew:Like this might mess some things up.
Ajay:Yeah.
Ajay:I think especially when dealing with spec generation upfront, how do I know which,
Ajay:where that spec applies?
Ajay:If I am multi multi-repository, which I think a lot of organizations are and a lot
Ajay:of individuals I am, I mean, maybe, maybe I'm crazy.
Ajay:I I'm not the monorepo guy.
Ajay:There is a whole, there's a whole thing about like monorepos out there.
Ajay:So there's probably.
Ajay:Monorepo developers out there who are going to be like, I don't care.
Ajay:What do you, what do you, why do you, why do you care about that?
Ajay:You know, get good, you know, or something.
Ajay:And I'm going to be like, no, no, I am.
Ajay:I am multi-repo please.
Andrew:Like my deterministic checks never fail.
Ajay:Yeah.
Andrew:And they're super fast.
Ajay:They're already paralyzed.
Andrew:We're not checking anything.
Andrew:It's already perfect.
Andrew:My intuition.
Ajay:I, I think, I think, uh, I, I personally feel that way.
Ajay:There may be other trains of thought.
Ajay:Um, though I will still say this, even if you're doing monorepo, if you have a
Ajay:dependency you're pulling from, let's say that you actually needed to make a change
Ajay:in some kind of crypto cryptography authentication library that you're using, that's
Ajay:managed by your company or that you want to be a contributor in.
Ajay:Yeah.
Ajay:The minute that you start dealing with any of those dependencies, you have to pull
Ajay:that repo in as well to understand what it's doing.
Ajay:And then you can actually build a spec sheet on it correctly.
Ajay:If you assume that you're going to be able to build a single spec sheet to make
Ajay:changes that are cross, uh, repo, uh, good luck.
Andrew:Well, we'll see if Ricker can do it.
Ajay:I, I, I mean, just, just pulling the repos in, I think starting there is important.
Andrew:Yeah.
Andrew:But yeah, it, it, it is now aware that that could be a case of it needs to work
Andrew:with.
Ajay:Yeah.
Ajay:I, I, and I'm excited to try it for that reason.
Ajay:And I, uh, yeah, I am personally, um, I like to manage my things by splitting them
Ajay:up.
Andrew:Yeah.
Ajay:Organized units.
Ajay:Uh, each module, ideally the way I would build it as each module is its own repo.
Ajay:If it's big enough.
Ajay:If there's a logical separation where you do multiple modules in one repo, totally
Ajay:makes sense.
Ajay:If it is like they're logically grouped together, if I'm doing like 10 things in
Ajay:authentication, I'm not spending up 10 authentication repos, but if I'm building 10
Ajay:different business unit kind of capabilities, like I would put economy on its own, I
Ajay:think in this example of Luxwander, I would put it because I might even reuse the
Ajay:economy module in the future.
Ajay:Let's say for a different iteration.
Ajay:Yeah.
Andrew:And maybe phase two, we, we might just refactor it, build it that
Andrew:way because I think for long-term maintenance, it would benefit greatly without
Andrew:having, you know, collisions happening everywhere.
Andrew:Once we change something.
Ajay:Um, I will also say I, this is a slight form of over-engineering.
Ajay:There is definitely an aspect of like, you don't need to do this if you're trying to
Ajay:solve a simple problem.
Andrew:I don't know.
Andrew:600,000 lines of code.
Ajay:Okay.
Ajay:Phase one.
Ajay:Yeah.
Ajay:See, that is not a simple problem.
Andrew:That is not a simple problem.
Andrew:I'm beginning to see it.
Andrew:I was like, okay, because when you explained it to me, like last week, I was like,
Andrew:okay, if you change something within here, it's not going to affect anything else.
Ajay:Yeah.
Andrew:Well, at least it shouldn't.
Ajay:It shouldn't, but then you can fix it.
Ajay:Yes.
Ajay:You're like the, the separation exists.
Ajay:It shouldn't affect.
Andrew:Yep.
Ajay:And, and I think that's my take on it is, um, the tiers are exciting here again,
Ajay:because if the simple question from the AI or from rigor could be is like, wait,
Ajay:you're trying to do something really simple.
Ajay:Why do you have multiple repositories?
Ajay:Your tier expectations, tier one or tier, tier five.
Andrew:So I'm, I'm hearing even though the user can select it.
Ajay:Yeah.
Andrew:The performance sanity check.
Ajay:Yeah.
Ajay:Yeah.
Ajay:I know a hundred percent, right?
Ajay:Like I'm, why are you doing this?
Ajay:Yeah.
Ajay:Should be a simple question.
Ajay:Are you sure you should be doing this?
Andrew:Maybe that will be the third, the second question after you put in the choice.
Andrew:Are you sure?
Andrew:You want to make, do you want 20 repositories for this?
Ajay:Why?
Ajay:I mean, that that's, and it should ask me that question because that's, again, it's,
Ajay:it's just like, it's like Ajay, why are you doing this?
Ajay:Um, and those, those are, I think, uh, the getting into the spec side of things
Ajay:before you do the spec, if you know, as you said, multi repo, mono repo, if you
Ajay:support both questions become relevant, the tiers become even more interesting
Ajay:because you're like, yeah, sure.
Ajay:Like you're, you want to do tier one.
Ajay:You want to spin up something.
Ajay:You want to, you want to launch a spacecraft.
Ajay:You should isolate, you should split them up from the get go because your
Ajay:expectations are super high.
Ajay:Um, but if you're, you know, if you're, if you're going to start booking tennis, uh,
Ajay:you know, court reservations, uh, yeah, just use one repository.
Ajay:Come on.
Ajay:What are you, what are you doing?
Andrew:Yeah.
Ajay:Uh, yeah.
Andrew:Sounds, sounds like someone figured it out.
Ajay:Yeah.
Ajay:Yeah.
Andrew:I, uh, it, it's funny as, as, uh, you mentioned all of this, I kind of was zooming
Andrew:out in my head.
Andrew:Mm-hmm .
Andrew:On the bigger picture for rigor.
Ajay:Mm-hmm .
Andrew:Right.
Andrew:It's like, uh, we haven't thought, talked much about
Andrew:the actual design documents yet.
Ajay:Oh yeah.
Ajay:Okay.
Andrew:Like, like that part of rigor, there's actually no feature set for that.
Ajay:Okay.
Andrew:Like right now it's like, it will take in whatever the person writes.
Ajay:Mm-hmm .
Andrew:Right.
Andrew:And so I haven't actually considered that failure mode yet.
Andrew:Well, what if the.
Andrew:The, the, the, the design documents, one little prompt, like what's going to happen
Andrew:from here, right?
Andrew:Like I assume the model will take over and start filling in all the gaps on its own.
Ajay:That I, I, okay.
Ajay:Personally, I, I will come back and say the best experience I've had in those
Ajay:scenarios is opinionated default exists, but verified with the user kind of thing.
Ajay:So you're just like, at the end of the day, like I can take a bunch of opinion and
Ajay:defaults.
Ajay:Actually.
Ajay:I also ask my models to give me opinion and defaults because a lot of times.
Ajay:I don't care about every little detail.
Ajay:Yeah.
Ajay:I have run into one out of four, one out of five things.
Ajay:I do see them like, oh, oh, oh, oh, hold on.
Ajay:Hold on that, that one right there.
Ajay:Change that.
Ajay:That is not what I want.
Andrew:That is something different.
Ajay:Yeah.
Ajay:Um, I, I think that approach of opinionated defaults with a clear review process,
Ajay:easy review process with the user in some way, uh, I like to do something nowadays
Ajay:where I just, uh, self-host like a little app and, you know, like, uh, local server,
Ajay:which hosts a commentable, uh, markdown file in the browser for me, you know, the
Ajay:codex, uh, Claude will do this for you really easy.
Ajay:Um, the idea is that now I gives me, you know, like the specs or whatever it is that
Ajay:is giving me and I can go and be like, I can leave comments.
Ajay:I'd be like, no, yes.
Ajay:Terrible, you know?
Ajay:Um, I, I, I like that idea of like, you need some way to get that buy off, right?
Ajay:Like at the end of the day, there is, it's still a human.
Ajay:Yeah.
Ajay:Running their project.
Ajay:They should at least know what level, like, uh, it's kind of like you're bubbling
Ajay:again, a software engineering analogy, you're, you're bubbling up the most important
Ajay:decisions, the key decisions to, uh, you know, leadership to, uh, to, you know,
Ajay:like, uh, to your boss and the people who are going to fire you.
Andrew:And that, and that's why rigor doesn't have anything on the design side, because
Andrew:that is the part where the human's supposed to have a lot of authority over.
Ajay:I see.
Ajay:Yeah.
Andrew:Yeah.
Ajay:Sorry.
Ajay:I was also just.
Ajay:Yeah.
Ajay:I, I, I, I totally can get behind that.
Ajay:Yeah.
Ajay:I think so.
Andrew:Yeah.
Andrew:If they want to have a lot of opinionated default, they can't just put in a one
Andrew:sentence design document in.
Ajay:Yeah.
Ajay:Yeah.
Andrew:And I, I'm assuming it'll still work just fine.
Andrew:I, I just might not be exactly what they want.
Ajay:That is sometimes as good.
Ajay:Sometimes getting that information ahead of time is all you really wanted.
Andrew:Yeah.
Andrew:Yeah.
Andrew:I think it is, I guess on that.
Andrew:It's really easy to over.
Andrew:And over engineer things with all these tools.
Ajay:Yeah.
Ajay:I'm, I'm actually curious now.
Ajay:I'm, let me ask you an interesting question if I may, a particular use case that I
Ajay:just thought of is my single line prompt is launch a rocket into space
Ajay:and my tier tier is tier five digital handyman.
Andrew:Well, it's not going to be human rated.
Andrew:That's for sure.
Ajay:Well, how, how does it, you know, will, will, will the model tell it will rigor be
Ajay:like, Oh, it's okay.
Andrew:Well, I, I am not sure what it would say, because I guess
Andrew:this rocket is in the physical domain.
Ajay:Yeah.
Ajay:Well, right.
Andrew:So this workflow is meant for purely coding.
Ajay:Okay.
Ajay:Okay.
Ajay:Yeah.
Andrew:So I, I'm sure it's going to spit something out.
Ajay:Okay.
Ajay:How, how about this?
Ajay:Um, help me create a, um, interface for identifying, uh,
Ajay:cancer in images.
Ajay:Digital handyman.
Andrew:That's interesting.
Andrew:Um, I think it could do that.
Ajay:Digital handyman.
Andrew:It's, it's, it's not meant to, it's going to show you a prototype.
Ajay:Okay.
Andrew:Yeah.
Andrew:I, I think it could do that.
Andrew:Yeah.
Ajay:And then the disclaimer will be like, ah, you didn't give me enough money.
Ajay:You got a prototype.
Ajay:You didn't give me enough tokens.
Ajay:You, you chose tier five.
Ajay:This is a prototype.
Ajay:The disclaimer literally on the top will be like, uh, you know, cancer screening,
Ajay:uh, tools, uh, prototype.
Ajay:Yeah.
Ajay:This is okay.
Andrew:Yeah.
Andrew:I, I think it would, I think it would be able to make something.
Andrew:Yeah.
Andrew:It's, it's just, I'm sure it makes something with the rocket prompt.
Andrew:I'm just like trying to translate that into what a program would be.
Andrew:And I was like, well, there's not going to be a program for that.
Andrew:It's going to come up with a cyber security warning.
Andrew:Uh, yeah, that's, that's probably, that's probably, it's going to be like, okay,
Andrew:this person's going into liquid rockets.
Ajay:Yeah.
Andrew:Uh, stop.
Andrew:We're not going to let them make a missile today.
Andrew:I think that's actually, that's probably what's going to happen.
Andrew:And that's when you get the Chinese models.
Andrew:Oh my gosh.
Ajay:Oh boy.
Ajay:Um, well, you know, you better be self-hosting those because whoever you are, you're
Ajay:thinking, but it's, it's funny.
Andrew:Those are less censored.
Ajay:Oh yeah.
Ajay:I, I, it's, it's an interesting one.
Ajay:I mean, uh, some would call it censoring.
Ajay:Some would also call it just safety guardrails.
Ajay:The, uh, the question becomes is, uh, yeah, yeah.
Ajay:Uh, are we more intelligent or are we acting?
Ajay:Now?
Ajay:Or is the eye acting as I, as usual, Andrew?
Andrew:Hmm.
Andrew:I know I've had varying answers over the several podcasts we have done already.
Ajay:Yeah.
Andrew:Published or not.
Ajay:Yeah.
Andrew:That's, that's, that's fair.
Ajay:There have been varying answers.
Ajay:Yes.
Andrew:Um, at this time I would say that
Andrew:it is intelligent on the tasks you give it.
Ajay:As long as you're exact.
Andrew:Just like, Yeah.
Andrew:With the incidents with, you know, Claude.
Ajay:Yeah.
Andrew:Anthropic and open AI with the.
Andrew:Yeah.
Andrew:Breaking out of their sandboxes.
Ajay:Yeah.
Andrew:They were told to do that though.
Ajay:They were, they were told to solve a problem.
Ajay:And then the way that they went about solving that problem, including break bro,
Ajay:breaking out of their sandbox.
Andrew:Yeah.
Andrew:So they fulfilled their objective.
Andrew:They were essentially told to do it.
Andrew:Yeah.
Andrew:But if that's still required a human direction, a human prompt,
Andrew:so I would say at this time, I would not call it.
Ajay:I would call it intelligence and just intelligent and then just intelligent.
Ajay:So, uh, the, the, maybe the question, uh, it's, it's an, it's an observation.
Ajay:I'm, if I may make is then, uh, uh, as long as there are intelligent questions being
Ajay:asked, it is intelligent.
Andrew:Say that one more time.
Ajay:As long as a questions, as long as the task, as long as the direction, the drive,
Ajay:the driver is intelligent.
Andrew:Even then, I'm not sure if they need to be intelligent.
Andrew:I just think that they need to, because I I'm of the belief that, so what's
Andrew:interesting is like, you know how there's agents steering, right.
Andrew:And we can steer the agent closer to the objective.
Andrew:If we see it go off track as the, you know, the, the windows gone.
Ajay:Right.
Ajay:Yeah.
Ajay:Yeah.
Andrew:I think that even if someone maybe was not familiar with these
Andrew:tools, since it is using just plain English, if they were curious
Andrew:enough and said, well, how do I do this?
Andrew:How do I do that?
Andrew:I think the model can steer the human actually to use them properly.
Ajay:As, as long as the human is steerable.
Andrew:Yes.
Andrew:So that's, that's another thing there.
Andrew:Um, I, I guess the answer to your question is, I think it does heavily depend on
Andrew:who's in the seat, but I think it's always has.
Andrew:And you know, it's, have you ever, ever heard of a, uh, human in seat
Andrew:problem or something like that?
Andrew:Yeah.
Ajay:If you take the human out of the seat, you're going to have a problem.
Ajay:It might be better.
Andrew:Yeah.
Andrew:Yeah.
Andrew:I think that is thankfully not going to go away for a while.
Ajay:That's true.
Ajay:Yeah.
Andrew:I don't think all of our jobs are at risk right now.
Ajay:Ah, there.
Ajay:Yes.
Ajay:There we go.
Ajay:That is, that is a more concrete, uh, yes.
Ajay:Way of putting it.
Ajay:Yeah.
Andrew:I think that people need to start learning how to do these things differently, but
Andrew:adaption is very human.
Ajay:That is, that is true.
Ajay:So, uh, the ability to adapt is true.
Ajay:Yeah.
Ajay:Actually, that's a really interesting one because one of the things that we know for
Ajay:now is the models are not necessarily adapting.
Ajay:They are just getting more intelligent with training so far.
Ajay:Yeah.
Ajay:Um, so far.
Andrew:And they're being told to do more specific things.
Ajay:Yes.
Ajay:And there has been some research from Anthropic that has pointed to that the models
Ajay:we, we talked about this briefly, but that the models are creating spaces in their
Ajay:brains where they're becoming more creative.
Ajay:Yes, yes.
Ajay:Um, but that.
Ajay:Yeah.
Ajay:As far as I understand that still lives on that particular compute instance.
Ajay:Yeah.
Ajay:So once that compute instance gets either turned off, uh, or maybe you can, you can,
Ajay:you know, store the data somewhere and maybe pick it back up.
Ajay:Uh, but it is basically if that data is deleted, it's gone.
Ajay:I mean, same thing with humans.
Ajay:If you even pass away, you're talking about it that way.
Ajay:So as a species, we get more intelligent by sharing our
Ajay:learnings, which is, which is what we're doing here, I guess.
Ajay:So maybe, maybe we're, we're assisting human adaption, uh, in this form.
Ajay:Uh, you know, uh, delusions of grandeur, uh, you're welcome.
Andrew:Um, but yes.
Ajay:Uh, so, uh, yeah, that's, that's a great, that's a great point.
Ajay:I, it is, it is, they are intelligent in the models are intelligent in what they're
Ajay:doing as long as they get the direction they need, they're not necessarily in the
Ajay:driver's seat and they, they can help a, uh, a, a, a willing driver, uh,
Ajay:you know, adapt a direction to an intelligent direction.
Ajay:It may not always happen.
Ajay:Uh, and it is, as you said, based on human and seed problem as well.
Ajay:And yeah, so sounds like, uh, intelligence, it, it, it is still acting.
Ajay:It feels like it's acting still.
Andrew:I do think it is.
Andrew:I think it is, um, with all it knows, it still
Andrew:needs human input.
Ajay:Yeah.
Ajay:Yeah, I, I, I agree.
Ajay:Yeah.
Ajay:Yeah.
Ajay:Well, that's it for this week for this episode.
Ajay:Um, yeah, for the, for our assistant that is listening to us, I'm sorry.
Ajay:We are very sorry.
Ajay:We keep questioning your intelligence, but, uh, on, on the other note, that was the
Ajay:outro for our, uh, you know, uh, episode.