Q Have you found differences in having one model just generate the conversation and then using text-to-speech to kind of fake two people? Or, like, are you actually using two different kind of system prompts to, like, have a conversation step by step? I'm always curious, like, if persona system prompts make a big difference or, like, you just put in one prompt and then you just let it run?
A I guess, like, generally we Use a lot of inference, as you can tell with like the, the spinning thing takes, takes a while. Um, so yeah, there's definitely like a bunch of different things happening under the hood. We've tried both approaches and they have their sort of drawbacks and benefits. I think that that idea of like questioning, like the two different personas, like persists throughout, like whatever approach we try, it's like, there's a bit of like imperfection in there. Uh, like we had to really lean into the fact that like, To build something that's engaging, like it needs to be somewhat human and it needs to be just not a chatbot. Like that was sort of like what we need to diverge from is like, you know, most chatbots will just narrate the same kind of answer, like given the same sources for the most part, which is ridiculous. So yeah, there's like experimentation there under the hood, like with the model to like, make sure that it's spitting out like different takes and different personas and different sort of prompting each other is like a good analogy, I guess.
AI assessment note: “We've tried both approaches and they have their sort of drawbacks and benefits.”