XML Tag
topic on 2 shows · 2 statements across 2 episodes
the Y Combinator Startup Podcast
Latent Space
2 statements about XML Tag, every show
Diana Hu: XML Prompts Produce Better Output Due to Post-Training RLHF
“We found that it makes it a lot easier for LLMs to follow, because a lot of elements were post-trained in RLHF with kind of XML type of input, and it turns out to produce better results.”
Schluntz: JSON Escaping Overhead Degrades LLM Performance Across the Board
“Like if you're trying to output a code in JSON, there's a lot of extra escaping that needs to be done. And that actually hurts model performance across the board. Where versus like if you're in just a single XML tag, there's none of that sort of escaping that …”