How to Train LLMs on your Knowledge Base Data | by Stefan Kojouharov | Apr, 2024

Experiments in Organizing Information for Optimal Retrieval

Originally Published on my Substack

So recently, I have been experimenting with knowledge bases, and how information is structured is vital.

In some sense, it directly relates to the context and overall meaning. It also makes it easier for LLMs to answer questions accurately and reduces hallucinations.

And so we created a few experiments that you can play with and test yourself.

But first, why does information structure matter?

Imagine a library. One room has books strewn everywhere, titles mixed up, and no discernible order. In another room, the books are organized by subject, then by author, then by publication date. Which room would help you find the book you want more efficiently?

LLMs are similar. The way knowledge is presented and organized dictates not only their understanding but also their output.

Thank you for reading AI for Humanity with Stefan Speaks. This post is public so feel free to share it.