Lorebooks?

I know its not done and finished, if it ever even be implemented into Janitor. But how would it theoretically work?

I know that creators will get plenty of benefits being able to lower their tokens with it. As you can split small shards instead of having these chunks of tokens fulling up your memory tokens.

But where example, would this chunk of tokens be within this lorebook? They still need to add a seperate space for all these tokens to be in. As it need to be completely separate from the actual character itself.

Besides that, how will the lorebook interacting actually work like? Will it consume tokens to analyse those specific things that it's gonna take out from the lorebook and put into the text? Or will it merely kind of analyse it without actually consume any tokens? Perhaps it counts as inner tokens?

With that out of the way, I am hyped for this new function to come out as fast as possible. Basically almost 'unlimited' chats without the chat forgetting things finally.