Why is the AI generating gibberish/repeating itself?

Why is the AI generating gibberish/repeating itself?

Why is the AI generating gibberish/repeating itself?

Sometimes the AI will generate gibberish text that may look something like this:

image

There are several possible reasons for this, though most are related to the AI Model settings (features that are currently exclusively modifiable by premium users). Some things you can try to rectify this are:

  • Reduce the temperature (previously known as Randomness). For the Dragon model, it’s known that a temperature of about 1.0 or more causes sentence structure to break down.
  • Reduce repetition penalty. The base model of Griffin is known to be quite sensitive to this, so having it too low may cause it to begin repeating itself. Having it too high on the other hand may cause it to begin spouting incoherent sentences.
  • Reduce Top-K and Top-P. This will reduce the amount of options the AI has to pick from when generating text, so ideally this would make your generations more coherent - though this may come at the cost of creativity.

Regardless of your settings, sometimes the AI will latch onto a certain pattern in your story whether that be a specific thing a character says or does, or a specific way the story is being written. In these cases, it can cause a more subtle kind of repetition and make your story feel a lot more boring to read. The best thing to do in these situations if tweaking AI Model settings doesn’t work is undo to the point where this behavior started and attempt to continue in a way that avoids this behavior.

💠
image

© Latitude 2022