Perplexity

Revision as of 22:42, 31 January 2023 by Alpha5 (talk | contribs)

In order to not have articles being flagged as AI generated content. The text should have high perplexity.

Perplexity measures the amount of information contained in a text or the complexity of the text. Despite the high redundancy of natural language, which allows us to communicate effectively even in noisy environments, some information can still be lost without compromising overall understanding. However, external factors such as alliteration, which adds an additional layer of meaning, can contribute to high perplexity that AI may not be able to recognize.

AI, based on probabilistic models, struggles with text that contains high variability in terms of word specificity, such as legal documents that require precise use of specific keywords and phrases.

Generative AI for text operates by predicting the most likely word to follow a given word. In a text with perfect perplexity, the AI would always make incorrect predictions.