AI engineering glossary · NLP embeddings
What is text normalisation?
Text normalisation (also called Text normalization): Converting text into a consistent standard form before further processing, for example lowercasing, removing extra spaces, expanding contractions or converting numbers and dates to a fixed style. It reduces meaningless variation so equal things look equal to the model.
Text normalisation: an example
" Won't STOP " is normalised to "will not stop".
Related terms
More NLP embeddings terms
Where you learn it
Text normalisation is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.