Generating Misspelled Word Lists
Why would anyone need more misspelled words?
Natural Language Processing techniques require lots of data for testing. Improvements are often directly related to improvements in training and testing data. Spelling mistakes are predictable, and therefore it is possible to programmatically generate lists of misspelled words from just the original word. I have done just this and put it in an open source library called Misspeller.
How would I use misspelled word lists?
If we were testing, for example, a spelling suggestion tool, then we could rate our algorithm by how high the correct spelling of a word ranks against all of its misspelled versions. A Mean-Squared Error measurement would give us a great numerical rating of how good our technique is vs other techniques. Don't just go with an algorithm that "feels" right, quantify and compare each algorithm and choose the best one.
Andrew Johnson
Open Source:
Other Platforms
Published Books:
Books that I am reading:
Top Referrers:
- Google Search
- DuckDuckGo Search
- Sogou Search
- Bing Search
- Baidu Search
Tools:
- Perplexity 😵 Modelling Language
- A Categorical view of Typed Lambda Calculus with flexible Soundness Guarantees
- JLPT Flash Cards
Weblog:
- Unifying Input Experience from Desktop and Mobile
- Directed Graphs, Tensors, and Neural Networks in Rust
- Speech to Text Facilities in Rust
- Compiling Word Lists from Wiktionary Content
- RDXL Static Site Generation Template
- Anonymous Enum Types and Polymorphism in Rust
- Rust Smallvec Optimization
- FRU Syntax vs Builder Pattern in Rust
- Using RDXL with Rocket
- Parsing Natural Language with Machine Learning and Ontologies
- General Concepts for Multilingual Programming
- Closures in Rust
- Rust, shared: the mutability checker
- Rust, typed: type states and zero-sized types
- Rust, abstracted: lambda lifting
- Rust, asynchronized: what is a Rust Future?
- Is Rust a purely functional programming language?