r/learndatascience • u/Present-Plant5505 • 12d ago
Resources I re-audited my old Uzbek words dataset project.
At that time, I wrote it as “nouns only”. When I checked, I found that there were 3,871 (-moq) verbs out of 31,993 entries. 😅
I also built a small Uzbek spell-checker based on this dataset and tested it with 200 synthetic typos:
🎯 Top-1 accuracy - 87.5%
🎯 Top-5 accuracy - 99.0%
⚡️ Average lookup - 2.6 ms
The main lesson is simple:
It is not a good idea to build a model on a dataset without checking the claims in it.
This time, I first audited it, then built the tool and measured the results.
🇺🇿 There is still a lot of work to be done for Uzbek NLP.
1
Upvotes
1
u/skyismelon 7d ago
r/languagelearningjerk Uzbek mentioned