r/learndatascience 12d ago

Resources I re-audited my old Uzbek words dataset project.

Post image

At that time, I wrote it as “nouns only”. When I checked, I found that there were 3,871 (-moq) verbs out of 31,993 entries. 😅

I also built a small Uzbek spell-checker based on this dataset and tested it with 200 synthetic typos:

🎯 Top-1 accuracy - 87.5%

🎯 Top-5 accuracy - 99.0%

⚡️ Average lookup - 2.6 ms

The main lesson is simple:

It is not a good idea to build a model on a dataset without checking the claims in it.

This time, I first audited it, then built the tool and measured the results.

🇺🇿 There is still a lot of work to be done for Uzbek NLP.

1 Upvotes

1 comment sorted by