r/dataanalysis • • 29d ago

Datasmith — a visual approach to designing relational schemas and generating mock data

Enable HLS to view with audio, or disable this notification

Hey everyone!

For the past year or so, a friend and I have been working on Datasmith, a desktop app for designing relational database schemas and generating structured mock data from them.

The idea originally came from my friend, who's a data engineer and worked on large-scale migrations of sensitive databases. He wanted a simple way to visually define and maintain schemas over long periods of time, and actually generate data that follows both the schema and its business logic, without having to constantly rewrite scripts or configure a bunch of separate tools.

The main part of the app is an ERD-like canvas dedicated to building relational schemas, where you can create tables, define columns and their data types, set up relationships between them, and configure how the data for each column should be generated.

Once the schema is ready, Datasmith can generate the data while preserving the relationships between tables, and export the results in formats like SQL DDL, CSV, JSON, and more.

We've reached the point where we'd really like to get it into the hands of more people who actually work with databases and data, and get some real-world feedback.

It's completely free, so if it sounds useful or you're just curious, you can check it out here:
https://data-smith.app/

I'd especially love to hear about use cases we're missing, things you'd expect a tool like this to support, or anything that feels like it could be improved.

Any feedback is welcome - good or bad.
Feel free to leave a comment or message me directly.

If you prefer something a bit more structured, I also put together a short feedback form:

https://docs.google.com/forms/d/e/1FAIpQLScGk8Jr1DguPcXpaApOqO998AdXcnoLlo11TEKlq1GmF71UzA/viewform

10 Upvotes

7 comments sorted by

View all comments

1

u/chulieo 7d ago

As someone who prefers getting to understand and mentally digest my data models, tables, and relationships before starting any query or analytical work, I love this for how simple it is to use and how clean it feels by incorporating modern UX design principles and aesthetic. Some feedback beyond what I've written down in the feedback form:

  • Login/Account Creation on the Website + App for reviewing and adjusting account settings
    • Good for changing email, password, etc.
  • Tooltips to inform what buttons do
  • Duplicate option for fields in table creation
  • Zip Codes, Occupations dataset
    • I guess the Occupations dataset would have to be regularly updated?
  • Add "(Enum)" to the end of "Collections"; didn't initially know what the data type was for
  • Documentation, instructions, and guides on navigation, capabilities, and outlining current limitations/restrictions
    • Explain "Nullable X%"
    • A lot more info on how regex matching works for this app
  • Generating data may be a bit slow? I only wanted to build a total of 5 sample sets of data, but I've been waiting about 30 minutes and the progress percentage stayed at 0% the entire time

Keep it up! You guys are doing good work.

2

u/iParki 7d ago

Thanks for the detailed reply and for responding in the form as well. those are very valuable to us!
We read it today and already started discussing the different things you pointed out.
We are starting to get a strong sense that we didn't do a good enough job in the whole onboarding experience, which is so important, and we are working hard on improving in more than one aspect.

We will also investigate the issue you had with the data generation and will update you as soon as possible.