Hacker News new | ask | show | jobs
by millboh 2528 days ago
That's a good point. Actually we think of this tool as a collaboration tool which enables non technical users and data engineers to share this visual DAG and work together. The Apache Beam runners we use behind the scene have a Query planner to optimize chained queries . However you're totally right . This can't help a non technical users to write messy queries. The visual DAG should however helps them to split a complex query into simpler ones.