Eric Tome
Apr 19, 2022

--

You’re right, it is cumbersome, but you’ll have to create them if you want to use the Dataset API. I’ve been told by a co-worker that https://github.com/zio/zio-quill is a potential way to get around that, but I haven’t looked into it. If you don’t want to use Datasets you can use the DataFrame API or Spark SQL.

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

--

--

Eric Tome
Eric Tome

Written by Eric Tome

Solutions Architect at Databricks. I love working with data, math, coding, music, soccer, working out, and video games.

No responses yet

Write a response