layiq
/la·yiq/adjective
worthy; deserving; fitting; suitable.
A role, opportunity, or path that merits attention, time, and pursuit.
Loading LAYIQ…
Job opportunity
Senior Software Engineer, Apple Data Platform
Cupertino, California
Source: Apple careers · View original posting
- Pay
- $184,700 — $324,800 USD per year
Employer job description
From Apple's posting. “We” and “our” refer to the employer.
We are seeking extraordinary software engineers to work on Apache DataFusion Comet, the open-source accelerator for Apache Spark that Apple created and donated to the Apache Software Foundation. You are passionate about pushing distributed query engines to their limits and getting every ounce of performance out of them, while matching Spark’s results exactly. We are looking for engineers with in-depth knowledge of Spark internals and of related technologies such as Apache Iceberg, Parquet, Arrow, and DataFusion.
You are also excited about working in the open, collaborating with teams across Apple that run Spark at scale and contributing upstream to these open-source communities.
Description
As an engineer on our team, you will advance Apple Data Platform by making Apache Spark faster and more efficient with Apache DataFusion Comet. You will design and implement operators and expressions in a native language on Apache DataFusion and Apache Arrow, extend Comet’s Spark integration across Spark versions, and accelerate reads and writes of Apache Iceberg and Apache Parquet data, all while keeping results identical to Spark’s.