About the role

As a Senior Software Engineer for this role, you will collaborate with the founding team to expand the integration of our custom compiler technology with the internals of leading open-source software for Big Data analytics to drive faster data processing and broader operation coverage.

Your contributions to our core product will directly impact data infrastructure processing 10s of petabytes every day where Xonai is being deployed.

What you will do

• Implement extensible optimizations for various query processing components such as columnar batch processing, data reading, shuffling and data partitioning algorithms.
• Implement code generation targeting Xonai custom DSL to accelerate SQL operations to be supported.
• Run profiling and benchmark tools to draw conclusions on the broader impact of large changes to be incorporated.
• Independently and diligently write, test and deploy production code driven by modern software engineering practices.
• Collaborate with team members to drive new innovations on big data processing lying at the intersection of Big Data and compilers.

What you will bring

• 3+ years of experience working with performance optimization and complex codebases.
• Strong Java and C++ programming skills.
• Experience in navigating through the abstraction layers of large codebases to get down to the relevant details.
• Experience with profiling and debugging tools.
• Strong grasp of computer science fundamentals such as algorithms and data structures.
• Critical thinking and ability to work independently without direct supervision.

Nice-to-haves

• Entrepreneurial spirit and previous experience in early stage startups.
• Experience with Scala.
• Experience with the internals of query processing and optimization.
• Understanding of Big Data file formats (e.g. Parquet, ORC, Avro).
• Understanding of Big Data processing engine internals.