Big Data Product Engineer – Platforms

The Bigstream Product Engineering team is looking to welcome a new, talented programmer to work as a Big Data Product Engineer for the world’s first hyper-acceleration (CPUs + GPUs + FPGAs) platform for Big Data, Machine Learning and AI workloads. This is cutting-edge technology that uses a powerful combination of acceleration techniques to squeeze every last ounce of performance from each application and from every node in the cluster. Several patents having been granted with more pending. This is a place where you can make a huge difference.

This position will be a key member in building, fine-tuning, and optimizing the performance of Bigstream’s technology stack.

Responsibilities:

  • Develop acceleration solutions for Bigstream
  • Contribute to the full software development lifecycle – design, development, testing, operating in production
  • Communicate effectively within and across teams
  • Operate in an Agile development environment

Requirements:

  • 3+ years of development experience with big data platforms such as Spark, Presto, Hive or Kafka
  • Experience with container technologies with exposure to Kubernetes
  • Expertise in Scala or Java
  • Experience with C++ 11 or higher is a plus
  • Experience with compilers is a plus
  • Experience with cloud APIs (e.g., a public cloud such as AWS, Azure, GCP or an advanced private cloud such as Google, Facebook)
  • Good knowledge of Linux OS
  • Experience with API development
  • Good knowledge of SQL
  • Experience with Continuous Integration/Continuous Deployment frameworks

In addition to your resume, please answer the following questions:

  1. Have you worked on data engineering projects using Apache Spark, Hive, and/or Presto? If yes, please provide the amount of experience.
  2. Have you worked with Apache Spark, Hive, and/or Presto internals? If yes, please provide the amount of experience.
  3. On a scale of 1 – 10, please rate your proficiency in Java and/or Scala.
  4. Have you contributed to any open source projects? If yes, please provide the code repositories.

Bigstream welcomes people from diverse backgrounds and perspectives in all functions of the business.

Hiring Process

  • Step 1

    After you apply, a recruiter may reach out to you for an introductory call.

  • Step 2

    If your background is a match for the role, a phone interview may be scheduled.

  • Step 3

    If you continue through the process, you will come onsite.

Application