Senior Software Engineer - Data Infrastructure
Applied Compute
Location
Sunnyvale
Employment Type
Full time
Department
Data Engineering
About the role
We are looking for infrastructure engineers with expertise in scaling open-source data infrastructure to join the Data & ML infra group. This role will work across the entire data lifecycle (collection, ingestion, storage, querying, retrieval) and work directly with all business units across the company to design and develop both external and internal products. Handling massive volumes of data for Applied Intuition's platform needs is a critical area and we are looking for someone who can be hands-on in supporting our data products and verticals across the company. At Applied Intuition, we encourage all engineers to take ownership over technical and product decisions, closely interact with external and internal users to collect feedback, and contribute to a thoughtful, dynamic team culture.
At Applied Intuition, you will:
Scale infrastructure to support all deployment types (cloud, hybrid, on-prem) and across regions
Be involved in the end to end data lifecycle, from the external-facing product to the underlying platform and infrastructure for it
Build features to tune processing pipeline for fast data ingestion and indexing depending on customer's needs and workloads
Enable product workflows that expose performant query interfaces and offer easy-to-use integration hooks
Develop and deploy high-quality software using modern tooling and frameworks, especially open-source technologies
We're looking for someone who has:
Experience with large-scale open source data technologies (Spark, Kafka, Hudi, Flyte, etc.)
Experience with containerization and other modern software development workflows
Knowledge of the open source landscape with judgment on when to choose open source versus build in-house
Nice to have:
Expertise with modern programming languages (Python, C++, GoLang, Scala, etc.)
Experience with other open-source data technologies not listed above
Expertise with Kubernetes
Experience with enterprise software, including on-prem and/or cloud environments
Deep knowledge of data quality, data profiling and cleansing techniques
Compensation at Applied Intuition for eligible roles includes base salary, equity, and benefits. Base salary is a single component of the total compensation package, which may also include equity in the form of options and/or restricted stock units, comprehensive health, dental, vision, life and disability insurance coverage, 401k retirement benefits with employer match, learning and wellness stipends, and paid time off. Note that benefits are subject to change and may vary based on jurisdiction of employment.
Applied Intuition pay ranges reflect the minimum and maximum intended target base salary for new hire salaries for the position. The actual base salary offered to a successful candidate will additionally be influenced by a variety of factors including experience, credentials & certifications, educational attainment, skill level requirements, interview performance, and the level and scope of the position.
Please reference the job posting’s subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the location listed is: $153,000 - $222,000 USD annually.