Lead Data Engineer
Aeva
Software Engineering, Data Science
Bengaluru, Karnataka, India
Posted on Wednesday, October 4, 2023
About us:
Aeva’s mission is to bring the next wave of perception to a broad range of applications from automated driving to industrial robotics, consumer electronics, consumer health, security, and beyond. Aeva is transforming autonomy with its groundbreaking sensing and perception technology that integrates all key LiDAR components onto a silicon photonics chip in a compact module. Aeva 4D LiDAR sensors uniquely detect instant velocity in addition to 3D position, allowing autonomous devices like vehicles and robots to make more intelligent and safe decisions.
Role Summary:
The Data Platform team at Aeva is responsible for maintaining and developing end-to-end data solutions, providing crucial insights that impact operational and strategic functions. We are seeking an experienced Lead Data Engineer to join our dynamic team. IN this role, you will play a critical part in shaping our data infrastructure to align well with the business and engineering objectives.
What you'll be doing:
- Improve data architecture and models according to various operational and analytical use cases for different business units.
- Develop and maintain scalable data models using dbt or similar tools.
- Collaborate with full-stack engineers on internal as well as customer web applications allowing users to interact with the database and S3 data storage.
- Bring up and optimize cloud data warehouse and database assets (schemas, access control, compute clusters, scaling policies) for optimal cost-performance tradeoffs based on business needs.
- Established and maintained robust data ingestion processes from various sources including manufacturing assembly, test and inspection stations, qualification systems, Manufacturing Execution Systems (MES), and internal web applications.
- Establish robust logging infrastructure for all services and servers used by data platform.
What you'll have:
- Bachelor's degree in Computer Science, Engineering, or related field; or equivalent work experience.
- Advanced proficiency in SQL and Python.
- Experience with AWS services including RDS, S3, Lambda, API Gateway.
- 3+ years of experience in using tools like Apache Airflow, Elasticsearch, DBT, Prefect, Apache Spark.
- 3+ years of experience in using AWS services like Lambda; Step functions, CloudWatch, S3, SQS, RDS.
- 3+ years of experience with databases such as MySQL, ProsGres, Snowflake, Redshift, and or DataBricks.
- Experience with serverless architectures for data pipelines.
- Experience implementing and managing robust logging systems to monitor, troubleshoot, and optimize data operations and infrastructure.
- Experience with "infrastructure as code" using tools like AWS Cloud Formation or Terraform.
- Excellent interpersonal, analytical, and problem-solving skills.
- Ability to learn and improve domain experience working with cross-functional teams.
Nice to have:
- Understanding of hardware development/manufacturing business logic.
What's in it for you:
- Be part of a fast paced and dynamic team
- Very competitive compensation