PORTFOLIO JOBS

JOIN ONE OF OUR COMPANIES!

Staff AI Scientist (West, Remote or Hybrid)

Fiddler AI

Fiddler AI

Software Engineering, Data Science
Palo Alto, CA, USA
Posted on Friday, June 14, 2024
Our Purpose
At Fiddler, we understand the implications of AI and the impact that it has on human lives. Our company was born with the mission of building trust into AI. With the rise of the internet, trust in AI has been degraded by a plethora of issues like spam, fraudulent transactions, hate speech, and online abuse. Fiddler enables organizations to get ahead of these issues by building trustworthy, transparent, and explainable AI solutions.
Fiddler partners with AI-first organizations to help build a long-term framework for responsible AI practices, which, in turn, builds trust with their user base. Data Science, MLOps, and business teams use Fiddler AI to monitor, explain, analyze, and improve their AI solutions to identify performance gaps, mitigate bias, and drive better outcomes. Our platform enables engineering teams and business stakeholders alike to understand the “why” and how behind model outcomes.
Our Founders
Fiddler AI is founded by Krishna Gade (engineering leadership at Facebook, Pinterest, Twitter, and Microsoft) and Amit Paka (two-time founder with acquisitions by Samsung and PayPal and product roles at Expedia and Microsoft). We are backed by Insight Partners, Lightspeed Venture Partners, and Lux Capital.
Why Join Us
Our team is motivated to unlock the AI opaque box and help society harness the power of AI. Joining us means you get to make an impact by helping reduce algorithmic bias and ensure that models in production across many different industries are transparent and ethical. We are an early-stage startup and have a rapidly growing team of intelligent and empathetic doers, thinkers, creators, builders, and everyone in between. The AI and ML industry has a rapid pace of innovation and the learning opportunities here are monumental. This is your chance to be a trailblazer.
Fiddler is recognized as a pioneer in the field of AI Observability and has received numerous accolades, including: 2022 a16z Data50 list, 2021 CB Insights AI 100 most promising startups, 2020 WEF Technology Pioneer, 2020 Forbes AI 50 most promising startups of 2020, and a 2019 Gartner Cool Vendor in Enterprise AI Governance and Ethical Response. By joining our brilliant (at least we think so) team, you will help pave the way in the AI Observability space.
The Opportunity
In this role, you will be able to make a real impact on the safety of large language models and generative AI solutions across different verticals. You will work on the cutting edge of envisioning and building new types of tools and algorithms to monitor, explain, and improve such models.

What You'll Do

  • Develop and tune novel ML models, metrics and other techniques to classify and explain ML models and LLM prompts/responses
  • Setup processes around model building, deployment and MLOps to ensure health and performance of these artifacts in production
  • Establish thought-leadership by following up around state of the art research in responsible AI and Gen AI, experiment with and benchmark novel techniques related to model monitoring, model explainability, model fairness etc. Identify ways to leverage some of these into product offerings and guide efforts to pursue these
  • Develop deep product understanding. Think critically and creatively to recognize common customer challenges and craft powerful generalizable solutions.
  • Support Sales and Customer Success teams to address some of the more advanced customer questions and asks that require deep understanding of novel ML use-cases. Provide expert guidance to customers with challenging explainability uses.
  • Author white papers, blog posts, and develop technical content related to ML and the Fidder platform.

What We're Looking For

  • MS/PhD in Computer Science, Data Science or equivalent discipline
  • 7-8 years of industry experience
  • Proficiency with Python, ability to write production grade code and support ML model deployments that can handle live workloads
  • Experience working with and tuning ML models in production (tuning performance, latency, model size / quantization)
  • Experience with common LLM frameworks (Langchain, Llamaindex, RAG, HuggingFace, and eval frameworks like Ragas or Presidio)
  • Ability to conduct deep analysis and benchmarking of models and methods
  • Experience debugging and troubleshooting production systems
  • Preferably Hybrid with at least 1 day a week in the Palo Alto office. Will consider full remote for a strong candidate on the West Coast

Nice To Have

  • Experience speaking at industry events
  • Experience working with Computer vision models
  • Experience with data visualization and dimensionality reduction techniques
  • Knowledge of infrastructure management (AWS / Google Cloud, Kubernetes, or equivalent on-premises technologies)
The Pay Range in San Francisco California is $180,000 - $215,000. Preferably Hybrid with at least 1 day a week in the Palo Alto office. Will consider full remote for a strong candidate on the West Coast.
The posted range represents the expected salary range for this job requisition and does not include any other potential components of the compensation package, benefits, and perks previously outlined. Ultimately, in determining pay, we'll consider your experience, leveling, location, and other job-related factors.
Fiddler is proud to be an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.