Experienced Software Engineer - Machine Learning Infra
Plaid
Software Engineering
United States
Posted on Nov 12, 2024
We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Washington D.C., London and Amsterdam.
The Plaid Machine Learning Infrastructure (ML Infra) team is responsible for creating and maintaining the foundational systems, tools, and processes that enable efficient, scalable, reliable, responsible and secure machine learning workflows for Plaid ML practitioners. The core ML Infra components and responsibility covering core areas but not limited to these:
1. Feature Store Development: Developing a robust and efficient Feature Store platform customized for Plaid use cases to streamline feature engineering for both batch and real-time streaming features.
2. Model Serving and Deployment: Developing and maintaining infrastructure and tools for deploying models into production with observability and low latency.
3. Data Exploration and Experimentation: Using both vendor-based solutions, like Sagemaker Notebook and in-house/open-source solutions, like ML-Flow and Trino, to support early model experimentation, model version monitoring, and tracking
4. ML Data Cost: Developing creative framework to forecast, monitor, attribute and track the cost for end-to-end ML development life cycle.
You will lead the machine learning Infra team to design and develop Feature Store Platform for Plaid. You will support the team to set the multi-year technical strategy and roadmap. You will maintain current infrastructure for ML developer environment, ML model training, ML data feature creation/serving, ML model hosting/serving, ML model management, ML model service monitoring, vendor services (Tecton, OpenAI, Sagemaker and etc), and the CI/CD pipelines/infrastructure deploying all assets.
You will also help pioneer on early foundation of LLM AI platform for Plaid. Working with MLEs and product engineers to support different ML-based product lines and working with other Data Platform engineers to continuously improve overall Plaid data ecosystems.
Responsibilities
- Passionate about ML infrastructure and how it can solve real-world problems, especially in fintech world.
- Both leading and hands-on contribution to build the Feature Store for entire Plaid.
- Shape the future of ML world for Plaid.
- Technical leadership in engineering excellence and mentorship.
Qualifications
- 8+ years of software engineering experience.
- Extensive hands-on software engineering experience, with a strong track record of delivering successful projects within the ML Infrastructure or Platform domain at similar or larger companies.
- Deep understanding of high-quality ML Infrastructure systems, including Feature Stores, Training Infrastructure, Serving Infrastructure, and Model Monitoring.
- Experience in developing Feature Store system.
- Strong cross-functional collaboration, communication, and project management skills, with proven ability to coordinate effectively.
- Demonstrated leadership abilities, including experience mentoring and guiding junior engineers.
- [Nice to have] Experience with AWS Sagemaker, Tecton, or LLM training/serving infra/platform.
Our mission at Plaid is to unlock financial freedom for everyone. To support that mission, we seek to build a diverse team of driven individuals who care deeply about making the financial ecosystem more equitable. We recognize that strong qualifications can come from both prior work experiences and lived experiences. We encourage you to apply to a role even if your experience doesn't fully match the job description. We are always looking for team members that will bring something unique to Plaid!
Plaid is proud to be an equal opportunity employer and values diversity at our company. We do not discriminate based on race, color, national origin, ethnicity, religion or religious belief, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, military or veteran status, disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state, and local laws. Plaid is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance with your application or interviews due to a disability, please let us know at accommodations@plaid.com.