Sr. Software Engineer, AI
Location:
Brooklyn, NY (Hybrid)
Experience:
5+ years in ML/AI Engineering
About the Role
We're looking for a Sr. Software Engineer, AI to own the machine learning and AI efforts across our platform. You'll work directly with our CTO to define and build AI-powered features that will shape Agent North, our customer-facing AI assistant, as well as drive advancements in cost and usage forecasting, financial modeling, and multi-service provider rightsizing.
This is a hands-on, senior-level role, perfect for someone who thrives in a fast-moving startup environment, has built ML-powered products before, and is comfortable taking a project from 0 to 1. If you're a high-energy, motivated engineer passionate about LLMs, cloud infrastructure, and deploying AI systems at scale, we'd love to hear from you.
What You'll Do
- Design, build, and deploy ML models for cloud automation and optimization.
- Work with LLMs, fine-tuning, optimizing, and integrating them into our platform.
- Develop AI chatbots and customer-facing AI solutions to automate and enhance cloud finance management.
- Ensure security and compliance in AI model deployment, implementing best practices for secure AI infrastructure.
- Set up and maintain ML infrastructure across GCP, AWS, and Azure, optimizing for scale and efficiency.
What We're Looking For
- 5+ years of hands-on experience in ML, AI model development, and infrastructure deployment.
- Experience deploying ML models at scale on AWS (cloud-based, distributed systems, or edge deployments).
- Strong programming skills in Python and SQL, with demonstrated ability to write production-quality code.
- Proficiency with ML frameworks and the judgment to determine when and where to apply them based on data complexity.
- Ability to move fast and iterate, taking ideas from concept to production.
- Comfortable with Git.
- Excellent communication skills, with the ability to clearly convey progress, methodology, solution approach, and results.
Nice to Have
- Experience working in a startup.
- Experience working with financial cloud data across GCP, AWS, or Azure, or complex large financial and logging datasets.
- Experience deploying models in Amazon Bedrock or on AWS.
- Experience deploying infrastructure with Terraform.
- AWS technical certification (or equivalent cloud certification).
Work Setup
Hybrid role based in New York City, with an office in Dumbo, Brooklyn.
Benefits
- Unlimited PTO
- 16 weeks of paid parental leave (birthing parents receive an additional 4 weeks at 50% pay)
- Two company-wide breaks per year: one around Labor Day and one at the end of the year
- Aetna Medical PPO plan with the majority of the premium covered by North
- Dental and vision insurance
- Flexible spending account (FSA) for health expenses and commuter benefits
- 30 day sabbatical every 4 years
Compensation
$230,000 β $270,000 base salary, depending on experience Equity included
If you're a ML engineer who loves building AI-powered products, deploying at scale, and shaping the future of cloud financial automation, we'd love to hear from you.
If you're a ML engineer who loves building AI-powered products, deploying at scale, and shaping the future of cloud financial automation, we'd love to hear from you.
