Mgr - Software Eng

About the job

Ally and Your Career Ally Financial only succeeds when its people do - and that’s more than some cliché people put on job postings. We love this stuff! We see our people as, well, people - with interests, families, friends, dreams, and causes that are all important to them. Our focus is on the health and safety of our teammates as well as work-life balance and diversity and inclusion. From generous benefits to a variety of employee resource groups, we strive to build paths that encourage employees to stretch themselves professionally. We want to help you grow, develop, and learn new things. You’re constantly evolving, so shouldn’t your opportunities be, too?

Work Schedule: Ally designates roles as (1) fully on-site, (2) hybrid, or (3) fully remote. Hybrid roles are generally expected to be in the office a certain number of days per week as indicated by your manager. Your hiring manager will discuss this role's specific work requirements with you during the hiring process. All work requirements are subject to change at any time based on leader discretion and/or business need.

The Opportunity

We are seeking an experienced and hands-on GenAI Tech Lead to drive the end-to-end development of enterprise-grade generative and agentic AI solutions. You will bridge the gap between high-level strategy and hands-on execution—architecting robust systems, leading a talented team of engineers, and transforming complex business challenges into scalable AI products.

The Work Itself

Key Responsibilities

Minimum Qualifications:

• 7+ years of relevant experience or equivalent combination of education and experience
• Bachelor’s Degree in relevant field or equivalent

Preferred Qualifications:

• Architecture & Design: Design scalable, secure, and production-ready GenAI applications utilizing Large Language Models (LLMs), fine-tune and deploy open-source models that meets business needs, Retrieval-Augmented Generation (RAG) pipelines, and vector databases.
• Agentic Workflows: Build and orchestrate multi-agent AI systems and tool-calling frameworks (e.g., LangChain, LangGraph, AutoGen).
• Technical Leadership: Lead code reviews, establish engineering best practices, enforce coding standards, and mentor junior-to-mid-level software engineers.
• Prototyping & R&D: Rapidly build Proof of Concepts (PoCs) and Minimum Viable Products (MVPs) to test emerging AI models and frameworks
• LLMOps & Monitoring: Implement monitoring, caching, prompt versioning, cost tracking, and evaluation guardrails for models running in production
• Cross-Functional Collaboration: Partner with product managers, data scientists, security teams, and business stakeholders to align technical deliverables with organizational goals
• Experience: 8+ of Software Engineering experience with 5+ years in machine learning engineering, with at least 2+ years hands-on focus building and deploying GenAI/LLM enterprise applications.
• Core Technologies: Advanced proficiency in Python and cloud-native development (AWS, Azure, or Google Cloud).
• AI Frameworks: Deep practical knowledge of RAG architectures, vector search, prompt engineering, and orchestration libraries (LangChain, LlamaIndex, LangGraph).
• Infrastructure: Familiarity with CI/CD pipelines, containerization (Docker, Kubernetes), and API microservices.
• Soft Skills: Proven track record of technical leadership, mentoring, and translating complex technical concepts into clear business value. Strong analytical, communication (written and oral), and interpersonal skills. Ability to prioritize workload and balance multiple initiatives and efforts. Ability to respond quickly to a changing environment.
• Experience fine-tuning open-weight foundation models.
• Background in highly regulated industries (bank/finance) navigating strict security protocols.
• Active curiosity about emerging AI tooling, Model Context Protocol (MCP), and automated evaluation loops.

How We'll Have Your Back Ally's compensation program offers market-competitive base pay and pay-for-performance incentives (bonuses) based on achieving personal and company goals. Our Total Rewards program includes industry-leading compensation and benefits plus additional incentives that are designed to meet your needs and those of your family so you can get the most out of your career and your life, including:

Time Away: Program starts at 20 paid time off days in addition to 11 paid holidays and 8 hours of volunteer time off yearly (time off days are prorated based on start date and program varies based on full or part-time status and management level).

Planning for the Future: plan for the near and long term with an industry-leading 401K retirement savings plan with matching and company contributions, student loan pay downs and 529 educational save up assistance programs, tuition reimbursement, employee stock purchase plan, and financial learning center and financial coach access.

Supporting your Health & Well-being: flexible health and insurance options including medical, dental and vision, employee, spouse and child life insurance, short- and long-term disability, pre-tax Health Savings Account with employer contributions, Healthcare FSA, critical illness, accident & hospital indemnity insurance, and a total well-being program that helps you and your family stay on track physically, socially, emotionally, and financially.

Building a Family: adoption, surrogacy and fertility assistance as well as paid parental and caregiver leave, Dependent Day Care FSA back-up child and adult/elder care days and childcare discounts.

Work-Life Integration: other benefits including Mentally Fit Employee Assistance Program, subsidized and discounted Weight Watchers® program and other employee discount programs.

Other Compensations: depending on the role for which you are considered, you may be eligible for travel allowances, relocation assistance, a signing bonus and/or equity.

To view more detailed information about Ally’s Total Rewards, please visit this link: https://www.ally.com/content/dam/pdf/corporate/ally-total-rewards-snapshot.pdf

Who We Are: Ally Financial is a customer-centric, leading digital financial services company with passionate customer service and innovative financial solutions. We are relentlessly focused on "Doing it Right" and being a trusted financial-services provider to our consumer, commercial, and corporate customers. For more information, visit www.ally.com.

Ally is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity or expression, pregnancy status, marital status, military or veteran status, genetic disposition or any other reason protected by law.

In accordance with the Americans with Disabilities Act, if after review of the position expectations, you believe that you may need a medical accommodation to fulfill the duties of this role, please email hrpolicy@ally.com with details of your accommodation request.

Base Pay Range

$110,000.00 - $180,000.00 An individual's position in the range is determined by the specific role, the scope and responsibilities of the role, work experience, education, certification(s), training, and additional qualifications. We review internal pay, the competitive market, and business environment prior to extending an offer.

Incentive Compensation:

This position is eligible to participate in our annual incentive plan.