Insight Global
Software Engineer - GenAI (Atlanta, GA, or other unanticipated locations throughout the U.S.).
Insight Global is hiring a Software Engineer - GenAI (Atlanta, GA, or other unanticipated locations throughout the U.S.). in Atlanta, Georgia, United States. Posted September 18, 2026.
Job at a glance
- Company
- Insight Global
- Location
- Atlanta, Georgia, United States
- Workplace
- On-site
- Employment
- Full-time
- Sector
- Engineering & Technology
- Posted
- September 18, 2026
- Apply by
- September 21, 2026
About the job
Overview
Our team is looking for a Software Engineer - GenAI.
Responsibilities
Responsibilities include: Design, optimize, and evaluate prompts for LLMs to achieve precise, reliable, and contextually relevant outputs across a variety of use cases. Architect and implement dynamic context management strategies, including session memory, retrieval-augmented generation, and user personalization, to enhance agent performance. Integrate, fine-tune, and orchestrate LLMs within Python-based applications, leveraging APIs and custom pipelines for scalable deployment. Build and manage complex conversational and agent workflows using the LangGraph framework to support multi-agent or multi-step solutions. Develop robust backend services, APIs, and (optionally) front-end interfaces to enable end-to-end AI-powered applications. Work closely with product, data science, and engineering teams to define requirements, run prompt experiments, and iterate quickly on solutions. Implement testing, monitoring, and evaluation pipelines to continuously improve prompt effectiveness and context handling. Up to 5% domestic travel. Telecommuting permitted.
Qualifications
Master’s degree in Computer Science, Information Technology, or a related field, 24 months experience as Software Engineer, Cloud AI Engineer, Machine Learning Engineer, or a similar position, and 24 months experience in: Python, PyTorch, Dremio, Langchain, RASA, Docker, Kubernetes, AWS, Pandas, and Postgres. 40 hrs./wk. 8:00 am – 5:00 pm