AI/ML Engineer at 631 Booz Allen Hamilton_United States — Melbourne, FL
Full job description
AI/ML EngineerThe Opportunity:
As an AI/ML Engineer, you’re excited by the rapid evolution of AI and the impact modern LLM technologies can have on real users. You understand that building dependable AI capabilities requires more than clever prompts — it requires thoughtful engineering, clear communication, and the ability to collaborate across diverse technical and mission teams. We’re seeking someone with a strong foundation in IT, systems, software, data, cloud, infrastructure, integration, or related technical disciplines who is eager to apply that experience to scalable AI/ML solutions that support enterprise-level environments and sensitive data workflows.
As an AI/ML Engineer on our team, you’ll design and refine prompts, help build LLM-powered workflows, and support the development of retrieval augmented systems that improve decision making and operational efficiency. You’ll work closely with senior technical leaders who will guide AI/ML direction while you contribute hands-on execution and apply your broader IT and technical experience to real mission applications. You’ll collaborate with cross-functional teams and apply modern AI practices in secure, regulated environments.
Join us. The world can’t wait.
You Have:
- 8+ years of experience in IT, systems administration, software development, systems integration, cloud services, data engineering, cybersecurity, infrastructure, enterprise applications, or automation
- Experience with AI/ML, LLM-enabled tools, prompt engineering, automation, analytics, data workflows, or emerging technology solutions
- Experience in designing, testing, and iterating on prompts for LLM-powered applications
- Experience with Retrieval Augmented Generation such as chunking, embeddings, retrieval, and grounding responses in source data
- Experience with Python, including writing clean and reusable code
- Experience with Git, GitHub, or version control tools
- Experience supporting the assessment, design, integration, documentation, implementation, or troubleshooting of IT or technical solutions
- Ability to effectively communicate, confirm requirements, reduce churn, and maintain alignment across teams
- Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
- Bachelor’s degree in a Computer Science, Information Technology, or STEM field
Nice If You Have:
- Experience with prompting techniques such as few-shot prompting, structured output formats, ReAct, or similar prompting approaches
- Experience building or supporting simple multi-step LLM workflows using tools such as LangChain, LlamaIndex, Semantic Kernel, LangGraph, or similar tools
- Knowledge of responsible AI practices including content filtering, guardrails, output validation, or safe handling of model outputs
- Experience working with PHI, PII, or within HIPAA, IRB, or ATO environments
- Experience with vector databases or semantic search systems
- Experience building evaluation sets for prompt testing
- Experience with enterprise tools such as Jira, Confluence, or API-driven workflows
- Experience in healthcare, research data, or regulated data environments
- Experience with Microsoft Azure services, Azure OpenAI, or Azure ML and AI Foundry tooling
- Experience applying IT, systems, software, data, cloud, or integration experience to emerging technology initiatives
Vetting:
Compensation
Identity Statement
Candidate AI Usage Policy
- Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.
- Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and the needs of the role. You may also be required to work from or visit a customer facility.
- Onsite: If this position is listed as onsite, work will primarily be performed at a Booz Allen office or customer facility, where employees will collaborate directly with colleagues and customers as required by the role.
Commitment to Non-Discrimination