Lead Data Engineer - Risk Tech (Python, AWS) at Capital_One — Cambridge, MA
Full job description
Lead Data Engineer - Risk Tech (Python, AWS)
Risk Tech is responsible for transforming risk management into a real time, intelligent discipline powered by modern products and technical capabilities. Our mission is divided into two primary functional pillars: Risk Management Tech (RMT), which develops the frameworks and tools for monitoring risks, testing controls, and managing regulatory requirements; and AML and Compliance Tech (ACT), which ensures our products are delivered ethically and in strict compliance with BSA/AML regulations and global laws.
Reinforcing these pillars are our commitment to Architecture & Engineering Excellence. Our Architecture team bridges the gap between business strategy and technical execution through a customer centric, domain oriented lens, while our Engineering Excellence team empowers our talent to build better, more resilient systems every day. Together, we ensure that Risk Tech isn't just a safeguard - it’s a competitive advantage.
What You’ll Do
- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
- Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
- Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
- Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
- Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
- Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
Basic Qualifications:
- Bachelor’s Degree
- At least 4 years of experience in application development (Internship experience does not apply)
- At least 2 years of experience in big data technologies
- At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
Preferred Qualifications:
- 7+ years of experience in application development including Python, SQL, Golang, Java or Scala
- 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- 4+ years experience with Distributed data/computing tools (MapReduce, Flink, EMR, Kafka, Spark, or MySQL)
- 4+ year experience working on real-time data and streaming applications
- 4+ years of experience with SQL implementation(PostgreSQL) and NoSQL implementation (DynamoDB)
- 4+ years of data warehousing experience (Snowflake or Redshift)
- 4+ years of experience with UNIX/Linux including basic commands and shell scripting
- 2+ years of experience with Agile engineering practices
- Experience leveraging interactive AI tooling to accelerate productivity, utilizing capabilities beyond basic code completion
Cambridge, MA: $197,300 - $225,100 for Lead Data Engineer
Richmond, VA: $179,400 - $204,700 for Lead Data Engineer