Lead Data Engineer

Short Description

ThoughtWorks is hiring for Lead Data Engineer who has deep understanding of NoSQL technologies including column family, graph, document, and key-value data storage technologies. Also has deep understanding and application of modern data processing technology stacks. For example Spark, Hadoop ecosystem technologies and others.

Job Description

Responsibilities:
  • Hands-on Engineering Leadership.
  • Proven track record of Innovation and expertise in Data Engineering.
  • Tenure in coding, architecting and delivering complex projects.
  • Deep understanding and application of modern data processing technology stacks. For example Spark, Hadoop ecosystem technologies, and others.
  • Deep understanding of streaming data architectures and technologies for real-time and low-latency data processing.
  • Deep understanding of NoSQL technologies including column family, graph, document, and key-value data storage technologies.
  • Understanding of how to architect solutions for data science and analytics such as productionizing machine learning models and collaborating with data scientists.
  • Understanding of agile development methods including: core values, guiding principles, and key agile practices.
  • Understanding of the theory and application of Continuous Integration/Delivery
  • Passion for software craftsmanship.
  • A rich breadth of industry experience and background working across different organizations, ranging in size, from start-ups to large corporations.
  • Strong stakeholder management and interaction experience at different levels.

A few important things to know:
  • Travel is required. Projects are almost exclusively on customer site, so ThoughtWorkers need to be flexible and up for extensive travel. Most of our consultants travel every week and fly home for weekends. We do our best to take people's personal situations into account, but we know it's not for everyone.
  • Residing near one of our North America offices in Chicago, Dallas, New York, Atlanta or San Francisco is preferable although not necessary.

Lead Data Engineer
Mid-Senior-level Information Technology | Technology | Information Full-time Other | Information Technology | Engineering Data Engineer | Database
A community of passionate individuals whose purpose is to revolutionize software design, creation and delivery, while advocating for positive social change.

We work with people and organizations who have ambitious missions - whether they are in the commercial, social or government sectors. We set up smart teams who love challenges and think disruptively to help our clients succeed. Our Agile development tools help our clients continuously improve and deliver quality software.

We are focused on helping our industry improve, and believe in sharing what we learn. We do this by writing books, blogging, running events, talking at conferences, and championing open source.

We are strong believers in the power of software and technology as tools for social change. Through our Social Impact Program, we collaborate with organizations with a humanitarian mission and broad reach, helping them use technology to make an impact.

Apply Now