Short Description
Americian Express is seeking for Big Data Engineer Centric to batch/real-time analytical solutions leveraging transformational technologies (Hadoop, HDFS, MapReduce, Spark, Hive, HBase, Pig, etc.) to deliver innovative solutions across multiple business units.Job Description
- Owns all technical aspects of software development for assigned applications.
- Performs hands-on architecture, design, and development of systems.
- Functions as Senior member of an agile team and helps drive consistent development practices wrt tools, common components, and documentation.
- Typically spends 80% of time writing code and testing, and remainder of time collaborating with stakeholders through ongoing product/platform releases.
- Develops deep understanding of tie-ins with other Amex systems and platforms within the supported domains.
- Writes code and unit tests, works on API specs, automation, and conducts code reviews and testing.
- Performs ongoing refactoring of code, utilizes visualization and other techniques to fast-track concepts, and deliver continuous improvement - Identifies opportunities to adopt innovative technologies.
- Provides continuous support for ongoing application availability.
- Works closely with product owners on blueprints and annual planning of feature sets that impact multiple platforms and products.
- Works with product owners to prioritize features for ongoing sprints and managing a list of technical requirements based on industry trends, new technologies, known defects, and issues.
- A Bachelor's degree in computer science, computer engineering, other technical discipline, or equivalent work experience.
- Software development experience with proven hands-on experience in Bigdata technologies.
- Familiar with Agile or other rapid application development methods.
- Experience with design and coding across one or more platforms and languages as appropriate.
- Hands-on expertise with application design, software development and automated testing.
- Ability to effectively interpret technical and business objectives and challenges, and articulate solutions.
- Displays understanding of different Algorithms & Machine Learning techniques and their application in the Customer Marketing domain.
- Ability to think abstractly and deal with ambiguous/under-defined problems.
- Ability to enable business capabilities through innovation.
- High energy, demonstrated willingness to learn new technologies, and takes pride in how fast they develop working software.
- Experience with distributed (multi-tiered) systems, algorithms, and relational databases.
- Demonstrated experience with object-oriented design and coding with variety of languages.
- Knack to guide/mentor other team members in both technology and domain.
- Strong programming knowledge in Java/Python (Preferred) or C / Java.
- Experience working on any Hadoop distribution, such as Mapr, Cloudera, Hortonworks and have at least coded in Hive, Pig, Java M/R, Spark for 2 years or more, will be an added advantage.
- Solid understanding of data structures, Algorithms & Design Patters will be a plus.
- Understanding and experience with UNIX / Shell / Perl / Python scripting.
- Strong analytical ability.
- Excellent communication skills.
Big Data Engineer