Senior Associate Big Data

Short Description

Western Union is seeking for Senior Associate Big Data who will be responsible to Design and build the infrastructure for data extraction from a variety of sources, preparation, and analytics. Provide solution implementation including system set-ups, development, system and integration testing, and user training.

Job Description

  • Principal Software EngHave has proven experience in working with a team of engineers and service providers in a geographically distributed structure.
  • Use varied Big data architectural styles, architectural patterns, technologies and frameworks to design and build actionable data analytics systems at the Western Union.
  • Exposure to AWS Cloud-based Big data systems for data ingestion, processing, analytics, and machine learning is expected.
  • Troubleshoot issues and coordinate resolution with operations, functional, and technical teams that may be geographically distributed.
  • Define and adopt the best global practices that help in building a scalable, resilient, highly available big data platform.
  • Support server buildout on multiple sites for failover/disaster recovery in a highly available ecosystem.
  • Deliver common framework architecture and high-level design.
  • Develop and implement new software, maintain and improve existing software.
  • Conduct detailed design, code, and test reviews.
  • Ensure that software functionality is implemented with a focus on high performance.
  • Work with business partners to understand their needs and proactively lead them to solutions.
  • Must be able to multi-task, handling numerous competing priorities.
  • Provide coaching to Junior Associates.

Required Skills And Experience:
  • B.E. / B.Tech. / MCA in Computer Science, Engineering or related field is required.
  • 8 - 10 years of experience in software engineering and architecture experience in a fast-paced.
  • Corporate environment.
  • Comprehensive experience in Java/Scala.
  • Provide solutions for real-time/batch data injection into Hadoop Data Lake through Streaming systems.
  • Batch data load through HDFS/Sqoop scripts into Hadoop through Hive or Impala.
  • Experience with Spark datasets, Spark SQL and providing data to the Machine Learning Libraries for executing various machine learning algorithms.
  • Expertise in writing queries and with the tuning of queries or jobs. Experience on both relational and NoSQL databases.
  • Experience in AWS services like Kinesis, Redshift, EMR, RDS.
  • Perform analysis of vast data stores and uncover insights. Experience in implementing BI tools like Zoom data, Arcadia, Power etc.
  • Experience in fast analytics tools like Kudu is desired.
  • Strong skills in Stream processing systems like a storm, Spark-streaming, Kafka streaming. Exposure to Kafka is expected.
  • Experience on Cloudera Hadoop eco-system is desired.
  • Strong Linux/Unix skills required.
  • Understanding various development methodologies, including Traditional Waterfall and Iterative development methods (Unified Process and Agile)neer.

Senior Associate Big Data
Mid-Senior-level Technology | Information Technology | Information Full-time Information Technology | Other | Management Big Data
With a 160+ year history of connecting people when it matters most, Western Union continues to shape the world in which we live. Western Union offers one of the easiest ways for families, friends and businesses to send money and stay connected almost anywhere in the world. It all comes down to the relationships we have established over many years. Together with our Agents, we speak our consumers languages and live in our consumers neighborhoods. And we share our consumers cultures. We are a significant part of each others lives. As a result, our Agents and employees are more like ambassadors. They are ambassadors of trust. Ambassadors of responsibility. And ambassadors of hope. They are the living, breathing manifestation of who we are as a company and everything we stand for. We are inspired, driven, responsible, connected, and game-changers. And we're moving forward with other new ventures too! Western Union has launched WU Digital in San Francisco, CA. This technology-driven division will focus on mobile and online services. Wherever our customers go and however they want to connect well be there! We did not become the worldwide leader in money movement services overnight. The employees of Western Union have been the backbone of our innovative spirit and continued success since our beginnings in 1851. And its a proud tradition that continues today with the next dedicated, enterprising individual that joins our team hopefully, you!