Short Description
Myntra is looking for Techincal Lead-Big Data who will responsible for designing and architect technical solutions for the business problems of a very large scale data from leading e-commerce portal and maintain data pipelines and data components.Job Description
- Write maintainable/scalable/efficient code and maintain data pipelines and data components.
- Design and architect technical solutions for the business problems of a very large scale data from
- leading e-commerce portal.
- Work in cross-functional team, collaborating with peers during entire SDLC.
- Follow coding standards, unit-testing, code reviews etc.
- Follow release cycles and commitment to deadlines.
- Experience level of 5 to 8 years of experience in very large scale applications
- Strong problem solving skills, computer science fundamentals, data structures and algorithms.
- Excellent software product engineering using Java/J2EE or Scala
- Deep expertise on at least one big data frameworks for example, Spark, Hadoop, Kafka, Hive, Presto,
- Alluxio, HDFS etc.
- Experience working on real time streaming data pipelines using Spark Streaming or Storm
- Very good understanding of data modelling and data architecture / organization best practices for
- MPP data bases as well as big data (HDFS, S3, BlobStore)
- Ability to create data flow design and write complex SQL / Spark based transformations & data
- aggregations that scale for big data volume
- Experience in building product-ized data pipelines that increases dev productivity and reduces errors
- (we are building our own data processing framework)
- Experience working on any one MPP data stores for example, Redshift, Teradata, Vertica, etc.
- Hands on programming experience with Scala, Go or Python
- Experience building application having data visualisation, interactive analysis or analytical reporting
- Exposure to variety of databases like Mongo, Redis, MemSQL, Aerospike etc.
- Experience working on Microsoft Azure Cloud services
- Hands on experience with SQL Data Warehouse of Azure Cloud services
- Experience handling data replications across multiple data-centre
Technical Lead-Big Data