Job Location | Hyderabad, Pakistan |
Education | Not Mentioned |
Salary | Not Mentioned |
Industry | Other Business Support Services |
Functional Area | Not Mentioned |
Fanatics is a leading global digital sports platform, complete with offerings that excite fans and maximize the reach and presence for partners across the entire sports ecosystem. Come help us build a company the world has never seen before! We are first and foremost a technology company. We build innovative fan experiences through highly analytical, forward thinking, and open-minded collaboration. We are passionate about evaluating and finding the right tech for the jobs at hand, and we get excited about building solutions for modern challenges.Title: Sr.Manager Software Engineering--BigdataExperience :11yrs-13yrsJob location :Hyderabad (Hybrid)Leadership role+ Architect+ Proficiency in Java, Scala , Bigdata APIs(Mandatory)What Will You Do?- Build next-generation big data platforms that will be used by all the data engineering teams @ Fanatics- Support existing legacy infrastructure and provide tools to migrate to the newer orchestration platforms- Build, operate and manage big data platforms infrastructure in a scalable and efficient way for data teams within Fanatics- Support big data teams and increase productivity with automated services that setup, configure and monitor cloud infrastructure- Build data cataloging infrastructure and metadata platform to enable data discovery, data observability, and federated governance- Build house-keeping tools that enable automated data management and organization for efficient queries, and data purging on data lakes- Provide technical leadership to the data engineering team on how data should be stored and processed more efficiently and quickly at scale- Optimizing existing data platforms and infrastructure while exploring other technologies- Work with data engineering teams and help with a reference implementation for different use cases- Improve existing tools to deliver value to the users of the platformWhat Are We Looking For?- 10+ years of software development experience with at least 3+ years of experience in open-source big data technologies- Must have experience working on the cloud preferably AWS- Proficiency with OSS big data platforms with experience in batch and streaming technologies eg: Airflow, Spark, Spark Streaming, Iceberg, Flink, etc.- Proficiency in Java, Scala, Spark- Strong hands-on experience in, Spark, Spark SQL, Spark Streaming, Data Modeling, and Schema design.- Hands-On experience on query engines like Trino/Presto, StarBurst, Athena, Redshift, Snowflake- Experience and deep understanding of traditional, NoSQL, and columnar databases- Experience in building scalable infrastructure to support stream, batch, and micro-batch data processing- Hands-on experience in managing cloud-based infrastructureExperience on Airflow, Apache Iceberg is a plus
Keyskills :
© 2020 JobSearchGulf All Rights Reserved