Big Data Developer
Qualifications, Skill Set
B. Tech/ B.E/ MCA/ equivalent
Minimum 6 Years of Experience.
1+ years of hands-on coding experience in Hadoop Ecosystems.
1+ years of working experience on Hive/AWS Athena or other data warehouse tools and their Queries.
Experience in writing & Understanding Complex SQL queries w.r.t Hive/Redshift.
Experience with writing Complex Spark programs in Scala/Java to process huge volume of data.
Roles & Responsibilities
Developing and maintaining data pipelines implementing ETL processes.
Taking responsibility for Hadoop development and implementation.
Working closely with a data science team implementing data analytic pipelines.
Help define data governance policies and support data versioning processes.
Maintaining security and data privacy in data processing.
Analyzing a vast number of data stores and uncover insights.
Writing & understanding complex SQL queries w.r.t Hive/Redshift.
Writing Complex Spark programs in Scala/Java to process huge volume of data.
Working with Real time data analytics