Big Data Developer

Qualifications, Skill Set

B. Tech/ B.E/ MCA/ equivalent

Required Experience

Minimum 6 Years of Experience.

1+ years of hands-on coding experience in Hadoop Ecosystems.

1+ years of working experience on Hive/AWS Athena or other data warehouse tools and their Queries.

Experience in writing & Understanding Complex SQL queries w.r.t Hive/Redshift.

Experience with writing Complex Spark programs in Scala/Java to process huge volume of data.

Roles & Responsibilities

Developing and maintaining data pipelines implementing ETL processes.

Taking responsibility for Hadoop development and implementation.

Working closely with a data science team implementing data analytic pipelines.

Help define data governance policies and support data versioning processes.

Maintaining security and data privacy in data processing.

Analyzing a vast number of data stores and uncover insights.

Writing & understanding complex SQL queries w.r.t Hive/Redshift.

Writing Complex Spark programs in Scala/Java to process huge volume of data.

Working with Real time data analytics