Do large scale data processing in Azure.
Responsibilities & Requirements
Good knowledge of Python, R and/or Java.
Good knowledge of data engineering frameworks like Pandas, Spark, Kafka.
Knowledge of various persistence mechanisms (relational DB, No-sql, big data formats, cloud databases, graph DBs, index DBs, key-value stores, document DB).
Knowledge of data integration, data quality, data mastering tools is a big plus.