Overview:
The Azure Developer will be building a data pipeline from ingestion to consumption and operationalizing it. Moving existing data warehouses (both on premise and cloud) to Azure HDInsight.
Qualifications:
• A Minimum of 6-months plus USQL and Data factory experience
• Hadoop, Python or R experience is a plus but not required
Responsibilities:
• Design and build production data pipelines from ingestion to consumption
• Design and implement data engineering, ingestion and curation functions on Azure cloud using Azure native or custom programming
• Architecting and implementing data governance and security for data platforms on Azure
• Designing operations architecture and conducting performance engineering for large scale data lakes a production environment
Preferred Skills:
• Bachelor's degree in Computer Science, Engineering, Technical Science or 3+ years of technical architecture and build experience with large scale solutions
• Minimum 6 months of experience in architecting large-scale data solutions, performing architectural assessments, crafting architectural options and analysis, finalizing preferred solution alternative working with IT and Business stakeholders
• 6 months of hands-on experience designing and implementing data ingestion solutions on Azure using Azure native services or using custom approaches
• 6 months of hands-on experience architecting and designing data lakes on Azure cloud serving analytics and BI application integrations
• 6 months of experience in designing and optimizing data models on AZURE cloud using Azure data stores such as Redshift, RDS
• Minimum 6 months of experience integrating AZURE security services with AZURE data services for building secure data solutions
• Minimum 6 months of experience introducing and operationalizing self-service data preparation tools (e.g. Trifacta, Paxata) on AZURE
• Minimum 6 months of architecting and operating large production Hadoop/NoSQL clusters on premise or using Cloud services
• Minimum 6 months architecting and implementing metadata management on Azure