Immanuel Raj’s Post

Senior Azure Data Engineer - Development India,Chennai Full time Budget 30 LPA Job Information Years of Experience10 - 12 Years DomainRetail State/ProvinceTamil Nadu Zip/Postal Code600001 Job Description Creating Azure Synapse pipelines to Ingest data from Flat Files (Blob Storage) and Other Data Sources Data Ingestion covers structured, unstructured, and semi-structured data Creating File shares/Blob container in ADLS to store the Ingested Data Data Modelling for the Staging Layer Data Cleansing/formatting in staging layer in ADLS using Azure Synapse Transform raw data into standardized formats using data transformation processes in Azure Synapse Data Transformation process to merge, harmonize and transform the data and load it in transformation layer using Azure Synapse pipelines Copying the transformed data from ADLS to Synapse DB Schema Creating the final high-level aggregations/summary tables needed for consumption Create Synapse pipelines to expose the summarized data for API calls using SOAP/REST API’s Implement Azure Purview for data cataloguing and governance Implement Azure Monitor for logging and monitoring activities Implement Microsoft Entra ID for secure authentication and access control… Send your profile to [email protected]

To view or add a comment, sign in

Explore topics