Immediate need for a talented Data Engineer – Azure Databricks, Purview & Fabric. This is a Direct Hire opportunity with long-term potential and is located in Taguig, 1634 Metro Manila, Philippines(Onsite). Please review the job description below and contact me ASAP if you are interested.
Job ID:26-01102
Pay Range: PHP 100K - 160K /Monthly. (Negotiable).
Key Responsibilities:
- Design, develop, and implement data processing pipelines using Azure Databricks and Spark.
- Write efficient and optimized code in Python (PySpark) and SQL for large-scale data processing.
- Architect and maintain data lakehouse solutions leveraging Microsoft Fabric for analytics and reporting.
- Implement data governance and cataloging using Microsoft Purview, ensuring compliance and lineage tracking.
- Build and optimize ETL workflows for ingestion, transformation, and integration across Azure services.
- Ensure data quality, security, and integrity through robust validation and governance practices.
- Collaborate with cross-functional teams to understand business requirements and deliver scalable solutions.
- Maintain version control using Git and follow best practices for CI/CD in data engineering.
- Create comprehensive technical documentation, including requirements, design, and testing artifacts.
Key Requirements and Technology Experience:
- Key skills; Microsoft Purview , Microsoft Fabric, Azure Databricks, Spark, Python (PySpark) and SQL
- 5+ years of hands-on experience in development and production implementation with Azure Databricks and Spark.
- Proven experience with Microsoft Purview for data governance and compliance.
- Working knowledge of Microsoft Fabric for analytics and integration.
- Proficiency in Python (PySpark) and SQL coding.
- Strong understanding of data lake architecture, ETL processes, and data quality management.
- Experience with Azure data analytics services (e.g., Data Lake, Synapse, Data Factory).
- Excellent technical writing and communication skills.
- Ability to optimize performance for large-scale data processing and ensure scalability.
Our client is a leading Consulting Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, colour, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.
#prof