ETL Data Platform Developer Job at Cloud Analytics Technologies LLC, Redmond, WA

dy9kSlNrdlphcG1odE9oc1VFSEM0eXJGa2c9PQ==
  • Cloud Analytics Technologies LLC
  • Redmond, WA

Job Description

Summary

Role : ETL Data Platform Developer

Location : Redmond, WA (Onsite )


Key Responsibilities
Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse ,warehouse, sql) and Azure Data Factory.
Build and maintain a metadata driven Lakehouse architecture with threaded datasets to support multiple consumption patterns.
Develop agent specific data lakes and an orchestration layer for an uber agent that can query across agents to answer customer questions.
Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics and AI tools.
Ensure data quality, lineage, and governance across all ingestion and transformation processes.
Collaborate with product teams to understand data needs and deliver scalable solutions.
Optimize performance and cost across storage and compute layers.

Required Qualifications
7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies.

Strong expertise in:
Executive written and oral communication
Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)
Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2
Power BI and/or other visualization tools
SQL, Python and PySpark/ Scala
Experience working with structured and semi structured data (JSON, XML, CSV, Parquet).
Proven ability to build metadata driven architectures and reusable components.
Familiarity with agent based architectures and conversational AI integration is a plus.
Strong understanding of data modeling, data governance, and security best practices.

Job Tags

Similar Jobs

Cypress HCM

Biosample Manager Job at Cypress HCM

~3 8 years of experience in shipping, receiving, logistics, or warehouse operations (biotech, pharmaceutical, or GMP environment strongly preferred). ~ Knowledge of shipping requirements for hazardous materials and temperature-sensitive products a plus. ~ Familiarity...

Schillings

Graphic Designer Job at Schillings

Great news! Schillings is currently looking for a Graphic Designer at our Saint John, IN location to create visually engaging content and support our branding efforts. This role involves both creative design work and practical tasks, such as event setup and vinyl decal...

BOWA Construction

Safety Manager Job at BOWA Construction

 ...BOWA Construction Safety Manager - Dallas, TX COMPANY OVERVIEW: We are a General Contractor and Construction Management firm, established on the core principles of family, honesty, discipline, and quality. Our team consists of individuals with extensive general... 

Bancroft Staffing Partners (BSP)

Architectural Project Manager / Architect / Construction Admin - Education, DSA, K-12, Arts exp. Job at Bancroft Staffing Partners (BSP)

 ...recognized Architectural Design firm focused on diverse projects across education, healthcare, civic, S&T, commercial, etc. We have multiple...  ...and manage the construction administration phase of DSA, K-12, higher education, cultural, and arts projects, ensuring all work meets... 

iSpace, Inc.

Performance Test Engineer Job at iSpace, Inc.

 ...the following: Perform day to day monitoring tasks, including: Monitor and detect issues before they impact users Develop, test, and implement monitoring solutions Troubleshoot and fix monitoring issues Work with internal customers to gather monitoring requirements...