Job Description

Job Title: Sr. Data Engineer-ETL

Location: Denver, CO

Duration: Long-term

Main Skill:

Over 10+ years of experience in the Software Development Industry.
We need data Engineering exp - building ETLS using spark and sql, real time and batch pipelines using Kafka/firehose, experience with building pipelines with data bricks/snowflake, experience with ingesting multiple data formats like json/parquet/delta etc.

Job Description:

About You

You have a BS or MS in Computer Science or similar relevant field
You work well in a collaborative, team-based environment
You are an experienced engineering with 3+ years of experience
You have a passion for big data structures
You possess strong organizational and analytical skills related to working with structured and unstructured data operations
You have experience implementing and maintaining high performance / high availability data structures
You are most comfortable operating within cloud based eco systems
You enjoy leading projects and mentoring other team members

Specific Skills:

Over 10 years of experience in the Software Development Industry.
Experience or knowledge of relational SQL and NoSQL databases
High proficiency in Python, Pyspark, SQL and/or Scala
Experience in designing and implementing ETL processes
Experience in managing data pipelines for analytics and operational use
Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)
Experience or knowledge of AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS
Experience or knowledge of stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers.
Experience or knowledge of data pipeline and workflow management tools: i.e., Apache Airflow, AWS Data Pipeline
Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka.
Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD
Experience or knowledge in data observability and monitoring
Hands-on experience in designing and maintaining data schema life-cycles.
Bonus - Experience in tools like Databricks, Snowflake and Thoughtspot

Job Tags

Similar Jobs

YellowTelescope

Patient Sales Coordinator Job at YellowTelescope

...strong sales background, for a growing medical practice. This practice is owned by... ...together! Responsibilities: 1. Sales - assist prospective patients in making... ...cosmetic medical, plastic surgery, or cosmetic dermatology field or similar - ideal candidate will...

Stars: Illuminate. Educate. Advocate.

Van Driver Job at Stars: Illuminate. Educate. Advocate.

...Description Job Title : Van Driver Reports to : Director of Operations Work Location : Stars Office, Off-site locations Compensation : $20.00 per hour Employment Status Regular, part-time Work Schedule : 12-15 hours per week FLSA Classification :...

Mental Health Association, Inc.

Licensed Practical Nurse (LPN) Job at Mental Health Association, Inc.

...services. Position Summary: The Licensed Practical Nurse (LPN) provides direct oversight and support to the care team on-site... ...the same things in life as anyone: to have friends, work, go to school, have meaningful relationships, express themselves (and be heard...

Outcomes®

Client Support Rep Job at Outcomes®

...Job Summary The Client Support Representative delivers high-level service, support, and solutions to customers using specific tools and phone systems, teleconference tools, and remote connection. The Client Support Representative will answer a high volume of calls from...

iSpace, Inc.

Performance Test Engineer Job at iSpace, Inc.

...the following: Perform day to day monitoring tasks, including: Monitor and detect issues before they impact users Develop, test, and implement monitoring solutions Troubleshoot and fix monitoring issues Work with internal customers to gather monitoring requirements...

Sr Data Engineer-ETL Job at InfoVision Inc., Denver, CO

eFBOQlJrUGRacHVpdE9salhrREE2aXpC