Job Description
Job Description
Job Title: Sr. Data Engineer-ETL
Location: Denver, CO
Duration: Long-term
Main Skill:
- Over 10+ years of experience in the Software Development Industry.
- We need data Engineering exp - building ETLS using spark and sql, real time and batch pipelines using Kafka/firehose, experience with building pipelines with data bricks/snowflake, experience with ingesting multiple data formats like json/parquet/delta etc.
Job Description:
About You
- You have a BS or MS in Computer Science or similar relevant field
- You work well in a collaborative, team-based environment
- You are an experienced engineering with 3+ years of experience
- You have a passion for big data structures
- You possess strong organizational and analytical skills related to working with structured and unstructured data operations
- You have experience implementing and maintaining high performance / high availability data structures
- You are most comfortable operating within cloud based eco systems
- You enjoy leading projects and mentoring other team members
Specific Skills:
- Over 10 years of experience in the Software Development Industry.
- Experience or knowledge of relational SQL and NoSQL databases
- High proficiency in Python, Pyspark, SQL and/or Scala
- Experience in designing and implementing ETL processes
- Experience in managing data pipelines for analytics and operational use
- Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)
- Experience or knowledge of AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS
- Experience or knowledge of stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers.
- Experience or knowledge of data pipeline and workflow management tools: i.e., Apache Airflow, AWS Data Pipeline
- Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka.
- Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD
- Experience or knowledge in data observability and monitoring
- Hands-on experience in designing and maintaining data schema life-cycles.
- Bonus - Experience in tools like Databricks, Snowflake and Thoughtspot
Job Tags