Senior Principal Data Engineer

Company: Shutterfly, Inc.
Location: Myrtle Point
Posted on: May 28, 2023

Job Description:

At Spoonflower (part of the Shutterfly family of brands) our mission is to inspire individuals to make, buy and sell unique products built around color and pattern. Our e-commerce website makes it possible for individuals to create, sell, and shop for unique fabrics, wallpaper, and home dcor. Spoonflower's global marketplace connects our customers to more than 1 million designs by independent artists from around the world.Spoonflower is seeking an experienced and highly motivated Senior Principal Data Engineer to be a player/coach to our Data and Analytics engineering team. This position is responsible to conceptualize, feature design and development, maintenance, and production support of all data integration platform, tool, and ETL/ELT processes. This position is responsible for leading a team of data engineers to build and maintain the data lake that will support analytical and reporting use cases across the Spoonflower organization.What You'll Do Here:* Work in a dynamic & agile environment to develop creative data-driven solutions using AWS Tech stack, Snowflake, Databricks, SQL, as well as other modern data technologies* Working with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues* Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.* Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala* Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.* Knowledge in NoSQL databases - MongoDB, Dyanamo DB is a plus* Experience in managing and troubleshooting issues with database like Aurora, Redshift* Experience in Unix, AWS Cloud platform tools, storage and security (SNS, S3, Athena, QuickSight, Secret manager).* Demonstrates leadership and active pursuit of optimizing CI/CD process and tools, testing frameworks and practices* Understanding of Cloud / Hybrid data architecture and eCommerce concepts is a plus* Manage a small team of onshore and offshore engineersThe Skills You'll Bring:* Bachelors or master's degree in computer science, Information Technology or other relevant fields* 7-10 yrs. of hands-on experience in building batch as well as NRT/RT data ingestion pipeline using Kafka, Kinesis/firehose, AWS DMS, Spark-ETL, AWS Glue and Lambda and proficient in optimizing and tuning Redshift database* 3 years of experience managing a team of engineers* Has experience in AWS Athena and Glue, Pyspark, EMR, DynamoDB, Redshift, Kinesis, Lambda, Snowflake, Aurora, S3, Glue, Athena, DynamoDB* Knowledge of BI tools - Power BI, Looker is a plus* Knowledge of AWS security and IAM rolesSupporting a diverse and inclusive workforce is important to Shutterfly not only because it directly reflects our value of Embracing our Differences, but also because it's the right thing to do for our business and for our people. Learn more about our commitment to Diversity, Equity and Inclusion at Shutterfly DE&I.#SFLYTechnology

Keywords: Shutterfly, Inc., Medford , Senior Principal Data Engineer, Engineering , Myrtle Point, Oregon