Data Engineer in Egg Harbor Township, NJ at Spencer's

Job Description

Come work with us at Spencer's & Spirit Halloween, where you'll be working with the best and brightest colleagues as you help us deliver the most fun experience and product possible to our guests. We're fast-paced and take our work seriously, but we always have a good laugh at the end of the day. Walk through our stores or the halls of our corporate office and you'll see firsthand that we're laidback and irreverent. We're firm believers in being true to YOU, so tattoos and piercings are as common as watercooler convos. Whether it's critiquing our new exclusive costumes or quality testing newly implemented software technology, our teams understand the importance of working collaboratively to challenge status quo and achieve our goals. We keep pushing ourselves to go above and beyond and are looking for top talent to become a part of our team!

We offer the following benefits:

• 30% discount on merchandise
• competitive salary
• career advancement
• Bonus opportunity
• an excellent benefits package including Vacation/Sick/Holiday pay, Medical/Dental/Disability/Life and AD&D insurance & 401k.

Responsibilities

Data Engineer to optimize our data integration at scale. Inside our Data Integration team, you will be designing pipelines and warehouses to model data from multiple sources that will allow us to derive business insight. Using Azure and other open-source technologies, such as Azure Data Factory and PySpark, you will design and build our next-generation ETL pipelines and data models.

• Build data pipelines and python-based ETL tools for acquiring, processing, and delivering data
• Develop data models and schemas in our data warehouse that enable performant, intuitive analysis
• Handle the challenges that come with managing terabytes of data
• Collaborate with business leaders and analysts to define key metrics and build reporting to monitor and understand company performance
• Develop the server applications and APIs that are used by our Data Team

Qualifications

• Bachelor’s degree or higher in Computer Science, Computer Engineering, Information Technology or related field
• Fluent in several programming languages such as Python, R, or Scala
• 6+ years of work experience in building ETL pipelines in production data processing and analysis
• Experience designing SQL tables, choosing indexes, tuning queries, and optimizations across different functional environments.
• Hands-on experience writing complex SQL queries and using a BI tool
• Experience with data lakes and designing and maintaining data solutions using Spark and Azure serverless services such as ADF
• Familiarity with data ingestion APIs, data sharing technologies, and warehouse infrastructure and development
  

*Proof of vaccination for COVID-19 required for employment, reasonable accommodations considered for medical, pregnancy or sincerely held religious beliefs.