We seek a Data Engineer who embodies technical mastery and a visionary perspective. Beyond constructing data pipelines, the ideal candidate will be pivotal in refining developmental systems, aiding in our transition from Alteryx, and fortifying our journey to the Google Cloud landscape. Deep knowledge in SQL and Cloud databases will be pivotal to ensure system resilience and peak performance. Proactively identify bottlenecks, apply performance tuning, and ensure data security and compliance with industry standards. Collaboration is vital; interface with data scientists and analysts to align on architectural decisions and data pipeline strategies. If you’re technically adept and thrive on innovation, join our dedicated team
- Company location: Suffern, NY
- Position location: Suffern, NY. Hybrid (3 days/week onsite) after successful training
About LS Direct
From predictive analytics to the customer mailbox, LS Direct Marketing is the trusted one-stop partner for today’s savvy omnichannel retailers to deliver data-driven, highly personalized direct marketing messages at just the right time. Through our proprietary technology and team of data scientists and designers, we help our clients with actionable solutions to drive customer conversion and to achieve measurable ROI – at every stage of the buying journey
Core Responsibilities
- Develop and maintain scalable and fault-tolerant data infrastructure. Ensure the architecture supports the demands and future growth of the company
- Create, deploy, and manage ETL processes. Oversee real-time and batch data processing
- Guide our migration from Alteryx to a code-centric ETL framework, minimizing disruptions and maximizing efficiency, assisting the company’s transition to the Google Cloud, with a specific emphasis on BigQuery integration
- Collaborate to understand database requirements, ensuring optimal performance, resilience, and reliability
- Analyze current systems to identify bottlenecks and opportunities for enhancements, driving the evolution of our data infrastructure
- Implement best practices and solutions to ensure data security, privacy, and compliance with relevant regulations
- Work closely with data scientists, analysts, and other stakeholders to deliver on shared goals and projects
We’re Looking for Someone With
- BA or MA degree in Computer Science, Engineering, Data Science, Information Systems, or a related field
- 2-5+ years of demonstrable experience as a data engineer or in a similar capacity
- In-depth knowledge of Google Cloud Platform (GCP) and BigQuery
- Strong proficiency in programming languages commonly used in data engineering, such as Python, SQL, or Scala
- A deep understanding of distributed system design, data modeling, and schema design
- Excellent communication skills, both written and verbal, with the ability to convey complex technical information to non-technical stakeholders. In addition to a proven ability to work in cross-functional teams and collaborate with data analysts, data scientists, and other technical roles
- Knowledge of data governance and data quality management principles, privacy regulations, and compliance standards like GDPR, CCPA, etc.