Showcase your data pipeline builder and data wrangling skills when you climb on board as this company’s Senior Data Engineer. Advanced working SQL knowledge will set you up for success on this team and help you own some of the company’s project efforts. If this is you, send us your application today!
Responsibilities:
- Create and maintain optimal data pipeline architecture
- Assemble complex and large data sets that meet functional and non-functional business requirements
- Identify, design, and implement internal process improvements
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies
- Provide optimal data pipelines to be leveraged by analytics tools that utilize the data pipeline
- Work with stakeholders and other teams to assist with data-related technical issues and support their data infrastructure needs
- Keep data separated, segregated, and secure across in a multi-customer, multi-database environment
- Create data tools for analytics and data scientist team members
- Work with data and analytics experts to strive for greater functionality in data systems
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management
Qualifications:
- 5+ years of Data Engineer experience
- Advanced working SQL knowledge
- Familiarity with a variety of databases
- Experience building and optimizing data pipelines, architectures, and data sets
- Experience performing root cause analysis on internal and external data and processes
- Strong analytic skills related to working with unstructured datasets
- Working knowledge of message queuing, stream processing, and highly scalable “big data” data stores
- Strong project management and organizational skills
- Experience with the following:
- Relational SQL
- Integrating with 3rd party API’s
- Object-oriented/object function scripting languages such as C#, Python, Scala, etc.
- AWS cloud services: EC2, EMR, RDS, Redshift