Data Engineer: Deefield, Illinois with Salary to: $135,000
Responsibilities include:
- Architect, design and develop flexible, secure and scalable database solutions for the data warehouse, business applications and IoT/digital technologies
- Understand data in the big picture and how information flows and relates to various applications and internal/external systems
- Design, develop and execute ETL processes
- Develop deep understanding of the data sources, implement data standards, maintain data quality, master data management and identify data transformation needs
- Analyzing large quantities of data in on-premise and cloud platforms like AWS or Azure
- Work with internal stakeholders to understand business needs, technology options and recommend solutions
- Work with development, analytics, IoT and management teams to design, build, test and deliver global solutions across all areas of the enterprise
- Build and meet project timelines and manage delivery commitments with proper communication to management
- Create estimates and manage against overall project designs and budgets
- Develop and provide documentation, demos and training to internal team members Understand, implement and adhere to data integrity and security best practices
- Perform ongoing monitoring, automation and refinement of data engineering solutions
- Adhere to SOX policies and procedures for compliance to ensure company-wide consistent standards
Experience/Qualifications:
- Bachelor’s Degree or equivalent combination of education and experience
- Experience in the following minimum skill sets:
- Database management MSSQL/NoSQL
- Data Warehouse star schema methodology
- ETL tools and techniques
- Worked on Real Time data capture, processing and storing
- Working with different data storage options including AWS S3, Azure BLOB storage etc.
- Understanding of different data formats including Parquet, Avro, CSV, ORC etc.
- Experience with API/RESTful data services
Other desirable but not required technologies include:
- DB2
- Tableau
- Mulesoft
- Microsoft/Azure ETL solutions and business Intelligence
- Previous eCommerce data solutions
- Previous ERP integration (JDE Edwards, Oracle, SAP, Sales Force, Dynamics)