Dow has an exciting opportunity for a Data Platform Engineer on the Data & Analytics Platforms team within our Enterprise Data & Analytics Organization.
**This position is located full-time on site at the Dow Delivery Center at UIUC (University of Illinois Research Park) in Champaign, IL.**
As a Data Platform Engineer specializing in data and analytics solutions, your primary focus will be responsible for consuming, analyzing, and deriving insights from data using the Azure Databricks platform. You will work closely with a global, diverse extended team of data engineers, data scientists, and other stakeholders to understand data requirements and deliver actionable insights.
Your role involves performing data analysis, exploring and visualizing data, writing and optimizing SQL or Spark queries, and creating interactive dashboards, alerts, and reports. You will leverage the capabilities of Azure Databricks to explore patterns, correlations, and anomalies in data to ensure compliance with data governance policies, optimize data retrieval and analysis processes, and effectively communicate data insights to stakeholders. While this an individual contributor role, this role will also serve as a technical mentor to on-site college interns based out of the Dow Delivery Center at UIUC.
Responsibilities
- Optimizes data retrieval and analysis processes in Azure Databricks for efficiency and scalability.
- Performs data analysis using Azure Databricks to uncover patterns, correlations, and insights.
- Writes and optimizes SQL or Spark queries to extract, transform, and manipulate data in Azure Databricks.
- Uses Azure Databricks to explore and model data for predictive analytics or machine learning purposes.
- Works with cross-functional teams to develop and implement cloud-based solutions across the Application Development Lifecycle (Development/Test/Production).
- Collaborates with functional and business teams ensuring best practices are maintained for consuming data and using capabilities of the cloud data platform.
- Continuously explores and adopts new technologies and best practices to improve our data infrastructure.
- Provides technical expertise and guidance to team members and stakeholders .
- Ensures Change Management and Configuration Management standards are implemented and executed.
- Documents operational support procedures.
- Ensures technical, architecture, and application designs aligns to company IT architecture and security standards.
- Manage the onboarding process and provide ongoing coaching of college interns.
Qualifications
- A minimum of a Bachelor’s degree, or 5 years relevant experience, or relevant military experience at or above a U.S. E6 or Petty Officer 2nd Class or Sergeant ranking.
- A minimum of 2 years of professional data platform experience (data ingestion, pipeline orchestration).
- Experience with setting up data processing workloads, deploying Machine Learning models for predictive analytics, setting up containerized applications and/or utilizing various authentication methods for application consumption.
- A minimum requirement for this U.S. based position is the ability to work legally in the United States. No visa sponsorship/support is available for this position, including for any type of U.S. permanent residency (green card) process.
Preferred Skills – having some of these skills will be beneficial but can be learned on the job
- A degree discipline in Computer Science, Information Systems, Engineering, or related technical field.
- A minimum of 2 years of professional experience in Databricks technology.
- Azure Fundamentals: Understanding core Azure services, architecture, and cloud concepts.
- Cost Management: Proficiency in Azure Cost Management and Billing to monitor and optimize cloud spending.
- Resource Management: Skills in managing Azure resources, including virtual machines, storage, and networking.
- Automation: Experience with automation tools like Azure Automation, ARM templates, and scripting languages (e.g., PowerShell, Python).
- Monitoring and Reporting: Knowledge of Azure Monitor, Log Analytics, and creating custom reports to track resource usage and performance.
- Security and Compliance: Ensuring resources comply with security policies and regulatory requirements.
- DevOps Practices: Familiarity with Azure DevOps for continuous integration and continuous deployment (CI/CD) pipelines.
- Analytical Thinking: Ability to analyze data and trends to make informed decisions about resource optimization.
- Problem-Solving: Strong problem-solving skills to troubleshoot and resolve issues efficiently.
- Communication: Effective communication skills to collaborate with teams and explain technical concepts to non-technical stakeholders.
- Proven ability to effectively communicate with business partners and translate technical terminology into business-friendly language.
- Project Management: Organizational skills to manage multiple projects and tasks simultaneously.
Additional notes
- This position does not offer relocation assistance.
- While this position does not have direct people leadership responsibility, your independent contributions will have the opportunity to build leadership as a coach and mentor to junior resources.
Please apply here if you are interested- Dow Data Platform Engineer
