[Remote] Databricks Engineer
Note: The job is a remote job and is open to candidates in USA. Net2Source is seeking a Databricks Engineer to assist in migrating an underperforming customer solution to Databricks. The role involves analyzing current solutions, building data pipelines, and enhancing AI-driven components to ensure performance and reliability.
Responsibilities
- Migrate existing data pipelines and workflows to Databricks
- Analyze the customer's current solution and implement improvements
- Build and optimize Python- and SQL-based pipelines
- Develop and enhance AI-driven parsing and extraction components
- Ensure performance, data quality, and reliability
- Collaborate with technical and business teams to deliver a stable solution
Skills
- Hands-on experience with Databricks (clusters, notebooks, Delta Lake)
- Strong Python (required) and SQL skills
- Experience with AI parsing/extraction and text-processing workflows
- Background in data migration and troubleshooting
- Experience with Azure Databricks, MLflow, or Lakehouse architecture
- Knowledge of document intelligence tools and DevOps workflows
Company Overview
Company H1B Sponsorship