Responsibilities:

• Lead the design, implementation, and optimization of the Databricks platform.
• Develop and maintain a platform optimized for performance, scalability, and reliability.
• Collaborate with cross-functional teams to understand business requirements and provide technical solutions.
• Design and implement data pipelines, ETL processes, and data models.
• Implement security measures to ensure data privacy and compliance.
• Troubleshoot and resolve performance issues, system errors, and data inconsistencies.
• Manage the team, providing guidance and mentorship to junior members.

Key Skill Sets:

• Strong experience with Databricks platform and related technologies.
• Proficient in programming languages such as Python, Scala, or SQL.
• In-depth knowledge of Apache Spark and its ecosystem.
• Familiarity with cloud platforms like AWS or Azure.
• Strong understanding of data engineering principles and best practices.
• Experience in data modeling, data warehousing, and data integration techniques.
• Excellent problem-solving and analytical skills.
• Good communication and collaboration abilities.
• Experience with Snowflake data platform (nice to have).

Minimum Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• At least 5 years of experience in data engineering or architecture roles.
• Hands-on experience with the Databricks platform and Apache Spark.

Preferred Qualifications:

• Master's degree in Computer Science, Engineering, or a related field.
• Experience in the healthcare or medical device industry.
• Certifications in Databricks or related technologies.
• Knowledge of data governance and data quality frameworks.

Focus Areas:

• Design and optimization of the Databricks platform.
• Ensuring performance, scalability, and reliability of the platform.
• Team management and leadership.
• Developing data pipelines, ETL processes, and data models.
• Implementing security and compliance measures.
• Troubleshooting and resolving system issues.
• Mentoring and fostering team collaboration.