Open Systems Technologies Corporation is looking for a Databricks Administrator to join our team of experts to assist with building state of the art data platforms for the Department of Defense's premier data analytics platform.
Responsibilities:
- Manage and Administer Databricks Environment: Oversee the Databricks environment, including clusters, workspaces, jobs, and notebooks, to ensure optimal performance, reliability, and scalability.
- Configure and Optimize Databricks Clusters: Adjust and optimize Databricks clusters and resources based on workload requirements and best practices.
- Workspace Management: Create and manage workspaces and permissions.
- Identity Management: Understand and craft all applicable AWS IAM roles and policies necessary for program use cases.
- Monitor Account Usage Logs: Inspect Databricks logs for auditing and cost reporting.
- Ensure Security: Understand and execute DoD security best practices across the Databricks platform.
- Collaborate with Teams: Work closely with Advana teams to ensure smooth operation and physical design of databases, clusters, jobs, and workspaces.
- Support: Provide support to data engineers, data scientists, and analysts, enabling them to leverage the full potential of Databricks for analytics and machine learning.
- Manage Multiple Environments - maintain and support configuration management across unclasssified and classified environments
Required Skills:
- Minimum 2+ years of hands-on administration experience, from setting up the Databricks environment to successfully administering it (AWS preferred)
- Experience as the Databricks account owner, managing workspaces, AWS accounts, audit logs, and high-level usage monitoring
- Experience as Databricks workspace admin, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.
- Experience managing S3 access across a large user base
- Experience managing cluster and jobs configuration options
- Experience with Databricks security and privacy setup
- Experience troubleshooting end user and platform-level issues
- Experience delivering client presentations and demos
- Experience optimizing usage for performance and cost preferred
- Ability to multitask and reprioritize tasking on the fly according to the needs of a growing platform and its stakeholders
- Strong coding skills in SQL and Python (PySpark) with experience optimizing code
- Documented experience with AWS, EC2, S3, and/or RDS
- BA or BS degree
Preferred Skills:
- Experience with Qlik dashboarding and development functions
- Experience with facilitating BI tool training
- Experience in using DoD Data Management to manipulate and integrate databases with SQL, SAS, or other languages
- Knowledge of Big Data systems, including Hadoop, HDFS, Hive, or Cloudera
- Able to discern stakeholder needs, effectively communicate development plans, and track progress milestones
- Excellent organizational and time management skills to handle multiple tasks simultaneously
- Excellent critical thinking skills to assess numbers, trends, and data to reach new conclusions based on findings
- Excellent quantitative skills, including statistical analysis, process design, and data management
BENEFITS
OST has been operating since 1996 and has various contracts with Government agencies. We offer a comprehensive benefits package that includes 3 weeks paid time off, 11 Federal Holidays, medical/dental coverage, STD, LTD, Life Insurance, AD&D, 401k with up to 4% match, and end-of-year profit sharing.