Senior Data Engineer

Scuttlebutt Services, LLC

Senior Data Engineer

Chantilly, VA
Full Time
Paid
  • Responsibilities

    Chantilly, VA - Salary Range 200k-290k (Top Security Clearance Required)

     

     

    Job Brief

    As a skilled data engineer, you will play a pivotal role in the development and maintenance of data pipelines supporting a mission critical NextGen space resiliency / flight safety program. You’ll work closely with cross-functional teams, including analysts, software developers, cloud computing engineers, and systems engineers, to ensure efficient data processing, secure storage, and insightful analysis. This position requires hands-on experience and expertise with Kafka, AWS, and MongoDB


    Responsibilities

    • Upgrade and/or maintain Kafka clusters in an AWS/Kubernetes cloud environment
    • Design, Develop, and Deploy Kafka clusters in an AWS/Kubernetes cloud environment
    • Manage schema evolution and security using Kafka Schema Registry and Kafka Security Manager (KSM)
    • Oversee the assessment, design, building, and maintenance of scalable platforms


    Requirements

    • Kafka experience: Kafka Connect, Kafka Streams, and other Kafka ecosystem tools
    • Kafka knowledge of/with: Kafka Schema Security Manager, Kafka Schema Registry, and Kafka architecture and internals
    • Experience with Apache NiFI
    • Experience with AWS
    • Experience with MongoDB, Redis
    • Experience with agile development methodologies
    • Data Pipeline Experience: You will be involved with acquiring and prepping data to make data easily searchable and retrievable
    • Scripting Experience: develop scripts and programs for data conversion (transform various forms of data into usable formats)
    • Data Processing: create software to retrieve, parse, and process structured and unstructured data
    • Data Storage: implement data policies
    • TS/SCI clearance with a CI Polygraph
    • Ability to work on site in Chantilly, VA, Herndon, VA, or in Englewood, CO
    • Must be able to meet one of the education/experience combinations listed at the end
    • Background in any of the following: Orbital Dynamics, Astrodynamics, Aerospace Engineering, Flight Safety, Space Domain Awareness, Satellite Conjunction Analysis, SIGINT, IMINT, or GEOINT
    • Experience with Infrastructure-as-code tools (Ansible, Terraform)
    • Experience with Big Data technologies (Spark, Cassandra, Hadoop)
    • Experience with Java, Python, or Scala
    • Experience with Docker, Kubernetes, BitBucket, GIT

    \#CJ

  • Compensation
    $200,000-$290,000 per year