CouchDB Cassandra Spark Engineer

Global Channel Management, Inc

CouchDB Cassandra Spark Engineer

Phoenix, AZ
Full Time
Paid
  • Responsibilities

    CouchDB Cassandra Spark Engineer needs 5+ years experience CouchDB CouchDB CouchDB Cassandra Spark Engineer requires:

    • Expertise building data and processing pipelines

    • Familiarity with Spark engine syntax modules, including Spark SQL

    • Familiarity with APIs including RDD, DataFrame, Dataset, and PySpark

    • Fluency in programming languages including Python, Java, and Scala

    • Knowledge of Spark internals and streaming technology (Kafka, KSQL, etc.)

    • Expertise in SQL and big data processing (Hadoop ecosystems, Hive, Impala, Druid, etc.)

    • Familiarity with machine learning algorithms and foundations such as PyTorch

    • Experience with an ETL tool and expertise in managing the post-loading data

    • Expert in one or more distributed file systems, such as HDFS, S3, and Ceph

    • Familiarity with visualization tools

    • Familiarity with Amazon's AWS for building Apache Spark clusters

    CouchDB Cassandra Spark Engineer duties:

    • Provide technical, analytical knowledge and resolving technical challenges throughout project delivery.

    • Review code, testing case reviews, and ensuring that the code created matches the requirements are all part of the process.

    • Work proactively, autonomously, and collaboratively with global teams to solve project requirements and define issues/challenges with sufficient lead time to mitigate project delivery

  • Industry
    Financial Services