Hadoop Developer (Atlanta, GA, or other unanticipated locations throughout U.S.).

About the job

Overview

Our team is looking for a Hadoop Developer.

Responsibilities

Responsibilities include: Helping to build big new data platforms/pipelines, identify existing data gaps, providing automated solutions to deliver advanced analytical capabilities and enriched data to applications that are supporting the operations team. Supporting new software projects within the Data & Engineering Analytics team. Logging and monitoring and implementing a cyber security Logging & Monitoring strategy that will Standardize Infrastructure/Apps/Sec. logs used by GIS. Analyzing Signals Intelligence -- Automated ETL and enrichment to mitigate and proactively identify and profile adversary behavior, infrastructure, tradecraft, and capability, at scale, speed, and depth not currently available with existing infrastructure and computational power. Delivering end-to-end software design and build process of Near-Real Time and Batch Data Pipelines. Working with SQL, MySQL, HIVE, Impala, SPARK SQL. Providing software data ingestion from message queue, file share, REST API, relational database, and data formats like json, csv, xml. Working with SPARK Structured steaming, Hadoop/Big Data and Distributed Systems. Supporting, troubleshooting software systems and admin/products. Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc. Designing software in Scala, Python, PHP, or Shell Scripting. Providing software/systems performance tuning with spark /MapReduce and/or SQL jobs, Linux operating. Working in Agile development process and applying a deep understanding of various phases of the Software Development Life Cycle. Using Source Code and Version Control systems like SVN, Git, Bit Bucket. Working with Jenkins and Jar management and SPARK Structured steaming. Understanding customer requests and providing appropriate solutions. Adapting, learning, and staying up to date on new technologies.

Qualifications

BA in Computer Science or closely related. 12 mon. exp as a Software Developer/Data Engineer. 12 mon. in: PySpark; Native JCB connectors for PostgreSQL; Data Lake; Centralized Data Storage; Scala; SQL; Hadoop; GDIT; Hive/Python Data Frames; Athena; AWS; AI; Cloud; Kubernets; Azure Cloud; Snowflake. Telecommuting permitted. U.S. 40 hrs/wk. 8:00 am – 5:00 pm.