Location: Whippany, NJ
Position Type: Contract / Full-Time (Hybrid)
Work Mode: 2-3 days onsite per week
What You’ll Do
-
Build, deploy, and maintain large-scale distributed data processing systems and pipelines to support enterprise data needs.
-
Design and lead end-to-end Big Data solutions: from ingestion, storage, processing to access; ensure scalability, reliability, and performance.
-
Develop batch and streaming workflows using Spark, Hadoop, Kafka, HBase, Hive, Impala, and NoSQL databases.
-
Monitor system health, analyze performance metrics, troubleshoot issues (including Cloudera/Hadoop logs), and effect cluster configuration and performance optimizations.
-
Use AutoSys for job scheduling and monitoring; ensure jobs run reliably, manage failures, and automate recovery where possible.
-
Enforce and implement data governance, data security, and data management best practices across the Big Data platform.
What You Bring
-
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
-
8-10 years of software development/data engineering experience working with large-scale distributed systems.
-
Minimum 4 years leading Big Data solution designs and implementations in enterprise environments.
-
Strong programming skills in Java, J2EE, Scala.
-
Deep hands-on experience with Hadoop ecosystem: Spark, HDFS, YARN, Hive, Impala, Sqoop, HBase; Kafka; NoSQL DBs.
-
Solid experience with SQL, ElasticSearch, Oracle, and relational/non-relational data stores.
-
Proficient in using AutoSys (or similar) for job scheduling and monitoring.
-
Strong troubleshooting skills—performance tuning, logs analysis, cluster issues.
-
Knowledge of data governance and Hadoop/Cloudera security best practices.
-
Working experience with Linux, version control (Git), and CI/CD toolchains (Jenkins etc.).
Ideal Skills
-
Familiarity with cloud-based Big Data / data lake architectures (AWS, Azure, or GCP).
-
Experience with containerization / orchestration (Docker, Kubernetes) is a plus.
-
Ability to mentor & guide junior engineers.
-
Excellent communication skills, strong attention to detail, and ability to work cross-functionally.
Engagement Rules
- Contract Position (W2 only) – No C2C, No Agencies.
- This is a senior-level role requiring 8+ years of professional experience in data engineering and financial services.
- Entry-level applicants will not be considered.
- Candidates must have verifiable project experience in big data and Java development.
- H1-B transfer available for the right candidate.
- Multi-year contract with annual extensions.
- Hybrid onsite role (Whippany, NJ).