Job Role: Hadoop Data Engineer
Location: Dallas, TX
Duration: 6+ Months
ABOUT POSITION:
Experience Required: 10+ years of hands-on experience in Java (version 8 or above).
We are seeking an experienced Data Engineer with a strong background in Java, Spring Boot, Spark, and Scala, along with a deep understanding of big data and distributed systems.
The ideal candidate will be responsible for designing, building, and optimizing scalable data processing solutions, supporting both batch and real-time data pipelines.
WHAT YOU'LL DO:
Design, develop, and maintain scalable data processing applications using Java (8 or above) and Spring Boot.
Build and optimize big data pipelines using Spark and Scala for large-scale data processing.
Develop and consume RESTful web services for data integration and platform interoperability.
Implement and manage batch and streaming data pipelines using Spark Streaming and Kafka.
Write optimized Hive queries and SQL, focusing on performance and scalability.
Work on distributed data platforms leveraging Hadoop ecosystem components.
Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Ensure code quality through reviews, version control, and CI/CD best practices.
Troubleshoot and resolve performance, scalability, and data reliability issues
MANDATORY SKILLS:
8 12 years of hands-on experience in Java (version 8 or above).
Strong expertise in Spring Boot 2 framework.
Excellent proficiency in Spark.
Strong experience with Hive, SQL optimization, Hadoop Map Reduce, and Kafka Messaging Bus.
Solid understanding of REST Web Services.
Experience with version control systems such as Version Management GitLab.
Hands-on experience with build tools like Maven and/or Gradle.
Knowledge of CI CD & DevOps is a plus
Strong understanding of distributed systems and big data architecture.
Experience with streaming frameworks such as Spark Streaming and Kafka Messaging Bus.
Experience working in large-scale JD Edwards EnterpriseOne.
Exposure to Performance Tuning and SAP PMO Capacity planning for big data systems
...currently seeking a Vulnerability Management Analyst- Bilingual Japanese/English to join our... ...PCI DSS ISO 27001 NIST Framework SOC Controls ~ Maintain documentation for... ...clients needs. While many positions offer remote or hybrid work options, these...
...6 Closing Date: 10/22/2026 Agency: Department of Insurance Class Title: INSURANCE PERFORMANCE EXMNR TRN (2168... ...limited to, licensing and educating insurance agents, investigating Workers Compensation fraud, and examining the operations and finances of insurance...
...Job Title: Municipal Court Clerk Location: Elkins City Hall Schedule: Part-time, In-Office Position Overview: The City... ...the public, other municipalities, state officials, or state and federal legislative offices. Search files and contact witnesses, attorneys...
...Baptist New Mexican, manages the conventions Zoom systems, manages the conventions audiovisual resources and services, serves as podcast producer/editor, manages the BCNM connect app, manages the conventions internet domains, assists churches with technology matters,...
...GARNEY An Assistant Project Manager position is available through Garney. We are seeking for a motivated and detail-oriented professional to support the planning, coordination, and successful execution of construction and infrastructure projects in San Diego,...