Software Engineer-Big Data Hadoop, Hybrid, Charlotte, NC Job at Strategic Staffing Solutions, Charlotte, NC

Vmcxb29wbGp4eWJnNlRIMFFJMWVvMFA0U1E9PQ==
  • Strategic Staffing Solutions
  • Charlotte, NC

Job Description

STRATEGIC STAFFING SOLUTIONS (S3) HAS AN OPENING!

Strategic Staffing Solutions is currently looking for a Big Data Hadoop Engineer, a W2 contract opportunity with one of our largest clients!

Candidates should be willing to work on our W2 ONLY.

Software Engineer-ETL/Big Data Hadoop Engineer

Location- Charlotte, NC

Duration- 12 Months

Schedule: Hybrid

W2 only, no c2c

Pay: upto to $80

Job Descriptions:

Big Data Hadoop Engineer: -This is a need for someone to build and write the capabilities.- Experience building and enhance scala framework and spark experience-Java-Python. The Risk Data Services team is seeking a Lead Software Engineer.

Driving strategy for the team for entire platform and help with migration to cloud.Big Data Hub, the tools are used purely for ETL functions, moving and conforming data, not for building web applications.

The use of Python and Java is for Data Engineering, we are not seeking Web Developers, back and front end etc.

Job Expectations:

  • Design and implement automated spark-based framework to facilitate data ingestion, transformation and consumption.
  • Implement security protocols such as Kerberos Authentication, Encryption of data at rest, data authorization mechanism such as role-based access control using Apache ranger.
  • Design and develop automated testing framework to perform data validation. Enhance existing spark-based frameworks to overcome tool limitations, and/or to add more features based on consumer expectations. 
  • Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka and object storage architecture.
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure
  • Collaborate with application partners, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
  • Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure.
  • Support ongoing data management efforts for Development, QA and Production environments Provide tool support, help consumers

Required Qualifications:

  • 5+ years of experience of software engineering
  • 5+ years of experience delivering complex enterprise wide information technology solutions
  • 5+ years of experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as Hadoop
  • 5+ years of Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient Distributed Datasets (RDDs), Parquet or ORC file formats 6+ years of ETL (Extract, Transform, Load) Programming experience 
  • 2+ years of Kafka or equivalent experience
  • 2+ years of NoSQL DB like Couchbase/MongoDB experience.
  • 5+ experience working with complex SQLs and performance tuning

Desired Qualification

3+ years of Agile experience 

2+ years of reporting experience, analytics experience or a combination of both

2+ years of operational risk or credit risk or compliance domain experience 2+ years of experience integrating with RESTful API 

2+ years of experience with CICD tools.

Job ID: JOB-236687 Publish Date: 25 Jul 2024

Job Tags

Contract work,

Similar Jobs

Princeton University

Professional Specialist- Robotics Engineer for Automation of Ultrathin Brain Sectioning | Princeton University Job at Princeton University

 ...Position: Professional Specialist- Robotics Engineer for Automation of Ultrathin Brain Sectioning Description: The FlyWire Consortium, led by the Princeton Neuroscience Institute, recently released the first neuronal wiring diagram of an adult brain... 

Headway.co

Remote Data Engineer Job at Headway.co

 ...Andreessen Horowitz), Accel, GV (formerly Google Ventures), Spark Capital, Thrive Capital,...  ...: our mission excites you. We are working to solve the biggest problems in mental health...  ...~ HSA / FSA ~401K ~ Work-from-Home Stipend ~ Therapy Reimbursement ~... 

ABB

Customer Service Manager - Parts & Repair Job at ABB

Customer Service Manager - Parts & Repair At ABB, we are dedicated to addressing global challenges. Our core values: care, courage, curiosity, and collaboration - combined with a focus on diversity, inclusion, and equal opportunities - are key drivers in our aim to ...

University of California Berkeley

Lecturer - Criminal Law - School of Law | University of California Berkeley Job at University of California Berkeley

 ...Lecturer - Criminal Law - School of Law Position overview Salary range: The UC academic salary scales set the minimum pay at appointment. See the following table for the current salary scale for these positions: . The current full-time salary range for these... 

Agenda for Children

Early Care & Education Specialist Job at Agenda for Children

 ...OVERVIEW The Early Care & Education Specialist provides practice-based coaching and personalized support to teachers and program...  ...program goals. Provide training, observation, evaluation, consultation, modeling, and coaching, delivered both in-person and...