Job Description

Role: Senior Data Engineer

Location: Remote

Duration: Fulltime/Permanent Job

Job Description

Must Have Technical/Functional Skills

Google Cloud Platform (GCP)
PySpark
Python
Airflow
Hive
Kafka

Data Pipeline Development, Enhancement & Maintenance

Design, build, and maintain scalable ETL/ELT pipelines.
Automate data ingestion from multiple data sources.
Ensure reliable, high-performance, and scalable data movement.
Develop and optimize PySpark-based data processing frameworks.
Build and manage Airflow workflows and orchestration pipelines.
Work with Hive and Kafka-based batch and streaming data solutions.
Implement data quality, monitoring, governance, and operational controls.
Support production incidents, performance tuning, and continuous improvement initiatives

Roles & Responsibilities

The Data Engineer will be responsible for designing, building, governing, and optimizing data platforms, pipelines, and integrations to ensure secure, reliable, and scalable data availability for analytics, reporting, AI/ML, and business operations.

Preferred Experience

Strong Functional Knowledge in Retail (Search & Personalization) Added advantage.
Strong experience with large-scale GCP Data Engineering solutions.
Hands-on experience with Airflow DAG development and support
Experience building and optimizing Spark/PySpark data pipelines.
Exposure to Hive-based data processing and Kafka-driven ingestion frameworks.
Experience supporting analytics, personalization, recommendation, or search platforms is highly desirable

Job Tags

Permanent employment, Full time, Remote work

Similar Jobs

Confidential employer

Medical Receptionist Job at Confidential employer

The medical receptionist supports a busy outpatient office in Queens by helping patients check in, update records, and move through their visits efficiently. This role typically answers phones, schedules and confirms appointments, collects basic demographic and insurance...

Freeport McMoRan

Mine Crush/Convey Diagnostic Mechanic I Job at Freeport McMoRan

...skilled mechanic who safely perform diagnostic, maintenance, installation, and repair of equipment and processes in the underground crush and convey system. Perform maintenance repairs on crusher and belt systems which may include: crusher overhauls, liner changes...

Athletes Global Corporation

Leadership (Mentoring) Instructor Job at Athletes Global Corporation

...develop leadership and life skills. This is an excellent opportunity for educators, youth mentors, counselors, education majors, coaches, and professionals who enjoy making a lasting impact on students through leadership development and mentorship. Application...

AECOM

Environmental Permitting Specialist/Natural Resource Scientist Job at AECOM

...Northeast Environmental Planning & Permitting Department has a career opportunity for a mid-level Environmental Permitting Specialist/Natural Resource Scientist in our New England Office Locations.The position is remote but will require time in offices or client sites as...

Always Best Care Senior Services - Oahu

Life Coach for Wounded Warrior (Life Skills Coach) Job at Always Best Care Senior Services - Oahu

...$25.00/hr | Weekly PayJob Type: Full-time / Part-time | Flexible Schedule This is not a typical caregiver role. The Life Coach for Wounded Warrior (Life Skills Coach) is a community-based position supporting an individual with brain injury, PTSD, neurological...

Senior Data Engineer Job at SFE, Seattle, WA