Data Engineer 93155-1

Job Description

• Caterpillar is looking for a skilled Data Engineer to support digital product data platforms. The role focuses on data issue investigation, root cause analysis, and improving reliability and performance of data pipelines. The candidate will work closely with engineering and support teams to resolve complex data issues and build automation for proactive monitoring.

Key Responsibilities

• Identify, investigate, and resolve platform and data issues impacting digital product data
• Perform data triage, statistical analysis, and root cause analysis to diagnose issues
• Develop Python scripts and SageMaker scripts to correct data issues
• Perform break/fix tasks on data pipeline code
• Build automation tools and monitoring alerts to proactively detect data problems
• Improve data pipeline performance and reliability across platforms
• Collaborate with US and offshore teams in technical sync meetings
• Work with engineers, designers, and support teams to debug and test applications
• Provide Tier-2 support for data pipelines and production environments

Required Skills

• 5–7 years of Data Engineering / Data Operations / Data Management experience
• Strong SQL and Python development skills
• Experience with AWS serverless services (S3, Lambda, RDS, DynamoDB, SNS, SQS, Kinesis, IAM)
• Experience with AWS Cloud and Snowflake
• Knowledge of data pipelines, data quality, metadata, and data governance
• Experience building microservices using serverless AWS architecture

Preferred Skills

• AWS SageMaker, CloudWatch
• Strong Snowflake experience
• Experience with Data Lakes, Data Warehouses, and Big Data platforms
• Experience in Data Operations or Tier 2 Data Engineering Support
• Knowledge of Customer and Equipment data domains