Data Engineer

Data Engineering Requirements

1. Core Technical Skills

• Strong Python programming skills with experience in debugging and performance optimization
• Hands-on experience with Apache Airflow (DAG development, scheduling, monitoring, troubleshooting)
• Experience using AWS Performance Insights for database performance monitoring and tuning
• Solid understanding of data engineering concepts (ETL/ELT pipelines, data modeling, data validation, logging, and monitoring)

2. PostgreSQL Expertise

• Strong knowledge of PostgreSQL
• Experience working with:
  • Table-Valued Functions (TVFs)
  • Views
  • Materialized Views
  • Foreign Data Wrappers (FDW) and cross-database querying concepts
• Query optimization and performance tuning skills

3. Linux / Ubuntu Proficiency

• Good understanding of Ubuntu/Linux environment
• Familiarity with:
  • SSH for remote access and server management
  • Basic Bash commands (file operations, process monitoring, logs inspection)

4. API Knowledge

• Understanding of REST APIs
• Experience working with:
  • GET and POST methods
  • API integration and debugging