Data Engineer (Junior - Middle)

Key Responsibilities

Develop and maintain scalable data pipelines and ETL processes using Python/Go, Apache NiFi, and other related technologies. Design and implement efficient data processing, data storage, and data integration solutions that align with business needs. Monitor, optimize, and troubleshoot data systems to ensure performance, scalability, and reliability. Build and maintain data warehousing and data mart solutions using PostgreSQL/ClickHouse. Collaborate with cross-functional teams to support data requirements for reporting, analytics, and applications.

Mandatory Requirements

Minimum 2 - 4 years of experience in software development, with a focus on data engineering or big data technologies. Strong understanding of data structures, algorithms, and database design principles. Proficiency in SQL, with hands-on experience using PostgreSQL or ClickHouse. Comfortable working in Unix-like operating systems. Experience with Bash/Shell scripting.

Nice to Have Experience working in cloud environments (AWS, Azure, or Google Cloud Platform). Knowledge of containerization technologies such as Docker and Kubernetes. Understanding of distributed systems and microservices architecture. Experience with big data technologies such as Kafka, NiFi, or related tools.