Your Role

As a Senior Data Platform Engineer, you will:

• Design and build high-performance, production-grade microservices and cloud-native data processing pipelines.
• Help evolve a modern, event-driven ecosystem that powers Cognism’s core data products.

Your Challenges & Opportunities

• Design & Build at Scale: Develop and maintain scalable batch and streaming data pipelines using Apache Spark, AWS Glue, and broader AWS tools.
• Develop Robust Microservices: Build high-quality services in Scala (Play Framework and Pekko) integrated into a distributed data processing platform.
• Own Production Systems: Deploy services using ECS or EC2, ensuring systems are reliable, scalable, and performant.
• Drive Technical Excellence: Identify and resolve bottlenecks in existing systems, applying strong engineering practices and performance tuning.
• Be a Technical Leader: Mentor teammates, drive architectural decisions, and elevate the overall engineering bar.
• Collaborate Cross-Functionally: Work closely with data, engineering, and platform teams to design cloud-native and event-driven solutions.
• Champion Best Practices: Improve our CI/CD pipelines, testing coverage, and developer experience.
• Own End-to-End Delivery: Take responsibility for services and systems from design through to production operations.

Our Expectations

• Experienced Engineer: 6+ years in software engineering, ideally with a focus on distributed systems or large-scale data platforms.
• Scala Expertise: Proficiency in Scala or a similar strongly typed, object-oriented or functional language.
• Advanced Data Skills: Expertise in Apache Spark and performance tuning for large-scale data jobs.
• Cloud-Native Mindset: Experience with AWS services such as Glue, Lambda, S3, DynamoDB, Step Functions, EventBridge, API Gateway, ECS, and EC2.
• Systems Thinking: Strong grasp of microservices, reactive and event-driven architecture, batch vs streaming patterns, and scalable system design.
• Message Broker Mastery: Hands-on experience with Kafka (Confluent) and/or RabbitMQ.
• Modern Data Lakes: Familiarity with Apache Iceberg or similar formats like Delta Lake or Hudi.
• Software Engineering Craftsmanship: CI/CD, testing, clean code, and maintainable service design.
• Excellent Communicator: Strong communication skills with a collaborative and ownership-driven mindset.

Nice to Have

• Experience developing Scala microservices with Play Framework or Pekko.
• AWS Glue job optimization or EMR experience.
• Familiarity with schema evolution, data contracts, or data versioning.
• Exposure to data governance, lineage, or compliance tooling.
• Experience with Infrastructure as Code (Terraform or CloudFormation).
• Knowledge of domain-driven design (DDD), event sourcing, or CQRS patterns.

Why Cognism

At Cognism, we’re building an inclusive community of brilliant, diverse people who support, challenge, and inspire each other every day. Our values guide how we work, treat each other, and grow together. We celebrate individual contributors and welcome applications from individuals typically underrepresented in tech. If this role excites you but you’re unsure if you meet every requirement, we encourage you to apply!

Our Values:

• ✅ We Are Nice! We treat each other with respect and kindness.
• 🤝 We Are Collaborative. Great things happen when we work as one.
• 💡 We Are Solution-Focused. Every challenge is just an opportunity in disguise.
• 💙 We Are Understanding. We empower and support each other to do our best work.
• 🏆 We Celebrate Individual Contributors. Every role matters, and so do you!