Senior Big Data Developer

Develop expertise in trade surveillance data infrastructure and application portfolio,

Design and implement scalable data pipelines, ETL processes, and data integration solutions,

Build and optimize data models and database schemas,

Collaborate with cross-functional teams to gather requirements and translate them into technical data solutions,

Implement data quality frameworks and monitoring,

Provide technical guidance on data architecture, best practices, and emerging technologies,

Support production data systems and troubleshoot data-related issues,

Document data processes, pipelines, and system architecture,

7+ years of hands-on development experience with big data technologies (Spark, Scala, distributed computing frameworks),

Strong programming skills in Scala and Python for production-grade applications,

Proven experience with big data platforms (Databricks, Snowflake, or Hadoop ecosystem),

Knowledge of streaming technologies (Kafka, Spark Streaming) and event-driven architectures,

Solid understanding of data structures, algorithms, and performance optimization for large-scale data processing,

Experience with version control, testing frameworks, and CI/CD practices

Experience with kdb+ or time-series databases for financial data,

Familiarity with containerization and cloud-native development (Docker, Kubernetes),

Capital Markets/Wealth management and/or regulatory/compliance domain knowledge