Data Engineer
Full-time
Company Description
We are a global algo trading company fully dedicated to technology. Our brilliant team comprises 100+ individuals scattered across the globe. Seventy percent of our team members are technical specialists, encompassing development, infrastructure, testing, and analytics, while the rest comprise business units, including operations, legal, finance, etc.
Job Description
Responsibilities
Create ETL processes and data marts. Design linearly scalable client wrappers for interacting with exchange APIs, brokers, data aggregators, vendors, and blockchains. Work with FIX, HTTP, WebSocket, and gRPC protocols. Configure monitoring systems to ensure the reliability of ETL processes. Develop BI dashboards/reports using data visualization tools such as Grafana, Tableau, Lightweight Charts, and Google Sheets. Analyze and compare diverse data sources, their costs, and the amount of effort required to obtain them. Search for data from non-normalized sources, such as news, social media, or websites.
Qualifications
Strong proficiency in SQL: aggregations, joins, subqueries, window functions (first, last, candle, histogram), indexes, query planning, and optimization. Proficiency in Python. Experience in designing database schemas: normalization/denormalization within the scope of OLAP/OLTP. Understanding of different data storage architectures (Data Warehouse, Data Lake). Experience working with databases such as PostgreSQL + TimescaleDB or ClickHouse. Experience with raw data, including cleaning, normalization, and enrichment (CSV, JSON, PCAP, FIXML, etc.). Experience with large datasets (1TB+) and understanding of data architecture for high-load systems. Ability to work in a rapidly changing, dynamic environment.
Nice to have:
Proficiency in Docker, Airflow, and Kafka tools. Experience and/or willingness to transition to Go, Rust. Experience with the Hadoop ecosystem (HDFS, Hive, Spark). Understanding high-level business tasks and independently determining the data needed to solve them. Knowledge of basic trading statistics such as PnL, trading volumes, funding and interest rates, profitability, variation margin, spreads, convert rates, weighted average prices, etc. Knowledge of financial markets and high-frequency trading systems. Experience with real-time data processing and streaming data technologies.
Additional Information
What we offer:
Working in a modern international technology company without bureaucracy, legacy systems, or technical debt. Excellent opportunities for professional growth and self-realization. We work remotely from anywhere in the world, with a flexible schedule. We offer compensation for health insurance, sports activities, and non-professional training.
Data Engineer
Dubai - United Arab Emirates * Full-time
