As a Senior Information Engineer on our Unified Platform group, you’ll play an integral function in designing and construction an cutting edge information platform utilized by Buyers, Quantitative Researchers, and Again-Administrative center group of workers to investigate monetary markets, resolve buying and selling alternatives, identify new methods, and make sure clean back-office processes.
Technical necessities abstract:
- Have revel in designing and construction data-intensive allotted techniques
- Have revel in operating throughout the trendy batch and streaming information ecosystems
- A professional in Java/Scala or Python and feature revel in with SQL and Bash
- Ready to possess, arrange, and steer group tasks
- Be capable to give a contribution to challenge control and challenge reporting
- Be a pace-setter/mentor to junior contributors of the group relating to engineering best-practices and code-quality
What you’ll do on this function:
- Lend a hand design, construct, and set up DRW’s Unified Information Platform and strengthen its customers.
- Paintings intently with Buyers and Researchers to resolve suitable information assets and put in force processes to onboard and set up new information assets for research to release long term buying and selling alternatives.
- Design and broaden information answers to assist uncover, acquire, arrange, monitor utilization, set up rights, and keep watch over high quality of information units to deal with the wishes of more than a few DRW buying and selling groups and techniques.
- Regularly observe information ingestion pipelines and knowledge high quality to verify steadiness, reliability, and high quality of the knowledge. Give a contribution to the tracking and high quality keep watch over tool and processes.
What you’ll want on this function:
- 7+ years of revel in operating with trendy information applied sciences and/or construction data-intensive allotted techniques
- Knowledgeable stage talents in Java/Scala or Python with a confirmed talent to output top quality, maintainable, code
- Sturdy familiarity with SQL and Bash
- Revel in leveraging and construction cloud-native applied sciences for scalable information processing.
- Prior revel in with each batch and streaming techniques and an figuring out of the constraints the ones paradigms impose
- Revel in with an array of information processing applied sciences (e.g. Flink, Spark, Polars, Dask, and so forth.)
- Revel in with an array of information garage applied sciences (e.g. S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, and so forth.)
- Revel in with an array of information codecs and serialization techniques (e.g. Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, and so forth.)
- Revel in managing complicated information ETL Pipelines (e.g. Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, and so forth.)
- Prior revel in coping with schema governance and schema evolution
- Prior revel in growing information high quality keep watch over processes to stumble on information gaps or inaccuracies
- A need to mentor much less skilled team-members and champion each engineering best-practices and top code-quality requirements.
- Sturdy technical problem-solving talents
- Confirmed talent to paintings in an agile, fast paced surroundings, prioritize more than one duties and tasks, and successfully care for the calls for of a buying and selling surroundings
The yearly base wage vary for this place is $180k to $250x, relying at the candidate’s revel in, {qualifications}, and related talent set. The placement could also be eligible for an annual discretionary bonus. As well as, DRW provides a complete suite of worker advantages together with crew clinical, pharmacy, dental and imaginative and prescient insurance coverage, 401k (with discretionary employer fit), quick and long-term incapacity, existence and AD&D insurance coverage, well being financial savings accounts, and versatile spending accounts.
Recommend a fun game: sprunki download
