Job Search

Senior Data Engineer

Posted on:

18/03/2023

Closing on:

25/03/2023

Contact email:

Brief description :

•       Extensive Programming Experience as a Data/ETL Engineer in Distributed Data Ingestion, Processing/Computing

•       Experience in different data formats processing using JSON, Avro, Parquet

•       Data Warehousing and Dimensional Data Modelling Skills

•       Experience on Data Warehouse platforms (Data - Mapping, Modelling, Extract, Load, and Transformations)

•       Python/Scala and Spark/PySpark Programming

•       Job Schedulers(Airflow)

•       Very Good at SQL

•       Data Ingestion and Programming using Kafka

•       Search Engines(Elasticsearch)

•       Azure Data Factory, Snowflake (Good to have)

Responsibilities:

•       Analyse and organize raw data 

•       Build data systems and pipelines

•       Evaluate business needs and objectives

•       Interpret trends and patterns

•       Conduct complex data analysis and report on results 

•       Prepare data for prescriptive and predictive modeling

•       Build algorithms and prototypes

•       Combine raw information from different sources 

•       Explore ways to enhance data quality and reliability

•       Identify opportunities for data acquisition

•       Develop analytical tools and programs

•       Collaborate with data scientists and architects on several projects

Preferred skills

Technical Skills/Tools: 

Primary : 

•       Spark (Scala/Python)

•       Spark SQL,

•       Spark Streaming

•       SQL and Databricks

Secondary :

•       Kafka

•       Hadoop Tech Stack,

•       Azure/Cloud

•       NoSQL Database,

•    Time Series Database, Linux/Shell scripting

Send your resume with the subject line: Application for 'Job Position '