Job Description

Experience: 4 Years min Job Description We are looking for an experienced Big Data Engineer that will work on the collecting, storing, processing, and analysing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating processed data with machine learning algorithms and deep learning frameworks to solve complex business issues. Responsibilities Use appropriate big data technologies to create data pipes and process huge datasets for generating required business insights Utilise statistical learning techniques for answering statistically the business relevant questions Be part of internal practice for creation of market sensitive data frameworks and POCs Utilize the traditional database knowledge for supporting classic ETL systems Able to work within engineering team or as an individual performer Skills Proficient understanding of distributed computing principles Proficiency with big data ecosystem and willingness to learn and grow big with technologies like Hadoop, HDFS, Pig, Hive, Sqoop, Flume, Oozie, Zookeeper, Spark, NoSQLs Mathematical background to effectively utilise machine learning and deep learning technologies and frameworks like SparkML, Tensorflow, Pytorch/Caffe2 Most desired skill: ability to learn things quickly