Job Details

• Produce a detailed functional design document to match customer requirements.
• Responsible for Preparation, reviewing and owning Technical design documentation.
• Reviews, and preparing documents for Big Data applications according to system standards.
• Conducts peer reviews to ensure consistency, completeness and accuracy of the delivery.
• Detect, analyse, and remediate performance problems.
• Evaluates and recommends software and hardware solutions to meet user needs.
• Responsible for project support, support mentoring, and training for transition to the support team.
• Share best practices and be consultative to clients throughout duration of the project.
• Hands-on experience in working with Hadoop Distribution platforms like HortonWorks, Cloudera, MapR and others.
• Take end-to-end responsibility of the Hadoop Life Cycle in the organization
• Be the bridge between data scientists, engineers and the organizational needs.
• Do in-depth requirement analysis and exclusively choose the work platform.
• Full knowledge of Hadoop Architecture and HDFS is a must
• Working knowledge of MapReduce, HBase, Pig, MongoDb, Cassandra, Impala, Oozie , Mahout, Flume, Zookeeper/Sqoop and Hive
• In addition to above technologies , understanding of major programming/scripting
• languages like Java, Linux, PHP, Ruby, Phyton and/or R
• He or she should have experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS and/or knowledge on NoSQL platforms
• Must have minimum 3+ years hands-on experience in one of the Big Data Technologies (I.e. Apache Hadoop, HDP, Cloudera, MapR)
• MapReduce, HDFS, Hive, Hbase, Impala, Pig, Tez, Oozie,
• Hands on experience in designing and developing BI applications
• Excellent knowledge in Relational, NoSQL, Document Databases, Data Lakes and cloud storage
• Expertise in various connectors and pipelines for batch and real-time data collection/delivery
• Experience in integrating with on-premises, public/private Cloud platform
• Good knowledge in handling and implementing secure data collection/processing/delivery
• Desirable knowledge with the Hadoop components like Kafka, Spark, Solr, Atlas
• Desirable knowledge with one of the Open Source data ingestion tool like Talend, Pentaho, Apache NiFi, Spark, Kafka
• Desirable knowledge with one of the Open Source reporting tool Brit, Pentaho, JasperReport, KNIME, Google Chart API, D3

• Minimum 4-7 years of hands-on experience with statistical software tools: SQL, R, Python
• 3+ years’ experience in business analytics, forecasting or business planning with emphasis on analytical modeling, quantitative reasoning and metrics reporting
• Experience working with large data sets in order to extract business insights or build predictive models
• Proficiency in one or more statistical tools/languages – Python, Scala, R, SPSS or SAS and related packages like Pandas, SciPy/Scikit-learn, NumPy etc.
• Good data intuition / analysis skills; sql, plsql knowledge must
• Manage and transform variety of datasets to cleanse, join, aggregate the datasets
• Hands-on experience running in running various methods like Regression, Random forest, k-NN, k-Means, boosted trees, SVM, Neural Network, text mining, NLP, statistical modelling, data mining, exploratory data analysis, statistics (hypothesis testing, descriptive statistics)
• Industry experience in building and operationalizing various machine and deep learning models in finance/other domain would advantage
• Deep domain (BFSI, Manufacturing, Auto, Airlines, Supply Chain, Retail & CPG) knowledge
• Demonstrated ability to work under time constraints while delivering incremental value.
• Education Minimum a Masters in Statistics, or PhD in domains linked to applied statistics, applied physics, Artificial Intelligence, Computer Vision etc.

Reference ID - GH/IT/ JC//27032019//82720/Big Data/Data Scientist