Hadoop Developer

IBM Client Innovation Center Central & Eastern Europe (CEE) was established in 2012 by joining several centers in Europe. The Delivery Center is part of a global network of 80 similar centers and uses the best IBM methods of work, global processes and techniques. The center has achieved CMMI Level 5 (Capability Maturity Model Integration) and its mission is to provide customers with software solution customized to their global business needs.

At-least 2 years of Hadoop development and implementation experience -
Experience with MapReduce and tools based on MR such as Pig etc.
Experience with Apache Spark, Hive, HDFS,
Experience with Cloudera, Hue, Impala -
Test prototypes and oversee handover to operational teams
Propose best practices/standards.
Loading from disparate data sets.
Pre-processing using Hive and Pig.
Translate complex functional and technical requirements into detailed design.
Perform analysis of vast data stores and uncover insights.
Maintain security and data privacy.
High-speed querying.

Design and development of Hadoop applications
Writing programs according to system designs
Writing MapReduce coding to create new Hadoop clusters
Monitor and manage Hadoop cluster job performance capacity planning, plus security
Pre-processing data using Pig and Hive software
Understanding and finding solutions to problems
Converting complex processes into detailed and functional designs
Designing and developing web applications for querying and tracking data
Maintaining the privacy and security of data
Analyzing data to obtain insights
Handling Hadoop log files