Hadoop Developer

Angajator: IBM Client Innovation Center Central Eastern Europe (CEE)
Domeniu:
  • IT Software
  • Tip job: full-time
    Nivel job: peste 5 ani experienta
    Orase:
  • BUCURESTI
  • Cluj Napoca
  • Timisoara
  • Job la nivel national
    Actualizat la: 18.10.2021
    Scurta descriere a companiei

    IBM Client Innovation Center Central & Eastern Europe (CEE) was established in 2012 by joining several centers in Europe. The Delivery Center is part of a global network of 80 similar centers and uses the best IBM methods of work, global processes and techniques. The center has achieved CMMI Level 5 (Capability Maturity Model Integration) and its mission is to provide customers with software solution customized to their global business needs.

    Cerinte

    At-least 2 years of Hadoop development and implementation experience -
    Experience with MapReduce and tools based on MR such as Pig etc.
    Experience with Apache Spark, Hive, HDFS,
    Experience with Cloudera, Hue, Impala -
    Test prototypes and oversee handover to operational teams
    Propose best practices/standards.
    Loading from disparate data sets.
    Pre-processing using Hive and Pig.
    Translate complex functional and technical requirements into detailed design.
    Perform analysis of vast data stores and uncover insights.
    Maintain security and data privacy.
    High-speed querying.

    Responsabilitati

    Design and development of Hadoop applications
    Writing programs according to system designs
    Writing MapReduce coding to create new Hadoop clusters
    Monitor and manage Hadoop cluster job performance capacity planning, plus security
    Pre-processing data using Pig and Hive software
    Understanding and finding solutions to problems
    Converting complex processes into detailed and functional designs
    Designing and developing web applications for querying and tracking data
    Maintaining the privacy and security of data
    Analyzing data to obtain insights
    Handling Hadoop log files