BIG DATA (SPARK)

id/x partners provide consulting services that specializes in utilizing data mining solutions combined with an integrated risk management and marketing discipline to help clients optimize the portfolio profitability and business process. We want you to be part of our team, in which you will play a major role helping us to fundamentally aspect of our solutions.

As a you needed for this position, you will have the opportunity to build effective and efficient process for our software solutions.

You will be responsible:

• Building, Implementing, and maintaining code for big data ingestion using Spark, Impala, etc
• Designing schemas, data models and data architecture for Hadoop environments
• Developing and executing quality assurance and test scripts
• Work with business analysts to understand business requirements and use cases
• Problem solving and fixing technical issues
• Developing technical documentation

Qualification:

• Graduate Bachelor Degree of Computer Engineering, Informatics, Information System, Electrical Engineering
• Have 2+ years of development experience in area of Cloudera, Hadoop, SPARK, MapReduce, Hive, Impala, Kafka and HBASE
• Familiar with Linux/Unix Scripting, Sqoop, Oozie, and real time data ingestion into Hadoop
• Familiar with SoapUI, Postman, or other API Testing Tools
• Familiar with File Compression in Hadoop
• Familiar with Java (and/or Scala, Python)
• Familiar with application of standard software development principles.

Preferred qualifications:

• Self-motivated, driven, fast learner
• Have high commitment and able to meet project’s target in team with tight deadline
• Good communication, strong analytical skills, and problem-solving skills
• Possess good command of English