Big Data Developer

Job description

Responsibilities:

• Meeting with managers to determine the company’s Big Data needs.
• Developing Hadoop systems.
• Loading disparate data sets and conducting pre-processing services using Hive or Pig.
• Finalizing the scope of the system and delivering Big Data solutions.
• Managing the communications between the internal system and the survey vendor.
• Collaborating with the software research and development teams.
• Building cloud platforms for the development of company applications.
• Maintaining production systems.
• Training staff on data resource management.

Requirements:

• Bachelor’s degree in computer engineering or computer science.
• Previous experience as a big data engineer.
• In-depth knowledge of Hadoop, Spark, and similar frameworks.
• Knowledge of scripting languages including Java, C++, Linux, Ruby, PHP, Python, and R.
• Knowledge of NoSQL and RDBMS databases including Redis and MongoDB.
• Familiarity with Mesos, AWS, and Docker tools.
• Excellent project management skills.
• Good communication skills.
• Ability to solve complex networking, data, and software issues.