YOU ARE HERE :   Home Jobs By Category IT Software - DBA / Datawarehousing HADOOP ENGINEER

HADOOP ENGINEER

HADOOP ENGINEER ( Job Ref : 4NDICK269734 )

Buxton Consulting

View Company Profile

Job Summary

Job Title:
HADOOP ENGINEER
Job Location:
Pleasanton - California
Category :
IT Software - DBA / Datawarehousing
Industry:
Information Technology
Work Type:
Full Time
Job Role:
Software Developer
Job Type:
Regular
Annual Salary:
Confidential
Experience Required:
5-8 Years
Job Description

Technical Knowledge and Skills:

Consultant resources shall possess most of the following technical knowledge and experience:

  • Provide technical leadership, develop vision, gather requirements and translate client user requirements into technical architecture.
  • Strong Hands-on Experience in building, deploying and productionizing ML models using software such as Spark MLLib, TensorFlow, PyTorch, Python Scikit-learn etc. is mandatory
  • Ability to evaluate and choose best suited ML algorithms, perform feature engineering and optimize Machine Learning Models is mandatory
  • Strong fundamentals in algorithms, data structures, statistics, predictive modeling, & distributed systems is must
  • Design and implement an integrated Big Data platform and analytics solution
  • Design and implement data collectors to collect and transport data to the Big Data Platform.
  • 4+ years of hands-on Development, Deployment and production Support experience in Hadoop environment.
  • 4-5 years of programming experience in Java, Scala, Python.
  • Proficient in SQL and relational database design and methods for data retrieval.
  • Knowledge of NoSQL systems like HBase or Cassandra
  • Hands-on experience in Cloudera Distribution 5.x
  • Hands-on experience in creating, indexing Solr collections in Solr Cloud environment.
  • Hands-on experience building data pipelines using Hadoop components Sqoop, Hive, Pig, Solr, MR, Spark, Spark SQL.
  • Must have experience with developing Hive QL, UDF’s for analyzing semi structured/structured datasets.
  • Must have experience with Spring framework
  • Hands-on experience ingesting and processing various file formats like Avro/Parquet/Sequence Files/Text Files etc.
  • Hands-on experience working in Real-Time analytics like Spark/Kafka/Storm
  • Experience with Graph Databases like Neo4J, Tiger Graph, Orient DB
  • Must have working experience in the data warehousing and Business Intelligence systems.
  • Expertise in Unix/Linux environment in writing scripts and schedule/execute jobs.
  • Successful track record of building automation scripts/code using Java, Bash, Python etc. and experience in production support issue resolution process.
  • Experience with R, Jupyter/Zeppelin

Preferred Skills:

Strong SQL skills

Java, Spring, Scala, Cloudera Hadoop, MLLib, Spark, HBase, Neo4j, Solr, Python, Machine Learning

Demonstrable Skills:

  • Strong analytical skills with the ability to analyze information and identify and formulate solutions to problems.
  • Provide more in-depth analysis with a high-level view of goals and end deliverables.
  • Complete work within a reasonable time frame under the supervision of a manager or team lead.
  • Plan and manage all aspects of the support function.
  • Extensive knowledge of and proven experience with data processing systems, and methods of developing, testing and moving solutions to implementation.
  • Strong knowledge in project management practices and ability to document processes and procedures as needed.
  • Work collaboratively with other support team members and independently on assigned tasks and deliverables with minimum supervision
  • Communicate effectively with users at all levels, from data entry technicians up to senior management, verbally and in writing.
  • Self-motivated, working closely and actively communicating with team members to accomplish time critical tasks and deliverables
  • Ask questions and share information gained with other support team members, recording and documenting this knowledge
  • Elicit and gather user requirements and/or problem description information, and record this information accurately
  • Listen carefully and act upon user requirements
  • Convey and explain complex problems and solutions in an understandable language to both technical and non-technical persons
  • Present technical solutions to management and decision makers
  • Follow the lead of others on assigned projects as well as take the lead when deemed appropriate
  • Think creatively and critically, analyzing complex problems, weighing multiple solutions, and carefully selecting solutions appropriate to the business needs, project scope, and available resources
  • Take responsibility for the integrity of the solution

Buxton Consulting

Buxton Consulting

Established in :

5976 W. Las Positas Blvd., Suite 200, Pleasanton, California - 94588, United States

Website : http://www.buxtonconsulting.com/

videoVideos photo Images

RKA Jobs, LLC. has taken all reasonable steps to ensure that information on this site is authentic. Applicants are advised to research bonafides of advertisers independently. RKA Jobs, LLC. shall not have any responsibility in this regard. We also recommend that you visit Privacy Policies and Terms of use for more comprehensive information on this aspect.

Get the latest jobs
emailed to you inbox.

Already Registered !! Login

Tool to help you

  • Fast Upload

    Fast Upload

    Upload your resume and get noticed by recruiters to receive the latest job post and vacancies right away to your email.

     
  • Advanced Skill Search

    Advanced Skill Search

    Our advanced search tool select the key elements of your profile,or the choices made therein and provides you with the best results.

     
  • Resume Writing

    Scale Up for Interview

    Get the best Interview tips from our ace career advisors, to mould you best for any interview you choose to crack.

     
  • Resume Writing

    Resume Writing

    Showcase the best of you with our resume writing tips and never miss a chance to get noticed by the recruiters.

     
  • Resume Database

    Resume Database

    Connect to our resume database that holds the best of resume for you to search the finest candidate matching your requirement.

     
  • Talent Hunt

    Talent Hunt

    Step ahead, take the advantage of posting the right job with the right skills you require.

     
  • Universe Services

    Universe Services

    Fast and easy way to recruit; provided with a world class service, we give you the choice of the most economical membership plan to best suit your requirement.

     
 

Subscribe For Newsletter