Immediate Need for Big Data Engineer local to NJ,NY

Immediate Need for Big Data Engineer local to NJ,NY

Big Data Engineer

Location: Princeton, NJ  08540

Duration: 6+Months

Job Responsibilities

• Selecting and integrating Big Data tools and frameworks required to provide requested capabilities
• Implementing ETL processes; documenting ETL processes
• Monitoring performance and advising any necessary infrastructure changes
• Defining data retention policies and assist in enforcement
• Formulate techniques for quality data collection to ensure adequacy, accuracy and legitimacy of data
• Devise and implement efficient and secure procedures for data handling and analysis with attention to all technical aspects
• Design and manage the migration of data from legacy systems to new data solutions
• Monitor and analyze information and data systems and evaluate their performance to discover ways of enhancing them (new technologies, upgrades etc.)
• Troubleshoot data-related problems and authorize maintenance or modifications

Required Skills & Experience

• Proficient understanding of distributed computing principles
• Management of Hadoop cluster, with all included services
• Ability to solve any ongoing issues with operating the cluster
• Proficiency with Hortonworks HDP ecosystem
• Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with Spark
• Experience with integration of data from multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Knowledge of various ETL techniques and frameworks
• Experience in SyncSort preferred; experience with Flume, SSIS a bonus
• Experience with various messaging systems, such as Kafka.
• Good understanding of Lambda Architecture, along with its advantages and drawbacks
• Experience with Hortonworks HDF (NiFi) is a big plus

Thanks & Regards

Syed Fariz

Phone No: 510-397-7851

Email: syed@staffing-aces.com

Staffing Aces, Inc.

http://www.staffing-aces.com/

14107 Mirasol Irvine, CA 92620

Note: This email is not intended to be a solicitation. If you have received this in error, please accept our apologies and reply in the subject heading with "REMOVE" to be removed from our mailing list. We regret any inconvenience this has caused to you. If you have already asked to be removed, and are currently continuing to receive our emails, please send us any older or alias email addresses.