BIG DATA/HADOOP CONSULTANT
CERTIFIED HADOOP DEVELOPER
Summary of Qualifications:
Overall 12 years of experience in Architect, Analysis, Design, Development, Testing, Implementation,
Maintenance and Enhancements on various IT Projects. Around 3 Years of experience in Big Data in implementing
complete Hadoop solutions.
Hands on experience in using Apache Hadoop ecosystem components like Hadoop Distributed File System
(HDFS), MapReduce, PIG, HIVE, ZOOKEEPER, SQOOP, Hue, Maven, AVRO and JSON.
Expertise in writing Hadoop Jobs for analyzing data using MapReduce, Apache Crunch, Hive and Pig.
Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems (RDBMS) and
vice-versa.
In depth understanding/knowledge of Hadoop Architecture and various components such as HDFS, Job Tracker,
Task Tracker, Name Node, Data Node and MRv1 and MRv2 (YARN).
Experience in analyzing data using Hive QL, Pig Latin, and custom MapReduce programs in Java.
Experience in job workflow scheduling and monitoring tools like Oozie.
Proficient in using Cloudera Manager, an end to end tool to manage Hadoop operations.
Experience in Core Java, JDBC and proficient in using Java API’s for application development.
Strong working experience in SQL concepts.
Experience in working with Windows, UNIX/LINUX platform with different technologies such as Big Data,
SQL, XML, HTML, Core Java, Shell Scripting etc.
Excellent domain knowledge in Insurance and Finance. Excellent interpersonal, analytical, verbal and written
communications skills.
Excellent working experience in Scrum / Agile framework and Waterfall project execution methodologies.
Technical Expertise:
HADOOP ECOSYSTEM HDFS, MapReduce, Hive, Pig, Hbase, ZooKeeper, Sqoop,
Hue, Hcatalog
LANGUAGES Java , Cobol, Jcl
TECHNOLOGIES JDBC, Java Beans, JavaScript, AJAX, XML and HTML
DEVELOPMENT Waterfall, Iterative, Spiral, View and Agile
APPROACH
TESTING TOOLS JUnit3.8/4.0, J Meter and Test Driven Development (TDD)
DEFECT TRACKING HP Service Manager, Remedy
TOOLS
Eclipse 3.2, 3.3, 3.5, Eclipse RCP, My Eclipse 6.0 and IBM
IDE Rational Application Developer 6.0, 7
VERSION CONTROLS SVN and Changeman
WEB SERVICE SOAP, REST, JAX-RPC, JAX-WS, JAXB, WSDL and UDDI
PROTOCOLS
BUILD TOOLS Maven
DATABASE IBM DB2, IMS and SQL Server
PROCESSES SDLC and Rational Unified Process (RUP)
PROTOCOLS TCP/IP, HTTP, HTTPS, TELNET, FTP and LDAP
OPERATING SYSTEMS All Version of Microsoft Windows, Z/OS and LINUX
dcuFooter
Education
Master of Technology from REC – W (Currently known as NITs), Andhra Pradesh, India.
Certifications
Cloudera Certified Developer for Apache Hadoop CDH4 - CCD- 410.
ITIL V3 Certified.
Professional Experience:
Capital One – Richmond, VA.
March 2012 – Till Date.
Hadoop Developer.
Responsibilities:
Performed analysis, design and development and testing on Bank Operational Data Store
Datasets application.
Design, developed and tested Map Reduce programs(MR Unit) on Book Of Business
Savings, Balance History datasets to perform analytics on Current, Monthly (MTD),
Quarterly (QTD) AVG balances.
Used Oozie for work flow management.
Performed Analysis, design, developed and tested Map Reduce programs on Remote
Deposit Capture RMOT_DEP_LMT_TIER dataset to capture DLY_MAX_TOT_DEP_AMT and
ROLLG_30D_MAX_TOT_DEP_AMT on the provided account number and System of record
ID (SOR) using MR, PIG and HIVE.
Took ownership of Book Of Business, Remote Deposit Capture, REG E IM, ATM and ACH
transactions datasets and analyzed to provide the Account level/SorId Level/Date range
and amount range analytics and store the data on HDFS.
Provided solutions for different Integration and user acceptance testing issues.
Coordinating with offshore team and provide them analysis and guidance.
Ensured the timely completion of the Unit and Integration Testing, testing effort on the
project by coordinating with Business SMEs / IT , interface teams and stake holders.
PitneyBowes - Danbury, CT.
Nov 2010 to Feb 2012.
Java Developer.
Responsibilities:
Developed, tested and deployed the JAVA, XML, IMS path programs to update the contract
DB from the front-end system.
Reduced the CPU utilization by Analyzing IMS calls vs. DB2 Calls, coding, testing.
Worked on SSCRs by improving performance and scalability of the company’s data
processing system – JAVA, XML tags, IMS DB.
Participated and coordinated in design, coding, testing, and implementation of the project.
Conducted POCs and performance evaluation. Provided presentations on the functional
and technical design to stakeholders.
dcuFooter
Reviewing the Application Design, Unit Test Plan, Integration Test Plan, and Test Results to
ensure to be compliant as per the ITUP process of the client.
Involved in writing client side validations using Java Script.
PitneyBowes – Banglore, India.
Dec 2007 to Oct 2010.
Java Developer.
Responsibilities:
Object Oriented Analysis and Design using UML include development of class diagrams,
Sequence diagrams, and State diagrams and implemented these diagrams in Microsoft
Visio.
Developed action classes and form beans and configured the struts-config.xml.
Involved in writing client side validations using Java Script.
Involved in the design of the Referential Data Service module to interface with various
databases using JDBC.
Developed the build scripts using Maven.
Prepared deployment plans for production deployments.
Reviewing the Application Design, Unit Test Plan, Integration Test Plan, and Test Results to
ensure to be compliant as per the ITUP process of the client.
Developed controllers and actions encapsulating the business logic.
Prepared documentation and participated in preparing user’s manual for the application.
Attending the SFD, project kick-off meetings and ST meetings.
Developed Cobol, DB2 Programs and writing JCLs.
Aviva, NUAC - Pune, India
Jan 2007 to Nov 2007
Mainframe Developer.
Responsibilities:
Managed in taking transition, streamlining and stabilizing the Mainframe Operations from
Offshore.
NUAC Operations consists of Batch jobs and console monitoring and scheduling batch jobs
in OPC/ Control-M in Mainframe environment.
Responsible for ensuring smoother completion of Mainframe batch cycles. Providing first
level support to Batch abends (issues like Space, Interface, DB2 contention etc ..), ensuring
completion of daily/ weekly Mainframe backups.
Contributed extensively to Mainframe tasks (IMS, CICS, MW, DB2 tasks) refresh activities
and daily/ weekly/ monthly housekeeping activities.
Contrubited to SIPs(Service Improvement Plans): Introduced timer jobs for critical financial
batch jobs effective/ proactive monitoring.
Encouraged all team members to update their day to day learning’s/ best practices into
Share drive.
Ensuring for quality / security process defined for the engagement.
Constructed Cobol, DB2 Programs and Contributed in writing JCLs.
Kaiser Permanente - Chennai, India
Nov 2005 – Jan 2007
dcuFooter
Mainframe Developer
Responsibilities:
Ensuring timely completion of RATS application batch cycles runs in Mainframe
applications.
Provide fix to Batch Job abends (Issues like application data erros, program errors, Space
errors, DB2 contention etc ..).
Developed programs in Cobol/ DB2 in Mainframe environment. Developed Unit test plans
and Performed Unit Testing in Mainframe environment.
Performed System testing. Running system testing cycles and fixing the batch abends.
Preparing test environment in Mainframe environment (Data refresh, Preparing test JCLs
etc ..)
Contrubited to SIPs (Service Improvement Plans):
Contributed to permanent fixes of Batch Job abends which significantly reduced batch
Incidents.
Coordinating with the business users and preparing specs for new requirements.
Ensuring the documentation for Batch Job, Proc and Programs per customer quality
standards.
Sprint – Chennai, India
Feb 2004 to Nov 2005
Mainframe Developer
Responsibilities:
Developing & Modifying Cobol, DB2 programs as per design specifications.
Developed Unit test plans and performed Unit testing. Preparing test environment in
Mainframe environment (Data refresh, Preparing test JCLs etc ..).
Contributed to fix production issues in Mainframe environment under the scope of CIS.
Monitoring the status of transactions flows from CIS to NETWORK. Analyzing and fixing
proactively the transactions which are in ERR status.
Contributed to analysis, design, coding & testing of Sev 1/2/3 requests in order to provide
permanent fixes.
Humana Health Insurance – Mumbai , India
April 2003 to Jan 2004
Mainframe Developer
Responsibilities:
Developing & Modifying Cobol, DB2 programs as per design specifications.
Developed Unit test plans and performed Unit testing. Preparing test environment in
Mainframe (Data refresh, Preparing test JCLs etc ..).
Performed System testing. Running system testing cycles and fixing the batch abends..
Preparing the Job documentation, Proc and Jobs per customer quality standards.
Ensuring the deliverables (Programs, Jobs, Procs, Prose etc ..) for meeting the requirements
and are on time to delivery as agreed.
dcuFooter
Frontier Information Technology - Hyderabad, India
May 2001 to Oct 2002
Testing Analyst
Responsibilities:
Contributed in designing of test plans & test cases.
Performed Unit testing (Black Box Testing), Integration Testing.
Performed System testing which includes Functional testing, Installation testing, Recovery
testing,
Volume testing, Load testing .
Performed Regression which involves manual testing and some functionalities using Win
runner.
dcuFooter
