big-data-consultant-jobs-in-chennai, Chennai

173 Big Data Consultant Jobs in Chennai

Toggle to save search
posted 2 months ago

Data Engineer

MEEDEN LABS PRIVATE LIMITED
experience6 to 11 Yrs
Salary8 - 18 LPA
location
Chennai, Hyderabad
skills
  • python
  • big data
  • aws
  • pyspark
Job Description
Location: Bangalore, Chennai Employment Type: Full-Time Experience Level: Mid to Senior Level About the Role We are looking for a Big Data Engineer with strong experience in AWS cloud services, Python, and PySpark to design, build, and optimize large-scale data pipelines and data processing systems. The ideal candidate will work closely with data scientists, analysts, and platform engineers to ensure reliable, scalable, and efficient data infrastructure. Key Responsibilities Design, develop, and maintain big data processing pipelines using PySpark and AWS services (EMR, Glue, S3, Lambda, Redshift, Athena, etc.). Implement ETL/ELT data workflows to ingest, transform, and store structured and unstructured data. Optimize data processing jobs for performance, scalability, and cost efficiency in the cloud. Collaborate with data analysts and data scientists to support data modeling, feature engineering, and analytics use cases. Ensure data quality, governance, and security across all data environments. Monitor and troubleshoot data pipeline performance and production issues. Automate data workflows using Python, Airflow, or AWS Step Functions. Contribute to the development of best practices, reusable components, and documentation.
INTERVIEW ASSURED IN 15 MINS

Top Companies are Hiring in Your City

For Multiple Roles

Jio Platforms Ltd
Jio Platforms Ltdslide-preview-Genpact
posted 2 months ago

Data Scientist

LTIMindtree Limited
LTIMindtree Limited
experience6 to 11 Yrs
location
Chennai, Bangalore+6

Bangalore, Noida, Hyderabad, Kolkata, Pune, Mumbai City, Delhi

skills
  • azure
  • artificial intelligence
  • data science
  • machine learning
  • deep learning
  • generative
  • ai
Job Description
Location - LTIM Pan IndiaExperience - 5+to 12+ yrsGeneric JD-Mandatory Skills - Data Science, Gen AI, Python, RAG and Azure/AWS/GCP, AI/ML, NLP Secondary - (Any) Machine Learning, Deep Learning, ChatGPT, Langchain, Prompt, vector stores, RAG, llama, Computer vision, Deep learning, Machine learning, OCR, Transformer, regression, forecasting, classification, hyper parameter tunning, MLOps, Inference, Model training, Model DeploymentJD_ More than 6 years of experience in Data Engineering, Data Science and AI / ML domainExcellent understanding of machine learning techniques and algorithms, such as GPTs, CNN, RNN, k-NN, Naive Bayes, SVM, Decision Forests, etc.Experience using business intelligence tools (e.g. Tableau, PowerBI) and data frameworks (e.g. Hadoop)Experience in Cloud native skills.Knowledge of SQL and Python; familiarity with Scala, Java or C++ is an assetAnalytical mind and business acumen and Strong math skills (e.g. statistics, algebra)Experience with common data science toolkits, such as TensorFlow, KERAs, PyTorch, PANDAs, Microsoft CNTK, NumPy etc. Deep expertise in at least one of these is highly desirable.Experience with NLP, NLG and Large Language Models like BERT, LLaMa, LaMDA, GPT, BLOOM, PaLM, DALL-E, etc.Great communication and presentation skills. Should have experience in working in a fast-paced team culture.Experience with AIML and Big Data technologies like AWS SageMaker, Azure Cognitive Services, Google Colab, Jupyter Notebook, Hadoop, PySpark, HIVE, AWS EMR etc.Experience with NoSQL databases, such as MongoDB, Cassandra, HBase, Vector databasesGood understanding of applied statistics skills, such as distributions, statistical testing, regression, etc.Should be a data-oriented person with analytical mind and business acumen.
INTERVIEW ASSURED IN 15 MINS
posted 3 weeks ago

Big Data Engineer

RiskInsight Consulting Pvt Ltd
experience4 to 8 Yrs
location
Chennai, Tamil Nadu
skills
  • Hadoop
  • Spark
  • Python
  • Scala
  • Java
  • SQL
  • Cassandra
  • MongoDB
  • NoSQL databases
Job Description
As a Big Data Engineer, you will be responsible for designing, developing, and implementing robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Your key responsibilities will include: - Building and maintaining scalable data pipelines for effective data ingestion, transformation, and analysis. - Collaborating with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions. - Ensuring data quality and integrity through effective validation, monitoring, and troubleshooting techniques. - Optimizing data processing workflows for maximum performance and efficiency. - Staying up-to-date with evolving Big Data technologies and methodologies to enhance existing systems. - Implementing best practices for data governance, security, and compliance. - Documenting technical designs, processes, and procedures to support knowledge sharing across teams. Qualifications required for this role include: - Bachelor's or Master's degree in Computer Science, Engineering, or a related field. - 4+ years of experience as a Big Data Engineer or in a similar role. - Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks. - Extensive experience with programming languages such as Python, Scala, or Java. - Knowledge of data modeling and data warehousing concepts. - Familiarity with NoSQL databases like Cassandra or MongoDB. - Proficient in SQL for data querying and analysis. - Strong analytical and problem-solving skills. - Excellent communication and collaboration abilities. - Ability to work independently and effectively in a fast-paced environment. The company offers a competitive salary and benefits package, along with the opportunity to work on cutting-edge technologies and solve complex challenges. You will be part of a dynamic and collaborative work environment with opportunities for growth and career advancement, along with regular training and professional development opportunities.,
ACTIVELY HIRING
question

Are these jobs relevant for you?

posted 1 month ago

Specialist Software Engineer (Big Data Engineer)

Societe Generale Global Solution Centre
experience4 to 8 Yrs
location
Chennai, Tamil Nadu
skills
  • Scala
  • Spark
  • HDFS
  • Hive
  • SQL database
  • Maven
  • Git
  • Jenkins
  • SONAR
  • Kafka
  • Data visualization
  • Bigdata technologies
  • CICD tools
  • ELK stack
  • PowerBI
Job Description
As a Big Data Analyst at Socit Gnrale, your role will involve analyzing, organizing, and processing raw data using Bigdata technologies and Scala. You will be responsible for performing data validation, cleaning, and transformation using Big data technologies, Spark, and Scala. Additionally, you will be required to ingest and manage data in HDFS/Hive, analyze data using Spark, and produce meaningful insights for the business team. Your tasks will also include combining raw information from different sources, exploring ways to enhance data quality and reliability, and developing code using Software Craftmanship best practices such as Continuous delivery and Clean coding principles. Key Responsibilities: - Analyze, organize, and process raw data using Bigdata technologies and Scala - Perform data validation, cleaning, and transformation using Big data technologies, Spark, and Scala - Ingest and manage data in HDFS/Hive, analyze data using Spark, and produce meaningful insights for the business team - Combine raw information from different sources, explore ways to enhance data quality and reliability - Develop code using Software Craftmanship best practices such as Continuous delivery and Clean coding principles - Assist the business operations team with data samples to create proof of concepts - Ensure the new data sets are feeding the Business Intelligence setup i.e Dashboards on PowerBI - Liaise with BA to ensure subjects are getting prioritized, communicate to PO about progress and potential issues Qualifications Required: - 4 to 8 years of expertise and hands-on experience in Spark with Scala and Big data technologies - Good working experience in Scala and object-oriented concepts - Good working experience in HDFS, Spark, Hive, and Oozie - Technical expertise with data models, data mining, and partitioning techniques - Hands-on experience with SQL database - Understanding of CI/CD tools (Maven, Git, Jenkins) and SONAR - Knowledge of Kafka and ELK stack is a plus. Familiarity with Data visualization tools like PowerBI will be an added advantage - Strong communication and coordination skills with multiple stakeholders. Ability to assess existing situations, propose, and follow up on improvement actions - Good team spirit, ability to work in international/intercultural environments with lots of interactions with onsite stakeholders - Professional attitude: Self-motivated, fast learner, team player, independent If you choose to join Socit Gnrale, you will be part of an organization that believes in the power of individuals to drive change. The company encourages innovation, action, and a positive impact on the future. You will have the opportunity to grow in a stimulating and caring environment, contribute to initiatives that make a difference, and develop your expertise. Additionally, employees have the chance to dedicate several days per year to solidarity actions, supporting various causes and sharing skills with charities. Please note that the above details are extracted from the provided job description reference number 25000G3H.,
ACTIVELY HIRING
posted 3 days ago
experience5 to 9 Yrs
location
Chennai, Tamil Nadu
skills
  • Big Data
  • Hadoop
  • Hive
  • Snowflake
  • Data Modeling
  • Python
  • Data Warehousing
  • Database Management
  • PySpark
  • Problemsolving
  • Decisionmaking
Job Description
Role Overview: Working at Citi means being part of a team of over 230,000 dedicated individuals worldwide. As a Data Engineer at Citi, you will play a crucial role in developing high-quality data products to support the Banks regulatory requirements and data-driven decision-making. Your work will contribute to the evolution and growth of one of the world's most global banks, shaping the future of banking technology. Key Responsibilities: - Utilize big data platforms such as Hadoop, Hive, or Snowflake for data storage and processing - Apply data modeling techniques for the design, optimization, and maintenance of data models and structures - Proficiency in programming languages like Python and PySpark for data engineering tasks - Understand Data Warehousing concepts and database management - Demonstrate problem-solving and decision-making skills to contribute to business outcomes on an agile team - Manage deadlines and unexpected changes in expectations or requirements effectively Qualifications Required: - 5-8 years of relevant experience in data engineering - Bachelors degree or equivalent experience in a related field - Strong understanding of data architecture standards, data warehousing, and business intelligence - Ability to work under pressure and collaborate effectively with team members and customers Additional Company Details: Citi is committed to providing resources to meet your unique needs, empowering you to make healthy decisions, and managing your financial well-being for a secure future. Join us in building the future of banking technology and making a real impact on a global scale. Note: For any accessibility needs or accommodation requirements, review Accessibility at Citi. View Citis EEO Policy Statement and the Know Your Rights poster for more information.,
ACTIVELY HIRING
posted 2 weeks ago
experience2 to 11 Yrs
location
Chennai, Tamil Nadu
skills
  • Java
  • Apache Spark
  • Hadoop
  • Batch Processing
  • JavaScript
  • OOAD
  • Hive
  • HBase
  • Pig
  • Streaming Applications
  • Apache Spark Batch Framework
  • Apache Spark Structured Streaming
  • Hadoop API
  • Nodejs
Job Description
You have 7 to 11 years of experience in Java based application development with a strong hands-on experience in Java 8. Additionally, you have 2 to 4 years of experience in Apache Spark based application development and 2 to 4 years as a Hadoop developer. Your expertise lies in building batch and streaming applications, particularly with the Apache Spark batch framework. It would be beneficial if you have knowledge of Apache Spark structured streaming and advanced Spark usage such as Caching and Checkpointing. Your in-depth knowledge of Hadoop API and high-level programming skills are essential. Moreover, you are proficient in back-end programming languages like JavaScript, Node.js, and Object-Oriented Analysis and Design (OOAD). Familiarity with Hive, HBase, and Pig is also required for this role.,
ACTIVELY HIRING
posted 1 week ago
experience2 to 6 Yrs
location
Chennai, Tamil Nadu
skills
  • Hadoop
  • Hive
  • Python
  • SQL
  • Big data platforms
  • PySpark
Job Description
As a Big Data Engineer at Citi, you will be part of a dynamic team that is shaping the future of banking by leveraging cutting-edge technology. You will have the opportunity to work with a global bank that is at the forefront of innovation and is dedicated to changing the way the world does business. Join us in Chennai, India, and be a part of our journey towards redefining the banking experience. **Key Responsibilities:** - Utilize your 2-5 years of experience in Big data platforms like Hadoop and Hive to develop and maintain data pipelines. - Demonstrate proficiency in programming languages such as Python and PySpark for data engineering tasks. - Manage databases using SQL and ensure data integrity and security. - Apply your working knowledge of program languages to solve complex problems efficiently. - Communicate effectively through clear and concise written and verbal communication channels. **Qualifications Required:** - Bachelors degree or equivalent experience in a relevant field. - Proficiency in one or more programming languages commonly used in data engineering. - Strong understanding of Big data platforms and database management. - Excellent communication skills to collaborate with cross-functional teams effectively. At Citi, we are committed to providing resources for your physical and mental well-being, including access to telehealth options, health advocates, and confidential counseling services. Join us and shape your career while making a positive impact on the future of banking. (Note: The additional details of the company were not provided in the job description.),
ACTIVELY HIRING
posted 2 months ago
experience11 to 15 Yrs
location
Chennai, Tamil Nadu
skills
  • Automation framework
  • Jenkins
  • CD
  • CI
  • Github
  • Maven
  • Automation tools
  • Program management
  • Stakeholder management
  • Architecture
  • Design
  • Integration
  • Migration
  • Testing
  • DevOps
  • Microservices
  • Big Data
  • IoT
  • Blockchain
  • CCSP
  • AWS
  • Microsoft Azure
  • Agile
  • Presales experience
  • RFP Request for proposal
  • Test automation strategyScripts
  • Devops experience
  • Handling team
  • clients
  • Conducting testing organization assessments
  • Connecting with various stakeholders
  • Individual contributor
  • Transformation programme
  • POC Proof of concept
  • Propose solutions
  • Cloud full stack development
  • Deploy functions
  • Lead client discussions
  • Improve cloud initiatives
  • transformations
  • KPI driven metrics
  • standards
  • Understand digital disruptive technologies
  • Containers
  • AIML
  • APIAutomation
  • AnalyticsData Science
  • Opensource framework
  • IT cloud certifications
Job Description
As an experienced automation testing professional with a minimum of 11 years of relevant experience, you will play a crucial role in leading the engagement effort to provide high-quality consulting solutions to customers at different stages. Your typical day as an Infoscion would involve various responsibilities and tasks, such as: - Reviewing proposals prepared by consultants, providing guidance, and analyzing solutions for client business problems to identify potential risks and issues. - Identifying change management requirements and proposing a structured approach to clients for managing change using multiple communication mechanisms. - Coaching and creating a vision for the team, providing subject matter training, motivating and inspiring team members through effective feedback and recognition for high performance. - Being a key contributor in unit-level and organizational initiatives to provide high-quality consulting solutions to customers while adhering to organizational guidelines and processes. Additionally, the ideal candidate would have the following qualifications and skills: - Pre-sales experience with a focus on RFP (Request for Proposal) processes. - Strong expertise in test automation strategy, scripting, and automation frameworks. - DevOps experience, including tools like Jenkins, CD/CI, GitHub, and Maven. - Proficiency in at least two automation tools and experience in handling teams and clients. - Experience in conducting testing organization assessments and connecting with various stakeholders. - Familiarity with transformation programs, POC (Proof of Concept), and proposing solutions. - Experience in program management, stakeholder management, and cloud full stack development, architecture, design, integration, migration, testing, and deploy functions. - Knowledge of KPI-driven metrics and standards, as well as digital disruptive technologies like DevOps, Containers, Microservices, AI/ML, API/Automation, Big Data, Analytics/Data Science, IoT, Blockchain, and open-source frameworks. - IT cloud certifications like CompTIA Cloud+, CCSP, AWS, Microsoft Azure, Google Cloud, CISCO CCNA/CCNP, agile, and other test competencies. If you believe you possess the necessary skills and experience to excel in this role and help clients navigate their digital transformation journey, we welcome you to join our team at Infosys.,
ACTIVELY HIRING
posted 2 months ago
experience4 to 8 Yrs
location
Chennai, Tamil Nadu
skills
  • Data Science
  • Machine Learning
  • Statistics
  • Predictive Modeling
  • Analytical
  • ProblemSolving Skills
  • Strong Communication
  • GCP expertise
  • SQL proficiency
  • Big Data technologies
  • MLOps tools practices
Job Description
You will be responsible for analyzing large datasets to extract insights, predict trends, and support business decisions using data science methodologies including machine learning, predictive modeling, statistics, and advanced analytics. Key Responsibilities: - Understand business problems and translate them into analytical approaches. - Develop ML and statistical models, hypotheses, and experiments for decision support. - Apply data mining, predictive/prescriptive modeling, and advanced analytics techniques. - Design data pipelines, augmentation, and scalable model workflows for automation. - Create dashboards and visualizations to communicate findings effectively. - Collaborate with cross-functional teams to integrate models into production. Qualification Required: - 3-5 years of experience in data science and ML model development. - Stay updated with new tools, frameworks, and methodologies in data science and ML. - Strong communication skills. The company, TekWissen Group, is an equal opportunity employer supporting workforce diversity.,
ACTIVELY HIRING
posted 2 weeks ago

Big Data Engineer

Early Career
experience2 to 6 Yrs
location
Chennai, Tamil Nadu
skills
  • Hadoop
  • Hive
  • Python
  • SQL
  • Big data platforms
  • PySpark
Job Description
As a Big Data Engineer at Citi, you will play a crucial role in shaping the future of banking by leveraging your expertise in Big data platforms such as Hadoop and Hive. Your responsibilities will include: - Having 2-5 years of relevant experience in Big data platforms such as Hadoop, Hive - Proficiency in one or more programming languages commonly used in data engineering such as Python, PySpark - Strong Database Management skills in SQL - Working knowledge of program languages - Demonstrating clear and concise written and verbal communication consistently Qualifications required for this role include: - Bachelors degree/University degree or equivalent experience At Citi, we are committed to providing programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling, and more. Our focus is on empowering you to make healthy decisions and manage your financial well-being to help plan for your future. Please note that the job is based in Chennai, India, and is a full-time position within the Technology department under the Applications Development job family. If you are a person with a disability and require a reasonable accommodation to use our search tools and/or apply for a career opportunity, please review the Accessibility at Citi guidelines. You can also refer to Citis EEO Policy Statement and the Know Your Rights poster for more information.,
ACTIVELY HIRING
posted 2 months ago
experience8 to 12 Yrs
location
Chennai, Tamil Nadu
skills
  • Java
  • Scala
  • Spark
  • SQL
  • Python
  • Linux
  • Hadoop Ecosystem
Job Description
As an Applications Development Senior Programmer Analyst at Citi, you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your role will involve contributing to applications systems analysis and programming activities. You will have the opportunity to work on various tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establishing new or revised applications systems to meet specific business needs. Additionally, you will monitor and control all phases of the development process, provide user and operational support, and analyze complex problems using your specialty knowledge of applications development. Key Responsibilities: - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, and applications development - Monitor and control all phases of development process including analysis, design, construction, testing, and implementation - Utilize in-depth specialty knowledge to analyze complex problems, evaluate business and system processes, and provide judgment - Recommend and develop security measures to ensure successful system design and functionality - Consult with users/clients and recommend advanced programming solutions - Ensure essential procedures are followed, define operating standards, and serve as an advisor or coach to new analysts - Exercise independence of judgment and autonomy, and act as a Subject Matter Expert to stakeholders and team members Qualifications: - 8+ years of Development experience with expertise in Hadoop Ecosystem, Java Server side development, Scala programming, Spark expertise, Data Analyst using SQL, Python, Linux - Financial background preferable - Ability to deliver against agreed objectives, multi-task, work under pressure, and learn new concepts - Demonstrated problem-solving skills, enthusiastic and proactive approach, excellent analytical and process-based skills Education: - Bachelors degree/University degree or equivalent experience This job description provides a high-level overview of the work performed. Other job-related duties may be assigned as required.,
ACTIVELY HIRING
posted 7 days ago
experience18 to 22 Yrs
location
Chennai, Tamil Nadu
skills
  • Snowflake
  • pricing
  • data engineering
  • analytics
  • personalization
  • pricing optimization
  • Databricks
  • product catalogue platforms
  • AIML
  • architecture
  • solution design
  • AIML use cases
  • catalogue management
  • data pipelines
  • scalable architectures
Job Description
As an experienced professional in the IT services industry with a background in data warehousing and big data engineering, you have progressed into an architect role with expertise in Snowflake and Databricks. You now hold a leadership position focused on end-to-end delivery within the retail/ecommerce domain, particularly in pricing and product catalogue platforms. Your responsibilities include leading and managing a 20-member delivery team encompassing data engineering, AI/ML, and analytics. Key Responsibilities: - Own program delivery for Data & AI initiatives, ensuring quality, timelines, and measurable business impact. - Utilize deep knowledge of Snowflake and Databricks to guide architecture and solution design. - Drive AI/ML use cases in retail/ecommerce, such as personalization, pricing optimization, and catalogue management. - Ensure the development of robust data pipelines and scalable architectures for high-volume retail platforms. - Collaborate with senior stakeholders to align delivery outcomes with business priorities. Qualifications Required: - Minimum of 18 years in IT services with a strong career progression from data warehousing/big data engineer to architect to delivery leader with a focus on AI. - Hands-on expertise in Snowflake, Databricks, and modern data platforms. - Currently working in the Retail/ecommerce domain, specifically in pricing and product catalogue platforms. Please note: The job description does not include any additional details about the company.,
ACTIVELY HIRING
posted 2 weeks ago
experience15 to 20 Yrs
location
Chennai, Tamil Nadu
skills
  • SQL
  • Python
  • Machine Learning
  • Statistical Modeling
  • Predictive Analytics
  • Tableau
  • Power BI
  • Big Data Platforms
  • AI
  • Looker
Job Description
As the Vice President Data, you will be a key member of the executive team, responsible for shaping the organization's data strategy, driving actionable insights, and fostering a culture of data-driven decision-making. Your role will involve a combination of deep technical expertise, strategic thinking, and proven leadership capabilities. **Key Responsibilities:** - **Strategic Leadership:** Define and execute the enterprise-wide data analytics strategy in alignment with business goals and innovation priorities. - **Team Development:** Build, mentor, and lead a high-performance analytics team comprising data scientists, analysts, and BI developers. - **Data-Driven Transformation:** Drive the organization's shift towards a data-first culture by integrating analytics into crucial decision-making processes. - **Stakeholder Engagement:** Collaborate closely with senior leaders, product owners, and operations teams to identify analytical requirements and provide impactful solutions. - **Advanced Analytics and Innovation:** Supervise the design and implementation of machine learning models, predictive analytics, and data visualization frameworks to derive business insights. - **Governance and Data Quality:** Partner with Data Engineering and IT teams to ensure the availability, accuracy, and integrity of enterprise data assets. - **Analytics Enablement:** Advocate for self-service analytics and the democratization of data through the provision of tools, training, and platforms. - **Industry Intelligence:** Stay abreast of emerging trends, technologies, and best practices in data science, artificial intelligence, and data governance. **Qualifications Required:** - Bachelors or masters degree in data science, Computer Science, Statistics, Business Analytics, or a related field. - Minimum 15-20 years of experience in data analytics or data science, with a minimum of 5+ years in a senior leadership role driving enterprise-level analytics initiatives. - Strong technical proficiency in SQL, Python, and familiarity with big data platforms. - Expertise in machine learning, AI, statistical modeling, and predictive analytics. - Proven success in leading cross-functional teams, managing complex projects, and influencing C-suite executives. - Excellent communication and storytelling skills with the ability to translate complex data insights into clear business value. - Experience with modern BI tools such as Tableau, Power BI, Looker, or similar platforms. This job will require you to demonstrate a commitment to learning and delivering, possess good communication skills, and be willing to learn, train, and mentor subordinates. English language proficiency is essential for effective professional communication. You should also exhibit strong problem-solving skills, creativity in generating new ideas, confidence in your expertise, accountability for deliverables, and a collaborative approach to working with cross-functional teams. Additionally, staying updated on emerging trends, technologies, and industry best practices will be crucial for driving innovation and maintaining a competitive edge.,
ACTIVELY HIRING
posted 1 week ago
experience4 to 8 Yrs
location
Chennai, Tamil Nadu
skills
  • ETL Testing
  • Hive
  • Agile methodology
  • Manual testing
  • DWH testing
  • AWS
  • Tableau
  • Automation scripting
  • Redshift ETL tool
  • Collibra
Job Description
As a Software Engineer/Senior Software Engineer/Senior Analyst in Chennai, your role will involve: - Performing database testing and ETL testing with expertise in Big Data technologies like Hive - Applying your working knowledge in Agile methodology to drive testing activities - Demonstrating a minimum of 4-6 years of experience in test planning and execution - Having exposure to the auditing domain would be an added advantage - Utilizing strong application analysis and troubleshooting skills - Possessing extensive experience in manual testing and preferably some experience in automation scripting - Leading discussions with Business, Development, and vendor teams for testing activities such as Defect Coordination and test scenario reviews - Demonstrating expertise in Data Warehouse (DWH) and ETL testing, including experience with Redshift ETL tool and AWS - Familiarity with analytics tools like Tableau and Collibra - Being open to working in 2nd shifts from 1 pm to 10 pm - Showcasing excellent communication skills to effectively collaborate with internal and external stakeholders The above qualifications and responsibilities align with the requirements of the role, enabling you to contribute effectively to the testing activities in the context of ETL and Big Data technologies.,
ACTIVELY HIRING
posted 2 days ago
experience5 to 9 Yrs
location
Chennai, Tamil Nadu
skills
  • Python
  • GCP
  • ETL
  • Reporting
  • Visualization
  • Dashboards
  • QlikSense
  • R
  • Alteryx
  • Data Analysis
  • Business Intelligence BI
  • PowerBI
  • Data handling
  • Big Query
  • DataAnalytics dashboards
Job Description
Role Overview: As a Data Analyst with Python & GCP at TekWissen in Chennai, your primary responsibility will be utilizing tools in Business Intelligence (BI), Extract-Transform-Load (ETL), Reporting, Visualization, and Dashboards such as PowerBI and QlikSense. Your role involves leveraging visualization techniques to effectively solve business problems and provide insights from data through visualization and storytelling. Experience with data handling using R or Python will be an added advantage. Key Responsibilities: - Utilize tools in Business Intelligence, ETL, Reporting, Visualization, and Dashboards such as PowerBI and QlikSense - Leverage visualization techniques to solve business problems and provide insights from data - Gain exposure to Big Data-based analytical solutions and hands-on experience with data lakes, data cleansing, and data manipulation - Possess skills in Power BI, POSTGRES, Alteryx, Big Query, and creating Data/Analytics dashboards - Have familiarity with Data Analysis, Google Cloud Platform (GCP), and Python Qualifications Required: - Minimum of 5 years of experience - Bachelor's Degree required, Master's Degree preferred About TekWissen Group: TekWissen Group is committed to promoting workforce diversity and is an equal opportunity employer. Join TekWissen in their mission to make the world a better place through innovative solutions that benefit lives, communities, and the planet.,
ACTIVELY HIRING
posted 2 weeks ago
experience10 to 14 Yrs
location
Chennai, All India
skills
  • Snowflake
  • EMR
  • Data Modeling
  • Data Architecture
  • Java
  • Python
  • Hadoop
  • Spark
  • Effective communication skills
  • Leadership
  • Strategic thinking
  • Vendor management
  • Team management
  • LegacyOn Premise ETL solutionsPlatforms Informatica Ab Initio
  • AWS cloud services Glue
  • RDS
  • EC2
  • S3
  • SQL database design
  • Data pipeline orchestration eg
  • Apache Airflow
  • Big Data tools eg
  • Decisionmaking
  • Organizational skills
Job Description
As an experienced Data Engineer at FIS, you will have the opportunity to work on challenging financial services and technology issues. You will be part of a team that values openness, collaboration, entrepreneurship, passion, and fun. **Role Overview:** You will be responsible for designing, developing, testing, and maintaining architectures such as databases and large-scale processing systems. Your key responsibilities will include: - Identifying and resolving database performance issues, capacity, and scalability - Overseeing the design, maintenance, and use of an Extract, Transform, Load (ETL) pipeline - Developing testable, reusable code in SQL and Python - Providing technical leadership, project management, and mentoring junior engineers - Developing data set processes for data modeling, mining, and production - Recommending ways to improve data reliability, efficiency, and quality - Designing and developing scalable data pipelines using AWS services - Integrating diverse data sources and ensuring data consistency and reliability - Collaborating with data scientists and other stakeholders to understand data requirements - Implementing data security measures and maintaining data integrity - Monitoring and troubleshooting data pipelines to ensure optimal performance - Optimizing and maintaining data warehouse and data lake architectures - Creating and maintaining comprehensive documentation for data engineering processes **Qualification Required:** - Bachelor of Computer Engineering - 10+ years of relevant experience - Experience with Legacy/On Premise ETL solutions/Platforms like Informatica/Ab Initio - Experience with AWS cloud services: Glue, Snowflake, RDS, EC2, EMR, S3 - Strong experience in Data Modeling and Data Architecture - Knowledge of programming languages such as Java and Python - Hands-on experience with SQL database design - Data pipeline orchestration (e.g., Apache Airflow) - Big Data tools (e.g., Hadoop, Spark) - Effective verbal and written communication skills - Ability to represent FIS effectively to Senior Client leaders - Decision-making ability and leadership skills - Ability to think strategically and work with partners/vendors - Organized approach and ability to manage and adapt priorities Join FIS, the world's largest global provider dedicated to financial technology solutions, and be part of a team that powers billions of transactions annually. With a competitive salary, benefits, and opportunities for career development, FIS offers you a multifaceted job with high responsibility and a chance to make a difference in the financial services industry. As an experienced Data Engineer at FIS, you will have the opportunity to work on challenging financial services and technology issues. You will be part of a team that values openness, collaboration, entrepreneurship, passion, and fun. **Role Overview:** You will be responsible for designing, developing, testing, and maintaining architectures such as databases and large-scale processing systems. Your key responsibilities will include: - Identifying and resolving database performance issues, capacity, and scalability - Overseeing the design, maintenance, and use of an Extract, Transform, Load (ETL) pipeline - Developing testable, reusable code in SQL and Python - Providing technical leadership, project management, and mentoring junior engineers - Developing data set processes for data modeling, mining, and production - Recommending ways to improve data reliability, efficiency, and quality - Designing and developing scalable data pipelines using AWS services - Integrating diverse data sources and ensuring data consistency and reliability - Collaborating with data scientists and other stakeholders to understand data requirements - Implementing data security measures and maintaining data integrity - Monitoring and troubleshooting data pipelines to ensure optimal performance - Optimizing and maintaining data warehouse and data lake architectures - Creating and maintaining comprehensive documentation for data engineering processes **Qualification Required:** - Bachelor of Computer Engineering - 10+ years of relevant experience - Experience with Legacy/On Premise ETL solutions/Platforms like Informatica/Ab Initio - Experience with AWS cloud services: Glue, Snowflake, RDS, EC2, EMR, S3 - Strong experience in Data Modeling and Data Architecture - Knowledge of programming languages such as Java and Python - Hands-on experience with SQL database design - Data pipeline orchestration (e.g., Apache Airflow) - Big Data tools (e.g., Hadoop, Spark) - Effective verbal and written communication skills - Ability to represent FIS effectively to Senior Client leaders - Decision-making ability and leadership skills - Ability to think strategically and work with partners/vendors - Organized approach and ability to manage and adapt priorities Join FIS, the world's largest global provider dedicated to financial technology solutions, and be part of a team
ACTIVELY HIRING
posted 3 weeks ago
experience8 to 12 Yrs
location
Chennai, Tamil Nadu
skills
  • Core Java
  • Hadoop
  • Scala
  • Hive
  • Impala
  • Kafka
  • Python
  • Service Now
  • Full Stack developer
  • Big Data Frameworks
  • Elastic
  • JORAConfluence
Job Description
Role Overview: You will be an Applications Development Senior Programmer Analyst at an intermediate level, responsible for contributing to the establishment and implementation of a new Strategic Data Repository. Your role will involve working closely with the Global Technology team and participating in applications systems analysis and programming activities. Key Responsibilities: - Develop real-time and batch data transformation processes using a wide range of technologies including Hadoop, Spark Stream, Spark SQL, Python, and Hive. - Translate architecture and low-level requirements into design and code using Big-data tools and processes. - Utilize specialty knowledge of applications development to analyze complex problems, evaluate business and system processes, and make judgements. - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, and implementation of new or revised applications systems. - Monitor and control all phases of the development process, provide user and operational support, and work closely with Technology partners to ensure business requirements are met. Qualifications: - 8-10 years of Development experience in the big data space. - Desired Skills include Core Java, Full Stack developer, Big Data Frameworks, Hadoop, Scala, Hive, Impala, Kafka, Elastic, with a focus on data analysis. - Good to Have skills are Python, Service Now, and JIRA/Confluence experience. - Intermediate Java resource with experience in Java/J2EE, Hadoop, Scala, Hive, Impala, Kafka, Elastic to resolve data concerns and implement data remediation requirements. - Strong computer science fundamentals in data structures, algorithms, databases, and operating systems. - Experience in developing high-performance multi-threaded applications. - Good knowledge of design patterns, identification, and fixing code issues. - Experience with source code management tools such as Bitbucket. Additional Company Details: Citi Canada is an equal opportunity employer that makes accommodations for people with disabilities during the recruitment process. Individuals from Aboriginal, visible minority, racialized communities, and people with disabilities are encouraged to apply. Note: This job description provides a summary of the work performed, and other job-related duties may be assigned as required.,
ACTIVELY HIRING
posted 2 months ago
experience8 to 12 Yrs
location
Chennai, Tamil Nadu
skills
  • Spark
  • Scala
  • Hive
  • Impala
  • Kafka
  • Solace
  • Java
  • Hadoop
  • Python
  • Oracle
  • Netezza
  • Big Data technologies
  • Iceberg format tables
  • Elastic
  • Apache Iceberg
  • Ab Initio suite
Job Description
As an Applications Development Group Manager within the Data Engineering group at Citi, you will play a pivotal role in the company's broad transformation strategy. Your responsibilities will include providing architectural vision, developing strategies, planning solutions on an enterprise level, and maintaining awareness of business, technical, and infrastructure issues. You will collaborate with stakeholders globally to develop, implement, and roll out technology solutions to address complex business problems. **Responsibilities:** - Provide architectural vision ensuring conformity to enterprise blueprints - Develop architecture, strategy, planning, and problem-solving solutions on an enterprise level - Interface across multiple channels and act as a visionary to define future project directions - Maintain awareness of business, technical, and infrastructure issues and provide creative solutions - Develop metadata-driven frameworks for data processing/transformation and real-time processing solutions - Hands-on experience with Big Data technologies such as Spark with Scala, Hive, Impala, Kafka, Solace, and Iceberg format tables - Excellent communication skills to drive necessary changes and translate vision into technical artifacts - Identify and apply optimization techniques to enhance existing application performance - Provide thought leadership in key business subjects - Offer senior-level technical consulting and mentoring during design and development of complex data projects - Collaborate effectively with team members, vendors, and business stakeholders to align work efforts and execute strategic plans - Knowledge of technology solutions in Banking or Trading Book products preferred - Data modeling experience in financial services environment, particularly Enterprise Data warehouse Model based on Banking Model - Stay updated on industry leading practices to direct design, development, testing, and implementation of priority technology requirements - Provide in-depth analysis to define issues and develop innovative solutions - Impact technology function through technical direction and strategic decisions - Accountable for end-to-end results including budgeting, policy formulation, and future state technology strategies - Negotiate effectively and often at higher levels - Perform other assigned job duties and functions **Qualifications:** - 10+ years of experience in building data engineering solutions for large-scale Operational and Data Warehouse implementations - Demonstrates clear and concise written and verbal communication consistently - Management and prioritization skills - 8+ years of experience in building enterprise data warehouse systems in the finance sector preferred - 8+ years of relevant experience in Application Development for Enterprise - Must have technical skills in Java/Scala, Hadoop, Python, Hive, Impala, Kafka, Elastic, Apache Iceberg, Oracle, Netezza - Core Skills include experience in handling large teams, IT projects design and development, enterprise architecture, data & database architecture, project management, software development life cycle, risk management, on/offshore large teams management - Knowledge of Ab Initio suite of products preferred - Ability to develop working relationships, manage multiple activities and changing priorities, work under pressure, meet tight deadlines, and take initiative - Methodical with attention to detail **Education:** - Bachelors degree/University degree or equivalent experience - Masters degree preferred,
ACTIVELY HIRING
posted 2 months ago

Principal Consultant

Infosys Limited
experience11 to 15 Yrs
location
Chennai, Tamil Nadu
skills
  • Automation framework
  • Program management
  • Stakeholder management
  • DevOps
  • Microservices
  • ML
  • Big Data Analytics
  • Data Science
  • IoT
  • Blockchain
  • Consulting
  • Automated Testing
  • Pre sales experience
  • RFP Request for proposal
  • Test automation strategy Scripts
  • Devops experience Jenkins CD CI Github Maven
  • Handling team
  • clients
  • Conducting testing organization assessments
  • Transformation programme
  • POC Proof of concept
  • Propose solutions
  • Cloud full stack development
  • Architecture design integration migration testing
  • deploy functions
  • Lead client discussions
  • KPI driven metrics
  • standards
  • Containers
  • AI
  • API Automation
  • Open source framework
  • Consulting processes
  • Automated Testing ALL
  • Test automation framework design
Job Description
As a Lead Consultant at Infosys, you will be responsible for architecting Automation solutions for QA services in an agile DevOps environment. Your role includes implementing test automation solutions and providing support to presales activities. Your main responsibilities will be to lead, monitor, and improve automation service creation and business growth. Key Responsibilities: - Lead the engagement effort of providing high quality consulting solutions to customers from problem definition to solution design and deployment - Review proposals, provide guidance, and analyze solutions to identify potential risks and issues - Identify change management requirements and propose a structured approach for managing change - Coach, create a vision, and provide subject matter training for the team - Contribute to unit level and organizational initiatives for providing high-quality consulting solutions - Play a key role in navigating clients through their digital transformation journey Technical Requirements: Mandate Skills: - Pre-sales experience and handling RFP (Request for Proposal) - Expertise in test automation strategy, scripts, and framework - DevOps experience with tools like Jenkins, CD, CI, Github, Maven - Experience with at least 2 automation tools - Team and client management skills - Conducting testing organization assessments - Minimum 11 years of relevant automation testing experience - Ability to connect with various stakeholders - Act as an individual contributor and consultant Added Advantage: - Experience in transformation programs and POC (Proof of Concept) - Ability to propose solutions and drive cloud initiatives - Knowledge in KPI metrics, digital disruptive technologies, and IT cloud certifications Additional Responsibilities: - Ensure high quality standards and strive for customer delight - Experience in program and stakeholder management - Proficiency in cloud full stack development, architecture design, integration, migration, testing, and deployment - Lead client discussions to enhance cloud initiatives and transformations - Understanding of KPI-driven metrics, digital disruptive technologies, and IT cloud certifications Preferred Skills: - Consulting processes and technology expertise in automated testing and test automation framework design.,
ACTIVELY HIRING
posted 2 months ago
experience7 to 15 Yrs
location
Chennai, Tamil Nadu
skills
  • Hypothesis testing
  • Data interpretation
  • Data wrangling
  • SQL
  • Python
  • R
  • Model building
  • Model validation
  • Consulting
  • PreSales
  • Tableau
  • Power BI
  • Hadoop
  • Spark
  • Kafka
  • AWS
  • Azure
  • Statistical methods
  • Machine learning algorithms
  • Model deployment
  • Business requirements translation
  • Data Visualization Tools
  • Big data platforms
  • Cloud platforms
  • Google Cloud
Job Description
Role Overview: As a Senior Data Scientist specializing in Statistical Analysis, your primary responsibility will be to develop effective and high-quality analytics solutions that align with business requirements. Leveraging your deep understanding of statistics and mathematics, along with a solid domain expertise, you will be instrumental in crafting pre-built business solutions to tackle specific challenges. Additionally, you will play a crucial role in providing technical consultation to both existing and potential clients throughout various stages of the program, contributing to proposals and pre-sales activities. Key Responsibilities: - Systematically Develop and Maintain Offerings: - Provide guidance to create advanced analytics solutions that can set Infocepts apart in the market. - Assist in the development and implementation of offerings, methodologies, and processes. - Thought Leadership: - Establish and share industry-leading insights through platforms like professional social media, blogs, white papers, and events. - Provide Sales Support: - Engage with prospects, conduct workshops, develop solutions, and support sales and marketing activities. - Consulting for New and Existing Clients: - Offer specialized advisory services, expand client relationships, and manage client expectations effectively. - Support Organizational Strategy: - Contribute to practice development, talent growth, and corporate initiatives. - Support Project Delivery: - Collaborate with Data Scientists in delivering project outcomes through data analysis, feature selection, and building ML models. Qualifications Required: - Proficiency in statistical methods, hypothesis testing, and data interpretation. - Expertise in data wrangling, cleaning, and preprocessing using tools like SQL, Python, or R. - Strong understanding of machine learning algorithms, model building, validation, and deployment. - Ability to translate business requirements into analytical solutions in industries such as Retail, Healthcare, Media, or Banking/Finance. - Consulting and business-oriented analytics solution development experience. - Pre-Sales experience in proposing Advanced Analytics capabilities. Desirable Skills: - Proficiency in Data Visualization Tools like Tableau, Power BI. - Knowledge of big data platforms such as Hadoop, Spark, or Kafka. - Experience with cloud platforms like AWS, Azure, or Google Cloud. (Note: No additional details about the company were provided in the Job Description),
ACTIVELY HIRING
logo

@ 2025 Shine.com | All Right Reserved

Connect with us:
  • LinkedIn
  • Instagram
  • Facebook
  • YouTube
  • Twitter