hadoop-developer-jobs-in-karnataka, Karnataka

196 Hadoop Developer Jobs in Karnataka

Toggle to save search
posted 1 month ago

Data Engineer

CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
experience6 to 11 Yrs
location
Bangalore, Chennai+1

Chennai, Pune

skills
  • sql
  • scala
  • cloud
  • django
  • hadoop
  • python
  • flask
  • devops
  • pyspark
Job Description
Job Description-  Data EngineerTotal yrs of exp should be 6+yrs   Must have 3+ years in Pyspark. Strong programming experience, Python, Pyspark, Scala is preferred. Experience in designing and implementing CI/CD, Build Management, and Development strategy. Experience with SQL and SQL Analytical functions, experience participating in key business, architectural and technical decisions Scope to get trained on AWS cloud technology Proficient in leveraging Spark for distributed data processing and transformation. Skilled in optimizing data pipelines for efficiency and scalability. Experience with real-time data processing and integration. Familiarity with Apache Hadoop ecosystem components. Strong problem-solving abilities in handling large-scale datasets. Ability to collaborate with cross-functional teams and communicate effectively with stakeholders. Primary Skills : Pyspark SQL Secondary Skill: Experience on AWS/Azure/GCP would be added advantage
INTERVIEW ASSURED IN 15 MINS

Top Companies are Hiring in Your City

For Multiple Roles

Jio Platforms Ltd
Jio Platforms Ltdslide-preview-Genpact
posted 1 month ago

Senior BigData Developer

krtrimaIQ Cognitive Solutions
experience6 to 10 Yrs
location
Karnataka
skills
  • Apache Hadoop
  • Hive
  • HDFS
  • ETL
  • Python
  • Java
  • SQL
  • NoSQL
  • Git
  • PySpark
  • CICD
  • Apache NiFi
Job Description
As a Senior Big Data Developer with expertise in PySpark and the Apache Big Data ecosystem, your role will involve designing, developing, and optimizing scalable data pipelines. You will collaborate with cross-functional teams to deliver reliable, high-performance data solutions. Your responsibilities will include: - Building and optimizing large-scale data processing pipelines using PySpark - Working with Apache Hadoop, Hive, HDFS, Spark, and other tools for managing big data workloads - Handling ETL development, data ingestion, transformation, and integration from various sources - Collaborating with Data Scientists, Analysts, and business stakeholders to deliver data-driven solutions - Ensuring high availability, performance, and scalability of data jobs - Implementing data quality checks and lineage tracking for auditability - Developing reusable code in Python and Java - Contributing to architectural design, performance tuning, and tech discussions In order to excel in this role, you will need to have the following skills and qualifications: - 5-7 years of experience as a Big Data Developer - Expertise in PySpark and distributed data processing - Strong knowledge of the Apache ecosystem: Hadoop, Hive, HDFS, Spark - Experience with ETL pipelines, data modeling, and data warehousing - Proficiency in Python and working knowledge of Java - Familiarity with SQL/NoSQL databases - Hands-on experience with Git, CI/CD tools, and code versioning Nice-to-have skills for this role include knowledge of Apache NiFi, experience with real-time data streaming tools, exposure to cloud platforms such as AWS, Azure, or GCP, and familiarity with Docker, Kubernetes, or other orchestration tools. Additionally, soft skills such as excellent problem-solving and analytical abilities, strong collaboration and communication skills, and the ability to work independently and in a team will be beneficial. If you are passionate about big data and seeking impactful projects, please send your updated resume to nikhil.kumar@krtrimaiq.ai.,
ACTIVELY HIRING
posted 2 months ago

Big Data Developer

MediaMelon, Inc.
experience3 to 7 Yrs
location
Karnataka
skills
  • Scala
  • Java
  • Spark
  • HBase
  • Cassandra
  • Hive
  • Mahout
  • Hadoop
  • AeroSpike
  • Apache Kafka
  • Big Data
  • Elastic Search
  • Spark Streaming
  • Pig Latin
  • Machine learning algorithms
Job Description
As a Developer in this role, you will be responsible for developing analytic tools and working on Big Data and Distributed systems. Your main focus will be providing technical leadership in developing the core Analytic platform. Your expertise in innovation, problem solving, analytical skills, data structures, and design patterns will play a crucial role in the success of this position. Key Responsibilities: - Demonstrating excellence in innovation, problem solving, analytical skills, data structures, and design patterns - Leading development efforts on product features using Scala and Java - Building applications using Spark and Spark Streaming - Working with NoSQL technologies such as HBase, Cassandra, Hive, and Pig Latin, as well as Mahout - Utilizing extensive experience with Hadoop and Machine learning algorithms Qualifications Required: - Proficiency in Spark Streaming, AeroSpike, Cassandra, Apache Kafka, Big Data, Elastic Search, and Scala,
ACTIVELY HIRING
question

Are these jobs relevant for you?

posted 2 days ago
experience4 to 8 Yrs
location
Karnataka
skills
  • Hadoop
  • SQL
  • R
  • Python
  • GCP
Job Description
As a Data Engineering professional at Capco, a global technology and management consulting firm, you will have the opportunity to make a significant impact by delivering innovative solutions to help clients transform their businesses. With a presence in 32 cities worldwide and a focus on banking, financial, and energy sectors, Capco is known for its deep transformation execution and delivery. Key Responsibilities: - Work independently with team lead(s) in the Model Development team - Hands-on programming and development using SQL and Hadoop - Conduct data analysis and problem-solving to achieve optimal solutions - Tune and optimize AML scenarios, maintaining standards for alert testing - Support ongoing optimization of transaction monitoring systems - Perform UAT and systems integration testing of AML models - Utilize programming languages like R or Python, PySpark for model development - Hands-on experience in Hadoop technology stack including Hive, Impala, Spark, CDSW - Experience in Git/BitBucket and Orchestration tools like Control M and AirFlow Qualifications Required: - Significant experience and direct knowledge of AML Transaction Monitoring systems, preferably Oracle Mantas, Prime BSA, and Actimize - Strong knowledge of SQL and Hadoop - Hands-on development experience in programming languages like R or Python, PySpark - Experience in Git/BitBucket and Orchestration tools like Control M and AirFlow - Experience in UAT and systems integration testing Bonus Qualifications: - Knowledge of Object-Oriented programming is a plus - Experience in Data Science and Machine Learning is a big plus - Strong analytical and statistical skills - Experience with visualization tools like Tableau is a plus - Experience in GCP is a plus Join Capco to be part of a tolerant and open culture that values diversity, inclusivity, and creativity. With no forced hierarchy, you will have the opportunity to advance your career as the company grows, taking control of your own professional development. Capco believes that diversity of people and perspectives provides a competitive advantage in delivering disruptive work that is changing energy and financial services.,
ACTIVELY HIRING
posted 1 day ago
experience5 to 9 Yrs
location
Karnataka
skills
  • Python
  • SQL
  • statistical modeling
  • AWS
  • Azure
  • GCP
  • Jenkins
  • Spark
  • Architecture
  • Leadership
  • PySpark
  • ML workflows
  • data preprocessing
  • Azure Data Factory
  • AWS Glue
  • GitHub Actions
  • Hadoop ecosystem
Job Description
As a Solution Architect at Capgemini, you will play a crucial role in designing and implementing data science architectures to support advanced analytics, AI/ML models, and business intelligence. Your responsibilities will include: - Developing robust ETL pipelines using PySpark, Python, and modern frameworks for processing large-scale datasets. - Architecting and deploying solutions on cloud platforms like AWS, Azure, or Google Cloud using services such as Azure Data Factory, Databricks, S3, and BigQuery. - Collaborating with data scientists to ensure that the infrastructure supports predictive modeling, statistical analysis, and machine learning workflows. - Implementing CI/CD pipelines for data workflows and ML model deployment to enhance automation and efficiency. - Leading and mentoring a team of data engineers and data scientists to ensure best practices in coding, architecture, and project delivery. - Ensuring high availability, scalability, and performance of data platforms through performance optimization. - Working closely with business and technical teams to translate requirements into data-driven solutions. Your profile should ideally include expertise in the following areas: - Programming languages such as Python, PySpark, SQL - Strong understanding of ML workflows, data preprocessing, and statistical modeling - Cloud platforms like AWS, Azure, GCP (expertise in at least one) - ETL Tools such as Azure Data Factory, AWS Glue, or equivalent - CI/CD tools like Jenkins, GitHub Actions, or similar - Big Data Technologies like Spark, Hadoop ecosystem - Experience in designing scalable data platforms and solutions - Proven ability to lead cross-functional teams and deliver complex projects At Capgemini, you will enjoy a supportive and inclusive work environment where your unique skills and background are valued. You will have the opportunity to work on cutting-edge projects in technology and engineering, collaborate with industry leaders, and contribute to solutions that address societal and environmental challenges. With a global presence and a focus on digital transformation and sustainability, Capgemini offers a diverse and responsible work culture where you can make a tangible impact. (Note: The additional details about the company have been omitted as per the instructions),
ACTIVELY HIRING
posted 6 days ago
experience5 to 10 Yrs
location
Karnataka
skills
  • Data Science
  • Compliance Advisory
  • SQL
  • HQL
  • Hive
  • Oracle
  • R Programming
  • SAS Programming
  • C Programming
  • Manage Risk
  • Surveillance Specifically Monitoring
  • Statistical Modelling Machine Learning Data Analysis
  • Hadoop scripting
  • HaaS
  • Python Programming
  • STATA Programming
  • SCALA Programming
Job Description
As a Financial Crime Detection and Prevention Specialist at Standard Chartered, your role will involve strategic thinking and technical expertise in designing, developing, and deploying analytics/models to detect suspicious activities and financial crime. Your responsibilities will include: - Designing, developing, and deploying models for anomaly detection, behavior profiling, network analysis, and predictive scoring for Transaction Monitoring Solutions - Performing data exploration, feature engineering, and ensuring accuracy, efficiency, and scalability of models - Supporting analytical processes to enhance red flag monitoring and optimizing cases for investigation through AI/ML models - Improving processes associated with the Transaction Monitoring function across various products - Ensuring compliance with the Bank's governance processes, including Model Risk Policy Governance - Providing guidance on industry best practices and closing compliance gaps - Mentoring and conducting training programs for new joiners and team members - Collaborating with stakeholders for deploying changes to production and supporting control improvements You will also be responsible for: - Providing coaching to peers and new hires to ensure high engagement and performance - Promoting a culture of openness, trust, and risk awareness - Applying Group and FCC policies and processes to manage risks effectively - Collaborating with cross-functional teams effectively - Attending relevant business meetings and ensuring tracking and remediation of surveillance and investigations related regulatory findings - Displaying exemplary conduct and ensuring compliance with applicable laws and regulations - Working collaboratively with key stakeholders including Business teams, CFCC Advisory teams, and Audit teams Qualifications for this role include: - 10+ years of hands-on experience in Transaction Monitoring design and development, with a focus on financial crime threat risk mitigation - Strong background in deploying models within TM or compliance environment - Post Graduate degree in Management/Statistics/Mathematics or Graduate degree in Engineering - Certification from the ACAMS or equivalent - Strong coding skills in Python, R, SQL, and familiarity with data engineering practices Standard Chartered is an international bank that values diversity and inclusion. You will have the opportunity to work in a purpose-driven environment where you can make a positive difference for clients, communities, and the bank. If you are looking for a rewarding career with a focus on growth and impact, Standard Chartered is the place for you.,
ACTIVELY HIRING
posted 1 month ago

Hadoop Admin

Wipro Limited
experience5 to 9 Yrs
location
Karnataka
skills
  • HDFS
  • Hadoop Admin
  • UnixLinux
  • Scripting language
  • Machine Learning Infrastructure
  • AI
Job Description
Role Overview: As a Hadoop Admin at Wipro Limited, you will be responsible for the administration and management of Hadoop and HDFS, with a focus on building and managing data pipelines. Your role will involve strong expertise in Unix/Linux server setup, maintenance, and troubleshooting skills, along with scripting languages for automation tasks. Additionally, familiarity with virtualization technologies and ML pipelines in NVIDIA GPU clusters will be beneficial. Key Responsibilities: - Instrumental in understanding product/software requirements and designing solutions by studying information needs, systems flow, and work processes - Perform coding and ensure optimal software/module development by evaluating feasibility, developing test cases, and modifying software to improve performance - Status Reporting and Customer Focus on an ongoing basis with respect to project execution, capturing requirements, and taking feedback for smooth delivery - Continuous Integration, Deployment & Monitoring of Software to ensure error-free implementation and adherence to release plan - Quality & CSAT management, troubleshooting queries, and ensuring on-time delivery for a positive customer experience - MIS & Reporting generation on time to track project progress and performance Qualification Required: - Proven experience in Hadoop administration and HDFS management - Extensive experience in building and managing data pipelines in Hadoop - Strong background in Unix/Linux server setup, maintenance, and upgrades - Excellent troubleshooting skills and experience with Linux package installation - Skilled in scripting languages (Bash, Python) for automation of tasks and workflows - Familiarity with virtualization technologies and Conda/Python environment management - Experience with running ML pipelines in NVIDIA GPU clusters Additional Company Details: Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions for clients" digital transformation needs. With over 230,000 employees and business partners across 65 countries, Wipro aims to empower individuals to reinvent themselves and their careers in a dynamic industry. Join Wipro to be a part of a purpose-driven business that encourages constant evolution and reinvention. Applications from individuals with disabilities are explicitly welcome.,
ACTIVELY HIRING
posted 5 days ago
experience15 to 19 Yrs
location
Karnataka
skills
  • Data Analytics
  • Power BI
  • Tableau
  • QlikView
  • ETL
  • Informatica
  • Talend
  • Snowflake
  • Python
  • R
  • SAS
  • SQL
  • AWS
  • Azure
  • GCP
  • EMR
  • ADF
  • Hadoop
  • Spark
  • Netezza
  • Machine Learning
  • Automation
  • Leadership
  • Communication
  • AWS Glue
  • Redshift
  • Synapse
  • BigQuery
  • Teradata
  • AI
Job Description
As a member of the Analytics and Insights Managed Services team, your role will involve leveraging your industry expertise, technology knowledge, and managed services experience to drive sustained outcomes and enhance business performance for our clients. You will play a key role in helping companies transform their analytics and insights approach, optimizing processes for efficiency and client satisfaction. Your deep understanding of IT services, operational excellence, and client-centric solutions will be crucial in delivering success. **Key Responsibilities:** - Serve as the focal point for high-level client interactions, maintaining strong relationships - Manage client escalations and ensure timely resolution of issues - Act as the face of the team for strategic client discussions, governance, and regular cadence - Lead end-to-end delivery of managed data analytics services to clients, ensuring projects meet business requirements, timelines, and quality standards - Deliver minor enhancements and bug fixes aligned with the client's service delivery model - Set up incident management and problem management processes for the engagement - Collaborate with cross-functional teams to deliver end-to-end solutions - Monitor, manage, and report service-level agreements (SLAs) and key performance indicators (KPIs) - Implement and oversee standardized processes, workflows, and best practices for efficient operations - Utilize tools and systems for service monitoring, reporting, and automation to improve service delivery - Drive innovation and automation in data integration, processing, analysis, and reporting workflows - Ensure data security, privacy, and compliance with relevant standards and regulations - Lead and mentor a team of service managers and technical professionals for high performance and continuous development - Foster a culture of collaboration, accountability, and excellence within the team - Collaborate with sales teams to identify opportunities for growth and expansion of services - Experience in solutioning of responses and operating models in responding to RFPs **Qualifications Required:** - Bachelor's degree in information technology, Data Science, Computer Science, Statistics, or a related field (Master's degree preferred) - 15 years of experience with at least 3 years in a managerial or leadership role - Proven experience in managing data analytics services for external clients, preferably within a managed services or consulting environment - Technical skills including proficiency in data analytics tools (e.g., Power BI, Tableau, QlikView), Data Integration tools (ETL, Informatica, Talend, Snowflake, etc.), programming languages (e.g., Python, R, SAS, SQL), cloud platforms (e.g., AWS, Azure, GCP), big data technologies (e.g., Hadoop, Spark), traditional Datawarehousing tools (e.g., Teradata, Netezza), machine learning, AI, and automation in data analytics - Certification in data-related disciplines preferred - Demonstrated ability to lead teams, manage complex projects, and deliver results - Excellent verbal and written communication skills with the ability to present complex information to non-technical stakeholders - Strong financial acumen with experience in budget management - Problem-solving and decision-making skills with the ability to think strategically - Experience with practice development, Agile practices, cloud platforms, and infrastructure management This role provides you with the opportunity to make a significant impact by driving innovation, ensuring client satisfaction, and fostering team development within a dynamic and client-focused environment.,
ACTIVELY HIRING
posted 2 weeks ago

Senior Analyst

Golden Opportunities
experience3 to 7 Yrs
location
Karnataka
skills
  • SQL
  • HADOOP
  • PYTHON
  • SPARK
  • EMR
  • ETL
  • DEVOPS
  • PYSPARK
  • AWS GLUE
  • CICD
Job Description
Role Overview: You will be responsible for designing, developing, and optimizing data pipelines using PySpark and Spark SQL to support large-scale analytics and data integration initiatives. Additionally, you will work with large datasets in Hadoop, Databricks, or AWS/GCP/Azure environments, and collaborate with various teams to define data requirements and integrate data from different sources. Key Responsibilities: - Design, develop, and maintain scalable ETL pipelines using PySpark and Spark SQL. - Work with large datasets in Hadoop, Databricks, or AWS/GCP/Azure environments. - Optimize Spark jobs for performance and reliability. - Collaborate with data engineers, analysts, and business teams to define data requirements. - Integrate data from various sources (structured and unstructured). - Implement best practices for data governance, quality, and security. Qualifications Required: - Strong proficiency in PySpark, Python, and SQL. - Hands-on experience with Big Data ecosystems (HDFS, Hive, Kafka, etc.). - Experience with cloud platforms (AWS EMR, Azure Databricks, or GCP DataProc). - Solid understanding of data modeling, ETL design, and performance tuning. - Familiarity with CI/CD pipelines and version control (Git). Company Details: This section is not included in the provided job description.,
ACTIVELY HIRING
posted 5 days ago
experience15 to 19 Yrs
location
Karnataka
skills
  • Data Analytics
  • Power BI
  • Tableau
  • QlikView
  • ETL
  • Informatica
  • Talend
  • Snowflake
  • Python
  • R
  • SAS
  • SQL
  • AWS
  • Azure
  • GCP
  • EMR
  • ADF
  • Hadoop
  • Spark
  • Netezza
  • Machine Learning
  • Automation
  • Leadership
  • Communication
  • AWS Glue
  • Redshift
  • Synapse
  • BigQuery
  • Teradata
  • AI
Job Description
As a member of the Analytics and Insights Managed Services team, you will play a crucial role in leveraging industry expertise, technology, data management, and managed services experience to drive sustained outcomes for clients and enhance business performance. Your responsibilities will include empowering companies to revamp their analytics and insights approach, optimize processes for efficiency, and enhance client satisfaction. **Key Responsibilities:** - Serve as the focal point for high-level client interactions, maintaining strong relationships. - Manage client escalations and ensure timely resolution of issues. - Act as the face of the team for strategic client discussions, governance, and regular cadence with clients. - Lead end-to-end delivery of managed data analytics services to clients, ensuring projects align with business requirements, timelines, and quality standards. - Deliver minor enhancements and bug fixes in accordance with the client's service delivery model. - Set up incident management and problem management processes for the engagement. - Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to provide comprehensive solutions. - Monitor, manage, and report service-level agreements (SLAs) and key performance indicators (KPIs). - Demonstrate solid financial acumen with experience in budget management. - Implement and oversee standardized processes, workflows, and best practices to ensure operational efficiency. - Utilize tools and systems for service monitoring, reporting, and automation to enhance service delivery. - Drive innovation and automation in data integration, processing, analysis, and reporting workflows. - Stay informed about industry trends, emerging technologies, and regulatory requirements affecting managed services. - Ensure data security, privacy, and compliance with relevant standards and regulations. - Identify and mitigate operational risks that could impact service delivery proactively. - Lead and mentor a team of service managers and technical professionals to ensure high performance and continuous development. - Foster a culture of collaboration, accountability, and excellence within the team. - Ensure the team is well-trained on the latest industry best practices, tools, and methodologies. - Collaborate with sales teams to identify opportunities for service growth and expansion. - Experience in solutioning of responses and operating models, including estimation frameworks, content contribution, and solution architecture in response to RFPs. **Qualifications Required:** - Bachelor's degree in information technology, Data Science, Computer Science, Statistics, or a related field (Master's degree preferred). - Minimum of 15 years of experience with at least 3 years in a managerial or leadership role. - Proven experience in managing data analytics services for external clients, preferably within a managed services or consulting environment. - Proficiency in data analytics tools such as Power BI, Tableau, QlikView, etc. - Experience with data integration tools like ETL, Informatica, Talend, Snowflake, etc. - Familiarity with programming languages such as Python, R, SAS, SQL. - Strong understanding of Data & Analytics services cloud platforms like AWS, Azure, GCP. - Familiarity with traditional Datawarehousing tools like Teradata, Netezza, etc. - Certification in data-related disciplines is preferred. - Demonstrated leadership abilities in leading teams, managing complex projects, and delivering results. - Excellent verbal and written communication skills to effectively present complex information to non-technical stakeholders.,
ACTIVELY HIRING
posted 2 weeks ago
experience15 to 19 Yrs
location
Karnataka
skills
  • Data architecture
  • Stakeholder engagement
  • Technical writing
  • MDM
  • Metadata
  • Snowflake
  • AWS
  • GCP
  • Salesforce ecosystem knowledge
  • Data Distribution
  • Data Modelling
  • Hadoop spark
  • Lineage
  • Data Platforms
  • DataBricks
  • MS Azure
  • Salesforce Data Cloud
  • Enterprise data warehouse
  • Data lake
  • Data hub
  • Salesforce Products
Job Description
Role Overview: The "SF Data Cloud Architect" plays a critical role within Salesforces Professional Services team, assisting in pre-sales and leading the design and implementation of enterprise-grade Data Management solutions. You are responsible for architecting scalable solutions across enterprise landscapes using Data Cloud, ensuring data is ready for enterprise AI, applying data governance guardrails as well as supporting enterprise analytics and automation. This role covers ANZ, ASEAN, and India markets. The ideal candidate brings deep expertise in data architecture, project lifecycle, and Salesforce ecosystem knowledge. Combined with strong soft skills, stakeholder engagement, and technical writing ability. You will collaborate with cross-functional teams to shape the future of customer's data ecosystem and enable data excellence at scale. Key Responsibilities: - Salesforce Data Cloud Trusted Advisor: Be a trusted SME for Data Cloud to support and lead project delivery and customer engagements during the pre-sales cycle. Including how Data Cloud relates to the success of AI - Architecture Support: Provide Data and System Architecture guidance to Salesforce Account teams and Customers by reviewing proposed architecture. Also peer review project effort estimates, scope, and delivery considerations - Project Delivery: Work on cross-cloud project delivery and lead the data and analytics stream, spear-heading Data Cloud Design & Delivery. Ability to work collaboratively with cross-functional teams from Developer to Executive - Data Architecture: Design and guide customer's enterprise data architecture aligned to business goals. Highlight the importance of Data Ethics and Privacy by ensuring that customer solutions adhere to relevant regulations and best practices in data security and privacy - Data Cloud Enablement: Lead Data Cloud architecture enablement for key domains and cross-cloud teams - Analytics Support: Collaborate with analytics and AI teams to ensure data readiness for advanced analytics, reporting, and AI/ML initiatives - Stakeholder Engagement: Work cross-functionally across multiple Salesforce teams and projects to deliver aligned and trusted data solutions. Facilitate and influence Executive Customer stakeholders while aligning technology strategy to business value and ROI. Build strong relationships with both internal and external teams, contributing to broader goals and growth - Documentation: Create and maintain high-quality architecture blueprints, design documents, standards, and technical guidelines Qualifications Required: - 15+ years in data architecture or consulting, with solution design and project delivery experience - Deep knowledge in MDM, Data Distribution, and Data Modelling concepts - Expertise in data modelling with a strong understanding of metadata and lineage - Experience in executing data strategies, landscape architecture assessments, and proof-of-concepts - Excellent communication, stakeholder management, and presentation skills - Strong technical writing and documentation ability - Basic understanding of Hadoop spark fundamentals is an advantage - Understanding of Data Platforms (example: Snowflake, DataBricks, AWS, GCP, MS Azure) - Experience with tools such as Salesforce Data Cloud, or similar enterprise Data platforms - Hands-on deep Data Cloud experience is a strong plus - Working knowledge of enterprise data warehouse, data lake, and data hub concepts - Strong understanding of Salesforce Products and functional domains such as Technology, Finance, Telco, Manufacturing, and Retail is a positive,
ACTIVELY HIRING
posted 1 week ago

Generative AI Architect

Siemens Healthineers
experience5 to 9 Yrs
location
Karnataka
skills
  • machine learning
  • deep learning
  • natural language processing
  • computer vision
  • Python
  • R
  • SQL
  • NoSQL
  • Hadoop
  • Spark
  • Kubernetes
  • Web Apps
  • CDN
  • DevOps
  • Azure DevOps
  • Git
  • HIPAA
  • AI services
  • Azure Machine Learning
  • Azure Cognitive Services
  • Azure Databricks
  • containers
  • Azure Front Door
  • Web Application firewalls
  • CICD pipelines
  • Azure security services
  • GDPR
  • TensorFlow
  • Keras
  • PyTorch
  • Scikitlearn
Job Description
As a Solution Architect for Generative AI at Siemens Healthineers (SHS), your role will involve designing, building, and operating AI services. You will be responsible for developing and maintaining artificial intelligence systems and applications that address complex business challenges. Your expertise in machine learning, deep learning, natural language processing, computer vision, and other AI technologies will be essential for the success of this role. Key Responsibilities: - Design, develop, and deploy Azure-based AI solutions, including machine learning models, cognitive services, and data analytics solutions. - Collaborate with cross-functional teams to design and implement AI solutions that align with business requirements. - Build and train machine learning models using Azure Machine Learning, and optimize models for peak performance. - Develop and deploy custom AI models using Azure Cognitive Services for tasks such as speech recognition, language understanding, and computer vision. - Create data pipelines for data collection, processing, and preparation using Azure data services like Azure Data Factory and Azure Databricks. - Implement data analytics solutions using Azure Synapse Analytics or other Azure data services. - Deploy and manage Azure services and resources utilizing tools like Azure DevOps to ensure smooth operations. - Monitor and troubleshoot deployed solutions to maintain optimal performance and reliability. - Ensure compliance with security and regulatory requirements related to AI solutions. - Stay updated with the latest Azure AI technologies and industry trends, and share knowledge and best practices with the team. Qualifications: - Possess a minimum of 8 years of overall IT experience with at least 5 years as an AI engineer. - Hold a Bachelor's or Master's degree in computer science, information technology, or a related field. - Demonstrated experience in designing, developing, and delivering successful AI Services. - Familiarity with cloud computing technologies, particularly Azure. - Relevant industry certifications like Microsoft Certified: Azure AI Engineer, Azure Solution Architect, etc., would be advantageous. - Excellent written and verbal communication skills for effective collaboration with diverse teams and conveying technical information to non-technical stakeholders. Technical Skills: - Proficiency in programming languages, particularly Python and R. - Experience with Azure AI services such as Azure Machine Learning, Azure Cognitive Services, and Azure Databricks. - Strong data handling and processing skills including data cleaning, normalization, and feature extraction. Knowledge of SQL, NoSQL, and big data technologies like Hadoop and Spark is beneficial. - Understanding of cloud computing concepts and hands-on experience with Azure services like containers, Kubernetes, Web Apps, Azure Front Door, CDN, and Web Application firewalls. - Familiarity with DevOps practices and CI/CD pipelines, utilizing tools such as Azure DevOps and Git. - Awareness of security and compliance considerations when building and deploying AI models in the cloud. Knowledge of Azure security services, compliance frameworks like HIPAA and GDPR, and best practices for securing data and applications in the cloud. - Knowledge of machine learning algorithms and frameworks such as TensorFlow, Keras, PyTorch, and Scikit-learn would be advantageous for this role.,
ACTIVELY HIRING
posted 2 weeks ago
experience10 to 14 Yrs
location
Karnataka
skills
  • architecture
  • execution
  • test suites
  • RESTful APIs
  • programming
  • Python
  • Selenium
  • Hadoop
  • Spark
  • Kubernetes
  • Docker
  • Elastic Search
  • Kibana
  • NLB
  • Kafka
  • Redis
  • Postgres
  • test management
  • CI
  • CD
  • Bamboo
  • Jenkins
  • Jira
  • test management tools
  • TestRail
  • QA strategy
  • objectoriented methodologies
  • Automation test suites
  • WebUI testing
  • GoLang
  • Automated Testing Framework
  • microservicesbased API
  • load testing tools
  • Cloud Ecosystem
  • big data technologies
  • Grafana
  • Prometheus
  • S3
  • PrestoDB
  • AlloyDB
  • Spark
  • QA methodologies
  • software testing principles
  • verificationvalidation techniques
  • behaviour driven development
  • testdriven development
  • Dev Ops Pipeline
  • ArgoCD
  • Azkaban
  • bug tracking tools
  • XRay
  • Telecom Experience
Job Description
As a QA Engineer at Calix, you will be responsible for defining the QA strategy, architecture, and execution for all product lines across Software, Web, and Mobile. Your role will involve bringing high energy, effectively managing relationships, and being hands-on to ensure tasks are completed. You will design and develop advanced test suites using object-oriented methodologies, implement and execute test strategies on all supported platforms and languages to enhance overall quality and code coverage. Additionally, you will develop new test frameworks for data pipeline validation and streaming data processing, identify risks and errors in applications and tools, and collaborate with the development and QA team to identify test cases best suited for automation. Your knowledge of Web/UI testing will be crucial in this role. Qualifications: - BS/MS degree in CS, EE, or a related field - 10+ years of experience as a test engineer with a focus on manual and automated testing - 10+ years of experience and deep understanding of programming in Python, GoLang, or other languages - 5+ years of experience in Automated Testing Framework, Selenium, Rest APIs using PyTest/ROBOT - Working knowledge of micro-services-based API and load testing tools - Experience working in a Cloud Ecosystem like GCP/AWS/Azure is a must - Experience in big data technologies such as Hadoop, Spark, or similar - Proficiency in QA methodologies, software testing principles, concepts, verification/validation techniques, and test management - Excellent analytical, research, documentation, project planning, and implementation skills - Knowledge of behavior-driven development and test-driven development - Experience with Dev Ops Pipeline (CI and CD), Bamboo/Jenkins/ArgoCD/Azkaban - Ability to adapt and willingness to learn new technologies and techniques - Experience using bug tracking tools such as Jira, and test management tools such as TestRail or XRay - Telecom Experience is a plus Location: India (Flexible hybrid work model - work from Bangalore office for 20 days in a quarter) About Calix: Calix provides the cloud, software platforms, systems, and services required for communications service providers to simplify their businesses, excite their subscribers, and grow their value. They deliver a broadband platform and managed services that enable customers to improve life one community at a time. Calix is at the forefront of a once-in-a-generational change in the broadband industry, aiming to innovate, help customers reach their potential, and connect underserved communities with unrivaled digital experiences. Their mission is to enable BSPs of all sizes to Simplify, Innovate, and Grow. If you are a person with a disability needing assistance with the application process, you can email calix.interview@calix.com or call +1 (408) 514-3000. Please note that all emails from Calix will come from a "@calix.com" email address to ensure authenticity.,
ACTIVELY HIRING
posted 2 months ago

Big Data Developer - Hadoop/Hive

The Sourcing Team Pvt Ltd
experience3 to 7 Yrs
location
Karnataka
skills
  • Hadoop
  • Unix
  • HDFS
  • Hive
  • Impala
  • Sqoop
  • Airflow
  • Jenkins
  • SQL Server
  • TSQL
  • Jira
  • Confluence
  • GitLab
  • SparkScala
Job Description
As a Big Data Developer, you will be responsible for utilizing your strong experience with big data technologies such as Hadoop, Unix, HDFS, Hive, Impala, etc. You should be proficient in using Spark/Scala and have experience with data Import/Export using tools like Sqoop. Additionally, you will work with automation tools like Airflow, Jenkins, or similar ones. Your excellent knowledge of SQL Server and database structures will be crucial in writing and optimizing T-SQL queries and stored procedures. Your key responsibilities will include: - Demonstrating ability to write and optimize T-SQL queries and stored procedures - Working with Jira/Confluence/GitLab - Handling multiple activities with changing priorities simultaneously - Being detail-oriented with strong problem-solving skills - Integrating well in an international team - Ensuring effective Design, Development, Validation, and Support activities for client satisfaction - Translating client requirements into system requirements - Estimating work requirements and providing project estimations - Building efficient programs/systems - Coding, testing, and documenting data systems for robust and scalable applications - Collaborating with other Big Data developers for consistent data solutions - Partnering with the business community for understanding requirements and delivering user training sessions - Performing technology and product research for enhancing the analytics technology stack - Evaluating and providing feedback on future technologies and upgrades Your qualifications should include: - Strong experience with big data technologies - Proficiency in Spark/Scala - Experience with Sqoop or similar tools for data Import/Export - Knowledge of SQL Server and database structures - Excellent organizational and problem-solving skills - Ability to work in a team and collaborate effectively - Good communication skills - Ability to solve problems and meet deadlines with minimal supervision,
ACTIVELY HIRING
posted 3 weeks ago

Big Data Developer

Unison Consulting Pte Ltd
experience3 to 7 Yrs
location
Karnataka
skills
  • Hadoop
  • Spark
  • HDFS
  • Hive
  • Java
  • Scala
  • Python
  • ETL
  • SQL
  • NoSQL
  • Data Modeling
  • Schema Design
Job Description
As a Big Data Developer at Unison Consulting Pte Ltd, you will play a crucial role in designing, developing, and maintaining big data solutions to enhance data-driven decision making and analytics capabilities for our clients. You will leverage cutting-edge technologies and platforms to work with large volumes of structured and unstructured data. Responsibilities: - Design, develop, and maintain big data solutions utilizing technologies like Hadoop, HDFS, Spark, and Hive. - Ingest, process, and analyze substantial amounts of structured and unstructured data from various sources. - Develop and optimize ETL processes to facilitate efficient data extraction, transformation, and loading. - Implement data models, schemas, and data governance frameworks to uphold data quality and integrity. - Conduct data exploration, profiling, and validation to identify patterns, trends, and anomalies. - Collaborate closely with data scientists, analysts, and business stakeholders to grasp data requirements and provide actionable insights. - Create and enhance data storage and retrieval strategies, including data partitioning and indexing. - Construct and manage scalable data pipelines and workflows for streamlined data processing. - Perform performance tuning and optimization of big data applications and queries. - Implement and uphold data security measures to safeguard sensitive information. - Maintain comprehensive technical documentation of big data solutions, processes, and procedures. Requirements: - Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. - Proven experience as a Big Data Developer with expertise in technologies like Hadoop, Spark, HDFS, and Hive. - Proficiency in programming languages such as Java, Scala, or Python. - Familiarity with ETL tools and processes for data extraction, transformation, and loading. - Strong grasp of big data concepts, architectures, and technologies. - Experience working with SQL and NoSQL databases. - Knowledge of data modeling and schema design. - Exceptional problem-solving and analytical skills. - Effective communication and collaboration skills to engage with cross-functional teams. - Understanding of data security and privacy principles. - Ability to adapt to new technologies and quickly learn in a dynamic environment.,
ACTIVELY HIRING
posted 1 week ago
experience4 to 10 Yrs
location
Karnataka
skills
  • Analytics
  • Big Data
  • SAP BI
  • BOBJ
  • HANA
  • Hadoop
  • Cassandra
  • MSBI
  • Tableau
  • R
  • Data Modeling
  • Reports
  • Qlik
  • Paxata
  • SLT
Job Description
As an experienced professional in Analytics and Big Data with 4-10+ years of experience, you will be required to work on one or more platforms such as SAP BI, BOBJ, HANA, Hadoop, Cassandra, MSBI, Tableau, Qlik, R, and Paxata. Your expertise in SLT, Data Modeling, and Reports is mandatory for this role. **Key Responsibilities:** - Work on platforms like SAP BI, BOBJ, HANA, Hadoop, Cassandra, MSBI, Tableau, Qlik, R, and Paxata - Utilize deep experience in SLT, Data Modeling, and Reports **Qualifications Required:** - 4-10+ years of experience in Analytics and Big Data - Proficiency in one or more of the mentioned platforms - Strong expertise in SLT, Data Modeling, and Reports Please send your profiles to careers@infinivalue.com to be considered for this opportunity.,
ACTIVELY HIRING
posted 2 weeks ago

Abinitio Developer

M/S. B. NANDI
M/S. B. NANDI
experience10 to 20 Yrs
Salary24 - 36 LPA
location
Bangalore, Noida+8

Noida, Chennai, Hyderabad, Kolkata, Amritsar, Uttar Dinajpur, Pune, Delhi, Uttarkashi

skills
  • developers
  • abinitio
  • development management
  • developer relations
  • technology evangelism
Job Description
Job Role Duties And Responsibilities. Ab Initio Developer is responsible for giving team status on a variety of projects. Their focus is to escalate an issue as necessary, assess and communicate risks to the development schedule and project to represent the data integration development teams interests in cross-functional project teams by ensuring project success as an ultimate goal. Responsibilities Monitor and Support existing production data pipelines developed in Ab Initio Analysis of highly complex business requirements, designs and/or data requires evaluation of intangible variance factors Debug daily production issues and rerun the jobs after understanding the issues Collaborate throughout the organisation on effective identification of technical issues Participates and provides feedback in design reviews Complete component design documents on assigned projects Participate and provide feedback in design reviews Requirements 1.7+ years of actual development experience building Etl applications/processes using Sas Relevant years of Hands-on experience with Ab Initio and Hadoop technologies (Hdfs, Hive, Impala etc Need to have good understanding of Etl concepts like Informatica, Data stage, Clover Etl Experience in Relational Databases like Oracle, Sql Server and Pl/Sql Understanding of Agile methodologies as well as Sdlc life-cycles and processes. Experience in writing Technical, Functional documentation Soft Skills Ability to work as an individual with minimal guidance/support Strong communication/team skills Strong analytical skills.
posted 1 week ago
experience4 to 8 Yrs
location
Karnataka
skills
  • data visualization
  • banking domain
  • Tableau
  • Power BI
  • SSRS
  • Hadoop
  • SQL
  • data mining
  • segmentation
  • data analytics
  • agile working environments
  • database design development
Job Description
As an experienced candidate with 8+ years of experience, your role will involve: - Visualizing analytics insights effectively using tools like Tableau, Power BI (including SSRS) - Working with large datasets, including Hadoop and SQL - Demonstrating proficiency in database design development and data mining techniques - Identifying process improvement opportunities, proposing system modifications, and devising governance strategies To qualify for this role, you should meet the following criteria: - Hold a Bachelor's degree in a quantitative field such as Computer Science, Information Technology, Statistics, Mathematics, Finance, etc. - Have 4 to 7 years of experience in data visualization, particularly in the banking domain - Possess experience in data & analytics within an agile working environment If you are the right fit for this position, you will play a crucial role in visualizing analytics insights, leveraging your expertise in tools like Tableau and Power BI, while also demonstrating your ability to work with large datasets and propose process improvements.,
ACTIVELY HIRING
posted 4 days ago
experience15 to 19 Yrs
location
Karnataka
skills
  • Data Analytics
  • Data Management
  • Managed Services
  • IT Services
  • Operational Excellence
  • Client Relationship Management
  • Service Delivery Management
  • Incident Management
  • Problem Management
  • Operational Excellence
  • Team Leadership
  • Project Management
  • Technology
  • Process Optimization
  • Data Integration
  • Programming Languages
  • Machine Learning
  • Automation
  • Datawarehousing
  • Data Science
  • Computer Science
  • Statistics
  • Power BI
  • Tableau
  • QlikView
  • Python
  • R
  • SAS
  • SQL
  • AWS
  • Azure
  • GCP
  • EMR
  • ADF
  • Hadoop
  • Spark
  • Netezza
  • Leadership Skills
  • Communication Skills
  • Innovation
  • Automation
  • Regulatory Requir
  • Financial Acumen
  • Risk
  • Compliance
  • PreSales Experience
  • Cloud Platforms
  • Big Data Technologies
  • AI
  • AWS Glue
  • Redshift
  • Synapse
  • BigQuery
  • Teradata
  • Certification in Datarelated Disciplines
  • ProblemSolving Skills
  • DecisionMaking Skills
  • Agile Practices
  • Estimation Frameworks
Job Description
Role Overview: At PwC, you will be part of the managed services team focusing on various outsourced solutions to support clients across different functions. Your role involves helping organizations streamline operations, reduce costs, and enhance efficiency by managing key processes and functions on their behalf. You will utilize your skills in project management, technology, and process optimization to deliver high-quality services to clients. Specifically, in managed service management and strategy, you will concentrate on transitioning and running services, managing delivery teams, programs, commercials, performance, and delivery risk. Your responsibilities will include continuous improvement and optimization of managed services processes, tools, and services. Key Responsibilities: - Serve as the focal point for client interactions, maintaining strong relationships and managing client escalations - Lead end-to-end delivery of managed data analytics services, ensuring projects meet business requirements, timelines, and quality standards - Collaborate with cross-functional teams to deliver comprehensive solutions - Monitor, manage & report service-level agreements (SLAs) and key performance indicators (KPIs) - Implement standardized processes, workflows, and best practices for efficient operations - Drive innovation and automation in data integration, processing, analysis, and reporting workflows - Ensure data security, privacy, and compliance with relevant standards and regulations - Lead and mentor a team of service managers and technical professionals for high performance and continuous development - Collaborate with sales teams to identify growth opportunities and contribute to solution architecture in responding to RFPs Qualifications Required: - Minimum Bachelor's degree in information technology, Data Science, Computer Science, Statistics, or related field (Masters degree preferred) - At least 15 years of experience with a minimum of 3 years in a managerial or leadership role - Proven experience in managing data analytics services for external clients, preferably in a managed services or consulting environment - Proficiency in data analytics tools (e.g., Power BI, Tableau, QlikView), Data Integration tools (ETL, Informatica, Talend, Snowflake etc.), and programming languages (e.g., Python, R, SAS, SQL) - Strong understanding of Data & Analytics services cloud platforms (e.g., AWS, Azure, GCP), big data technologies (e.g., Hadoop, Spark), and traditional Datawarehousing tools like Teradata, Netezza - Familiarity with machine learning, AI, automation in data analytics, and certification in data-related disciplines preferred - Demonstrated leadership abilities, excellent communication skills, and problem-solving capabilities - Experience in budget management, operational excellence, risk mitigation, and team leadership and development - Capacity management, practice development, agile practices, cloud platforms, and infrastructure management experience Note: The above details are specific to the job description provided and may vary depending on the actual requirements of the position.,
ACTIVELY HIRING
posted 2 months ago

Hadoop Developer

Ni consultancy
experience4 to 8 Yrs
location
Karnataka
skills
  • ETL
  • Talend
  • Informatica
  • SQL
  • Data Modeling
  • Query Optimization
  • Data Warehouse Architecture
  • Hadoop
  • Hive
  • Setup
  • Configuration
  • Performance Optimization
  • Interpersonal Skills
  • Java Applications
  • Relational Database Concepts
  • Bigdata Concepts
  • UnixLinux
  • Design Best Practices
  • Excellent Communication
Job Description
Role Overview: You will gain a good working knowledge of Java Applications, including their flow, configuration, and other technical aspects. Your responsibilities will include maintaining the configuration for these Software Applications. Key Responsibilities: - Maintain the configuration for Java Applications, including flow and technical aspects - Utilize 4 to 6 years of ETL Experience with tools like Talend, Informatica - Demonstrate a strong understanding of SQL, relational database concepts, data modeling, query optimization, and data warehouse architecture - Possess a strong understanding of Bigdata Concepts, Hadoop, Hive, and Unix/Linux - Experience with setup, configuration, design best practices, and performance optimization with Talend and Hadoop Qualifications Required: - 4 to 6 years of ETL Experience with tools like Talend, Informatica - Strong understanding of SQL, relational database concepts, data modeling, query optimization, and data warehouse architecture - Strong understanding of Bigdata Concepts, Hadoop, Hive, and Unix/Linux - Experience with setup, configuration, design best practices, and performance optimization with Talend and Hadoop Additional details of the company: N/A,
ACTIVELY HIRING
logo

@ 2025 Shine.com | All Right Reserved

Connect with us:
  • LinkedIn
  • Instagram
  • Facebook
  • YouTube
  • Twitter