data-warehousing-jobs-in-bangalore, Bangalore

46 Data Warehousing Jobs in Bangalore

Toggle to save search
posted 1 week ago

GCP Technical lead

Hucon Solutions India Pvt.Ltd.
Hucon Solutions India Pvt.Ltd.
experience6 to 9 Yrs
location
Bangalore, Chennai+3

Chennai, Kochi, Hyderabad, Pune

skills
  • sql
  • security
  • python
  • gcp
  • devops
  • terraform
  • kubernates
Job Description
Job Title: GCP Technical Lead Employment Type: Permanent Industry of the Employer: IT / Software Services Department / Functional Area: Cloud Engineering, Data Engineering, DevOps Job Description Hiring for Leading MNC GCP Technical Lead Role: GCP Technical Lead Skills: GCP, Python, SQL, BigQuery, Jenkins, Terraform, CI/CD, ETL/ELT Experience: 6-9 Years Locations: Chennai, Kochi, Bangalore, Hyderabad, Pune Eligibility Criteria / Required Skills Strong experience in Python, SQL, Data Warehousing concepts, and Data Modeling Expertise in GCP services: BigQuery, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions Hands-on experience with Docker, Kubernetes, GitHub Strong understanding of Microservices and Serverless Architecture Ability to design scalable, secure, and cost-efficient cloud solutions Experience with Infrastructure as Code (IaC) using Terraform Knowledge of Cloud Security principles, IAM, and governance Experience with PySpark and Big Data tools Basic cloud Networking knowledge Google Professional Cloud Architect / DevOps Engineer Certification preferred Familiarity with F&A Domain is an added advantage Excellent communication and leadership skills Role Responsibilities Lead the design and architecture of end-to-end cloud solutions on GCP Oversee development of scalable ETL/ELT pipelines and cloud-native workflows Implement CI/CD pipelines using Jenkins and DevOps best practices Architect microservices and serverless-based applications Drive cloud security, performance tuning, and cost optimization Build and maintain data pipelines using BigQuery, Dataflow, Cloud Storage, Cloud Composer Guide teams through code reviews, best practices, and cloud standards Collaborate with cross-functional teams to ensure architectural alignment Ensure cloud compliance, governance, and secure architecture Keywords / Skills GCP, Python, SQL, Terraform, Jenkins, BigQuery, Cloud Composer, Pub/Sub, CI/CD, ETL, ELT, Microservices, Kubernetes, Docker, IAM, Cloud Security, Dataflow, Serverless, PySpark, Big Data Total Experience: 6 to 9 Years Salary Type: Yearly Annual Salary Offered: As per company norms Job Type: Full Time Shift Type: Day Shift / Rotational (based on project requirement) Location of the Job: Chennai | Kochi | Bangalore | Hyderabad | Pune Why Join Us Opportunity to work on cutting-edge cloud transformation projects. Collaborative and high-growth environment. Exposure to multi-cloud and hybrid cloud technologies. Leadership opportunities in shaping cloud strategy and architecture. If you are passionate about building world-class cloud solutions and want to be part of an innovative team, wed love to hear from you. Apply now!
INTERVIEW ASSURED IN 15 MINS

Top Companies are Hiring in Your City

For Multiple Roles

Jio Platforms Ltd
Jio Platforms Ltdslide-preview-Genpact
posted 1 week ago

GCP Data Engineer

Hucon Solutions India Pvt.Ltd.
Hucon Solutions India Pvt.Ltd.
experience5 to 9 Yrs
Salary10 - 20 LPA
location
Bangalore, Kochi+2

Kochi, Chennai, Hyderabad

skills
  • devops
  • gcp
  • python
  • etl
  • docker
  • kubernates
  • bigquery
  • terraform
  • dataflow
Job Description
Job Title: GCP Data Engineer Employment Type: Permanent Industry of the Employer: IT / Software Services Department / Functional Area: Data Engineering, Cloud Engineering Job Description GREETINGS FROM HUCON Solutions Hiring for Leading MNC GCP Data Engineer Role: GCP Data Engineer Skills: GCP, Python, SQL, BigQuery, ETL Data Pipeline Experience: 59 Years Locations: Chennai, Kochi, Bangalore, Hyderabad, Pune Eligibility Criteria Strong hands-on experience in Python, Pandas, NumPy Expertise in SQL and solid understanding of Data Warehousing concepts In-depth knowledge of GCP Services including: BigQuery, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions Experience with Docker, Kubernetes, GitHub Strong communication and analytical skills Working experience with PySpark, Data Modeling, Dataproc, Terraform Google Cloud Professional Data Engineer certification is highly preferred Role Responsibilities Design, develop, and manage robust and scalable ETL / ELT pipelines on GCP using Dataflow, Cloud Run, BigQuery, Pub/Sub, and Cloud Composer Implement data ingestion workflows for structured and unstructured data sources Build and maintain data warehouses and data lakes using BigQuery, Cloud Storage, and other GCP tools Work with data modeling, architecture, and ETL/ELT frameworks Ensure best practices in performance, optimization, and cloud data management Keywords / Skills GCP, Python, SQL, BigQuery, ETL, Data Pipeline, Data Engineering, Cloud Run, Pub/Sub, Cloud Storage, Dataproc, Terraform, Kubernetes, Docker, Dataflow Total Experience: 5 to 9 Years Salary Type: Yearly Annual Salary Offered: As per company standards Job Type: Full Time Shift Type: Day Shift / Rotational (based on project requirement) Location of the Job: Chennai | Kochi | Bangalore | Hyderabad | Pune
INTERVIEW ASSURED IN 15 MINS
posted 2 weeks ago

Abinitio Developer

CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
experience5 to 10 Yrs
location
Bangalore, Noida+7

Noida, Chennai, Hyderabad, Gurugram, Kolkata, Pune, Mumbai City, Delhi

skills
  • ab initio
  • unix shell scripting
  • sql
Job Description
Key Responsibilities Design, develop, and implement ETL processes using Ab Initio GDE (Graphical Development Environment). Build and maintain Ab Initio graphs, plans, and sandboxes for data extraction, transformation, and loading. Work with business teams to understand data integration requirements and deliver efficient solutions. Use Ab Initio EME for version control, dependency management, and metadata governance. Perform data profiling, data validation, and quality checks using Ab Initio components and tools. Optimize ETL workflows for performance, scalability, and maintainability. Implement robust error handling, restartability, and logging mechanisms. Collaborate with DBAs, data modelers, and analysts to ensure data accuracy and consistency. Schedule and monitor jobs using Ab Initio Control Center (AICC) or enterprise schedulers. Support production systems, troubleshoot issues, and perform root cause analysis. Required Technical Skills Strong hands-on experience in Ab Initio GDE, EME, Co>Operating System, and Control Center. Proficiency with Ab Initio components such as Input/Output, Transform, Partition, Sort, Join, Lookup, Rollup, Reformat, Scan, and Dedup Sort, along with error handling using Rejects, Error Tables, and Error Ports for robust ETL design. Expertise in ETL design, development, and deployment for large-scale data environments. Proficiency in SQL and relational databases such as Oracle, Teradata, DB2, or SQL Server. Experience with UNIX/Linux shell scripting for automation and workflow integration. Understanding of data warehousing concepts (star schema, snowflake schema, slowly changing dimensions). Strong performance tuning and debugging skills in Ab Initio. Familiarity with data quality, metadata management, and data lineage.  
INTERVIEW ASSURED IN 15 MINS
question

Are these jobs relevant for you?

posted 6 days ago
experience7 to 11 Yrs
location
Bangalore
skills
  • Data Modeling
Job Description
Job Description We are seeking an experienced Data Modeler with 4 to 9 years of experience to join our team.The ideal candidate will be responsible for designing implementing and supporting data structures that ensure data integrity and facilitate accurate timely information retrieval. The Data Modeler will work closely with analysts architects and database developers to design datasets that align with business requirements and technical constraints. Responsibilities Design and implement data models to support business requirements ensuring consistency and integration across various data sources. Develop and maintain conceptual logical and physical data models optimizing them for performance scalability and ease of use. Collaborate with stakeholders to identify data requirements and translate them into technical specifications. Ensure data models align with the organizations data architecture and data governance standards. Design and implement data integration processes using ETL extract transform load tools and technologies ensuring data quality and completeness. Work with database administrators to ensure database designs support business needs and are optimized for performance. Maintain and update data dictionaries metadata repositories and data modeling documentation. Troubleshoot and resolve issues related to data quality integration and model design. Provide guidance and mentorship to junior team members as needed. Stay current with industry best practices and emerging trends in data modeling and data architecture. Requirements 2 to 5 years of experience in developing data pipelines and solutions using Azure Data Factory ADF Azure Synapse Analytics and Databricks Strong proficiency in SQL TSQL and familiarity with Azure SQL Database andor Azure Synapse Analytics SQL pools Experience with ADF pipeline orchestration and data ingestion from various sources such as databases APIs and file systems Knowledge of Spark and Databricks for data processing transformations and data analytics Familiarity with data modeling and schema design in Azure Synapse and Azure SQL Databases Understanding of data integration data warehousing and ETL concepts Proficiency in Azure cloud services and infrastructure particularly related to data processing and analytics Strong problemsolving and troubleshooting skills Qualifications Bachelors degree in Computer Science Information Technology or a related field 4 to 9 years of experience in data modeling data architecture or related areas Proficiency in data modeling tools such as ERStudio Erwin or similar Strong understanding of relational databases data warehousing concepts and SQL Experience with big data technologies and platforms Hadoop Spark NoSQL databases is a plus Strong analytical problemsolving and communication skills Ability to work collaboratively in a team environment and with crossfunctional stakeholders Experience in AgileScrum development environments is advantageous
INTERVIEW ASSURED IN 15 MINS
posted 1 month ago

Obiee Developer

CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
experience6 to 11 Yrs
Salary7 - 16 LPA
location
Bangalore, Hyderabad+2

Hyderabad, Pune, Mumbai City

skills
  • obiee
  • sql
  • oas
  • obiee developer
  • oracle analytics cloud
  • oac
Job Description
Job Title: Oracle BI DeveloperExperience: 6-12 years Location: Mumbai, Bangalore, Chennai, Pune, HyderabadJob Summary:We are seeking a highly skilled Oracle BI Developer with hands-on experience in OBIEE, OAS, and Oracle Analytics Cloud (OAC). The ideal candidate will be responsible for developing and maintaining interactive dashboards, reports, and visualizations, while ensuring optimal performance, security, and scalability of BI solutions.Key Responsibilities:Design, develop, and maintain dashboards, reports, visualizations, and analytical applications using OBIEE/OAS/OAC and BI Publisher.Perform RPD (Repository) development, data modeling, and troubleshooting related to data, performance, security, and functionality issues.Implement and manage Security Models for dashboards, roles, objects, and data within OBIEE/OAS/OAC environments.Administer and tune OBIEE/OAS/OAC environments, including Managed Servers, Admin Servers, WebLogic Configuration, and performance optimization.Create and maintain technical documentation, including data models, report specifications, and user guides.Write and optimize SQL queries for data extraction and analysis using relational databases such as Oracle or SQL Server.Follow best practices in BI architecture, data management, and data warehouse methodologies to ensure efficient, scalable BI solutions.Collaborate with cross-functional teams to support business intelligence needs and ensure data accuracy and consistency. Required Skills and Qualifications:612 years of professional experience in Business Intelligence and Analytics.Strong expertise in OBIEE, OAS, Oracle Analytics Cloud (OAC), and BI Publisher.Proficient in RPD development, security implementation, and OBIEE/OAS/OAC administration.Strong understanding of SQL, scripting, data warehousing, and performance tuning techniques.Experience with Oracle or SQL Server databases.Solid understanding of data modeling and BI architecture best practices.Excellent analytical, problem-solving, and communication skills.
INTERVIEW ASSURED IN 15 MINS
posted 2 months ago

AWS Data Engineer

CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
experience5 to 10 Yrs
Salary8 - 18 LPA
location
Bangalore, Chennai+2

Chennai, Pune, Mumbai City

skills
  • athena
  • python
  • sql
  • aws
  • data engineering
  • data warehousing
  • etl
  • glue
  • s3
Job Description
AWS Data Engineer  Requirements  3+ year of experience working on AWS Cloud platform with strong experience in Python Knowledge on AWS services such as - AWS S3, Glue, API Gateway, Crawler, Athena, Cloudwatch, Lambda, EC2, Route53, IAM, Aurora/Dynamic DB, Redshift is an advantage Knowledge/experience on CI/CD deployment tools (CloudFormation, Terraform, Jenkins) Experience/knowledge with streaming technologies is must preferably Kafka Should have knowledge/experience with SQL Experience developing REST API Good analytical skills Knowledge or experience developing microservices Familiar working on Linux platforms Have good understanding on pros and cons and the cost impact of the AWS services being leveraged Good Communication skills
INTERVIEW ASSURED IN 15 MINS
posted 1 day ago
experience5 to 7 Yrs
location
Bangalore
skills
  • IOTArchitecture
Job Description
Job Title: Solution Architect Job Description: The solution architect role involves designing and overseeing the implementation of home-grown and commercial-off-the-shelf IT solutions using Microsoft Azure and their integration with various systems and applications. The role involves collaborating with stakeholders, evaluating technology options, and guiding development teams to deliver scalable, secure and efficient solutions. Responsibilities: - Design and implement end-to-end solutions using Microsoft Azure services tailored to the oil and gas industry. - Collaborate with stakeholders to gather requirements and translate them into technical solutions. - Develop and maintain architectural blueprints, solution designs, and technical documentation. - Lead the integration of various systems and applications, ensuring seamless data flow and interoperability. - Provide technical leadership and guidance to development teams throughout the project lifecycle. Mentor and guide junior architects and engineers. Conduct regular reviews and audits of existing solutions to identify areas for improvement. - Stay current with industry trends and emerging technologies to ensure our solutions remain cutting-edge. - Develop and present proof of concepts to demonstrate the feasibility of proposed solutions. - Monitor and manage the costs associated with cloud services and solutions. - Develop and implement disaster recovery plans to ensure business continuity. Requirements: - 15+ overall relevant experience in the Industry - Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience). - 5+ years of prior experience as a solution architect, preferably in the oil and gas industry or 5+ years of prior experience as a software engineer or similar role. - Skilled in designing and implementing cloud-native solutions using a wide stack of Microsoft Azure services, including Azure App Services, Azure Functions, Azure DevOps, Azure Data Factory, Azure SQL Database, among others. - Skilled in implementing various architecture styles, design patterns and best practices for software development. - Skilled in evaluating technology and product options, and modern trade-off analysis for various architecture and design choices. - Skilled in ability to design and implement security best practices and compliance requirements in the oil and gas industry. - Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. Preferred Qualifications: - Relevant certifications such as Microsoft Certified: Azure Solutions Architect Expert or similar. Knowledge of enterprise architecture frameworks. - Experience with data integration, data warehousing, and big data technologies. - Experience with IoT solutions and edge computing. - Experience with containerization and orchestration tools (e.g., Docker, Kubernetes). - Experience with machine learning and advanced analytics. - Experience with CI/CD pipelines and automated testing frameworks. Selection Criteria: 1. Technical Skills: 2. Experience with solution architecture for custom development and COTS implementations. a. Various architecture styles, design patterns, and best practices. b. Technology options evaluation and trade-off analysis. 3. Technical knowledge of key technologies: a. .NET Framework (EF, LINQ, ASP.NET, ADO.NET) b. C# c. API Protocols (REST, SOAP) d. Azure Services (App Services, Functions, Azure DevOps, Data Factory, Azure SQL, Service Bus, Event Grid) 4. Supporting technology and concepts: a. Architecture styles, design patterns, and best practices (SOLID, MVC, REST, N-layered, SOA, Modular Monolith, Microservices, Event-Driven Architectures, DDD, Asynchronous & Parallel programming) b. Foundational CS knowledge c. Data modeling and relational schemas d. Database performance tuning e. Data integration, data warehousing, and big data technologies f. DevOps practices and tools (GIT, version control systems) g. CI/CD pipelines and cloud deployments h. Containerization and orchestration tools (Docker, Kubernetes) i. IoT solutions and edge computing j. Machine learning and advanced analytics 5. Teamwork and Communication Skill: a. Demonstrates the ability to effectively work in a team environment, can work across functions to verify requirements and align on business objectives. b. Demonstrates influential leadership through ability in driving product design and architecture, and adherence to IT engineering standards and architecture maturity. c. Excellent verbal and written communication skills and demonstrates the ability to effectively work asynchronously across time zones. d. Strong track record of keeping up to date with industry trends. Experience with the growth of others' capabilities. 6. Business Acumen: a. Demonstrated experience in more than one industry vertical b. Demonstrated ability to quickly gain knowledge in business domains, data, workflows and processes c. Experience translating business objectives and goals into technical solutions. ( This is contract to hire role )
INTERVIEW ASSURED IN 15 MINS
posted 1 week ago
experience6 to 11 Yrs
location
Bangalore
skills
  • queries
  • troubleshooting
  • tools
  • datastage
  • etl
  • data warehousing
  • devops
  • sql
Job Description
Job Description: DataStage Developer Location: Bangalore Experience: 6-15 years Qualification: B.Tech The DataStage Developer will be responsible for performing system development work around ETL, which includes developing new functions and supporting live systems. The role requires documentation, coding, and maintenance of ETL processes within the Enterprise Data Warehouse. The developer will investigate system faults, diagnose problems, and propose solutions. Collaboration with various teams to design, build, test, deploy, and maintain insightful MI reports is essential. The individual will interact with business analysts, project managers, and technical architects to ensure quality end-to-end solutions. Responsibilities also include supporting testing phases, participating in design workshops, and identifying delivery risks. The DataStage Developer will be responsible for designing, developing, and maintaining ETL processes within the Enterprise Data Warehouse. The role involves building new functionalities, supporting live systems, troubleshooting issues, and ensuring seamless data integration for business reporting and analytics. Key Responsibilities ETL Development: Design, code, and maintain ETL workflows using DataStage to support data warehousing needs. System Support: Investigate system faults, diagnose problems, and provide timely solutions to ensure smooth operations. Data Analysis & Reporting: Collaborate with teams to design, build, test, deploy, and maintain meaningful MI reports. Collaboration: Work closely with business analysts, project managers, and technical architects to deliver end-to-end solutions. Documentation & Testing: Maintain detailed documentation, support testing phases, and participate in design workshops. Risk Identification: Identify potential delivery risks and propose mitigation strategies. DevOps & Troubleshooting: Utilize DevOps tools to manage deployments and monitor system performance. Ideal Candidate Profile Strong experience with DataStage, ETL processes, and data warehousing Proficiency in SQL queries, troubleshooting, and DevOps tools Ability to collaborate with cross-functional teams and deliver high-quality solutions Strong analytical, problem-solving, and documentation skills
INTERVIEW ASSURED IN 15 MINS
posted 2 months ago

IMS Database Administartor(DBA)

WINTECH SERVICES INDIA PRIVATE LIMITED
experience6 to 11 Yrs
location
Bangalore, Chennai+4

Chennai, Noida, Hyderabad, Pune, Mumbai City

skills
  • cobol
  • db2 dba
  • ims
  • dba
Job Description
Who are we looking for We are seeking for 6+ years of administrator experienced and detail-oriented DB2 and IMS Database Administrator (DBA) to join our production support team. In this role, you will be responsible for maintaining the stability, availability, and performance of DB2 and IMS databases on IBM mainframe (z/OS) environments. The role requires strong problem-solving skills, a solid understanding of mainframe database internals, and a proactive approach to system health monitoring, incident response, and database maintenance. You will provide 24/7 production support, troubleshoot issues, monitor system health, optimize performance . Technical Skills: Proven experience as a DB2/IMS Databases Administrator or similar role in production support environments. 6+ years of hands-on experience supporting DB2 for z/OS and IMS (Information Management System) in a production environment. Strong knowledge of mainframe tools such as SPUFI, QMF, BMC, CA-DB2/IMS tools, and IBM utilities. Deep understanding of DB2 database internals, logs, buffer pools, catalog/directory, and utilities. Proficient in IMS Full-Function and Fast Path databases, DL/I calls, PSB/DBD maintenance. Solid experience with JCL, TSO/ISPF, SDSF, and mainframe batch job troubleshooting Experience with modern mainframe automation tools and schedulers (e.g., Control-M, CA-7). Knowledge of COBOL, CICS, and batch job data flows. Understanding of DB2 Data Sharing and IMS Sysplex environments. Experience with backup and recovery solutions Solid knowledge of Linux/Unix systems and scripting (Shell, Python, or similar). Proficiency in troubleshooting performance tuning, and capacity planning. In-depth understanding of data management (e.g. permissions, recovery, security and monitoring) Strong troubleshooting and problem-solving skills. Excellent communication and collaboration abilities. Ability to work in a 24/7 support rotation and handle urgent production issues. Familiarity with data security is the best practice and backup procedures. Responsibilities Production Support & Monitoring: o Provide 24x7 support for DB2 and IMS database environments, including on-call rotation. o Monitor database performance, availability, and integrity using mainframe tools and utilities. o Respond to incidents, troubleshoot issues, and resolve problems related to DB2/IMS systems. Database Maintenance & Administration: o Perform database backup and recovery procedures for DB2 and IMS databases. o Conduct regular reorgs, image copies, and utilities execution (RUNSTATS, REORG, CHECK). o Support DB2 and IMS subsystem maintenance, upgrades, and patching. Performance Tuning & Optimization: o Analyze and tune SQL queries, buffer pools, and access paths in DB2. o Optimize IMS database segments, DBDs, PSBs, and access methods. o Work with developers to design efficient data access strategies . Change Management & Deployments: o Review and implement database schema changes via Change Control processes. o Participate in software releases, ensuring database readiness and minimal impact on production. Security & Compliance: o Manage user access, RACF integration, and permissions in DB2/IMS environments. o Ensure compliance with enterprise security standards and data privacy regulations. Documentation & Collaboration: o Maintain accurate and up-to-date documentation, including runbooks, architecture diagrams, and operational procedures. o Collaborate with application teams, infrastructure, and middleware teams to support business applications
INTERVIEW ASSURED IN 15 MINS
posted 1 week ago

Senior Snowflake Data Engineer

Hucon Solutions India Pvt.Ltd.
Hucon Solutions India Pvt.Ltd.
experience8 to 13 Yrs
Salary8 - 18 LPA
location
Bangalore, Chennai+7

Chennai, Noida, Hyderabad, Gurugram, Kolkata, Pune, Mumbai City, Delhi

skills
  • aws
  • sql
  • data modeling
  • snowflake
  • data build tool
  • five tran
Job Description
Senior Snowflake Data Engineer Location: PAN India Experience: 8+ Years Skills: Snowflake, dbt, FiveTran, Snowpipe, AWS (MWAA, S3, Lambda), GitHub CI/CD Job Description We are looking for an experienced Senior Snowflake Data Engineer with strong expertise in modern data warehousing, cloud technologies, and ELT pipeline development. The ideal candidate should have deep hands-on experience in Snowflake, dbt, cloud environments, and CI/CD practices, with the ability to design scalable and efficient data solutions. Key Responsibilities Analyze, integrate, model, and interpret large and complex datasets from multiple sources. Design and implement ELT data pipelines using dbt with Snowflake as the primary cloud data warehouse. Build efficient and scalable data transformation pipelines using dbt at an advanced level. Work with ETL/ELT and data governance tools such as FiveTran and Alation. Utilize advanced Snowflake features such as RBAC, Dynamic Tables, and various optimization techniques. Ensure strong data modelling and warehousing practices across diverse database technologies. Manage orchestrations using Apache Airflow or AWS MWAA, along with CI/CD pipelines. Oversee continuous deployment, monitoring, and operations of data solutions using GitHub Actions, Terraform, and other DevOps tools. Collaborate with technical and non-technical stakeholders through effective communication. Contribute to building future-state Data Warehouse capabilities using cutting-edge technologies. Adapt and work efficiently within Agile methodology. Preferred Qualifications 2+ years of hands-on experience with Snowflake as a Cloud Data Warehouse and Data Lake platform. Strong understanding of cloud environments, especially AWS (S3, Lambda, MWAA). Airline industry domain experience is a plus.
INTERVIEW ASSURED IN 15 MINS
posted 1 week ago

Data Engineer

Lorven Technologies Private Limited
experience6 to 10 Yrs
WorkRemote
location
Bangalore, Chennai+6

Chennai, Noida, Kolkata, Gurugram, Pune, Mumbai City, Delhi

skills
  • azure
  • data engineering
  • data
  • bricks
  • factory
  • .net
  • python
Job Description
Data Engineer Azure Data Factory, SQL, Python, Databricks, ETL  Data Engineer .Net + Azure Data Factory  We are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining data systems and architectures that support our business needs. This role requires expertise in working with large datasets, cloud technologies, and advanced data platforms to ensure the availability, quality, and accessibility of data for business analytics and decision-making. Key Responsibilities: Design, build, and maintain data pipelines to collect, process, and store data efficiently from various sources. Work with cross-functional teams to understand business requirements and deliver data solutions that meet the needs of the organization. Optimize data storage and retrieval methods to enhance system performance and data quality. Integrate data from multiple sources (databases, data lakes, cloud storage, etc.) to build comprehensive data sets. Build and maintain data infrastructure, ensuring it is scalable, reliable, and secure. Implement and manage data governance policies, ensuring data accuracy, consistency, and compliance. Conduct data modeling and provide insights into the data through advanced analytics tools and reports. Perform data transformations and data wrangling tasks to prepare data for analysis. Troubleshoot data issues and collaborate with stakeholders to resolve technical challenges. Ensure the integrity of data pipelines and systems by conducting routine testing and validation. Required Skills and Qualifications: Bachelors degree in Computer Science, Engineering, Information Systems, or related field. Proven experience as a Data Engineer or in a similar role, with a minimum of [X] years of experience. Proficiency in data engineering tools and technologies such as SQL, Python, Java, Scala, and ETL frameworks. Experience working with cloud platforms (AWS, Azure, GCP) and data storage solutions (e.g., Redshift, Snowflake, BigQuery). Solid understanding of data modeling, database design, and cloud data architectures. Hands-on experience with data warehousing concepts and tools (e.g., Apache Hive, Apache Spark). Familiarity with data orchestration tools such as Apache Airflow, Azure Data Factory. Knowledge of real-time data streaming technologies (e.g., Kafka, Kinesis) is a plus. Strong problem-solving skills and ability to troubleshoot complex data issues. Familiarity with data security best practices and data privacy regulations (e.g., GDPR, HIPAA).
INTERVIEW ASSURED IN 15 MINS
posted 7 days ago
experience6 to 11 Yrs
location
Bangalore
skills
  • etl testing
  • etl
  • devops
  • queries
  • data warehousing
  • data stage etl
  • unix scripting
  • python
  • sql
  • control-m
Job Description
Job Description: DataStage Developer We are seeking an experienced DataStage Developer to design, build, and optimize data integration solutions across enterprise data platforms. The ideal candidate will have strong expertise in DataStage, data warehousing concepts, SQL, and automation using DevOps and scripting tools. Key Responsibilities Design, develop, and maintain ETL workflows using IBM DataStage in alignment with business and technical requirements. Work with large-scale data warehousing environments to support data integration, transformation, and loading processes. Write and optimize complex SQL queries for data extraction, validation, and performance tuning. Develop and maintain Unix shell scripts for automation, monitoring, and job orchestration. Utilize DevOps tools for version control, CI/CD, and deployment of ETL pipelines. Leverage Python for advanced data processing, automation, and integration tasks. Manage ETL scheduling, monitoring, and batch operations using Control-M. Collaborate with data architects, analysts, and cross-functional teams to ensure data quality, accuracy, and consistency. Troubleshoot ETL failures, performance issues, and data discrepancies in production and development environments. Document technical designs, data flows, and operational procedures. Required Skills & Qualifications Hands-on experience with IBM DataStage (Parallel & Server jobs). Strong understanding of data warehousing principles and ETL best practices. Proficiency in SQL with the ability to work on complex queries and tuning. Experience with Unix scripting, job automation, and server-side operations. Knowledge of Python for scripting and data manipulation. Familiarity with DevOps tools such as Git, Jenkins, or similar. Experience with Control-M or equivalent workload automation tools. Strong analytical, troubleshooting, and problem-solving abilities. Excellent communication skills and the ability to work collaboratively in cross-functional teams. Bachelors Degree mandatory.
INTERVIEW ASSURED IN 15 MINS
posted 1 month ago

Oracle BI developer

CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
CAPGEMINI TECHNOLOGY SERVICES INDIA LIMITED
experience6 to 11 Yrs
Salary6 - 14 LPA
location
Bangalore, Hyderabad+2

Hyderabad, Pune, Mumbai City

skills
  • obiee
  • sql
  • oas
  • obiee developer
  • oracle analytics cloud
  • oac
Job Description
Job Title: Oracle BI DeveloperExperience: 6-12 years Location: Mumbai, Bangalore, Chennai, Pune, Hyderabad Job Summary:We are seeking a highly skilled Oracle BI Developer with hands-on experience in OBIEE, OAS, and Oracle Analytics Cloud (OAC). The ideal candidate will be responsible for developing and maintaining interactive dashboards, reports, and visualizations, while ensuring optimal performance, security, and scalability of BI solutions. Key Responsibilities:Design, develop, and maintain dashboards, reports, visualizations, and analytical applications using OBIEE/OAS/OAC and BI Publisher.Perform RPD (Repository) development, data modeling, and troubleshooting related to data, performance, security, and functionality issues.Implement and manage Security Models for dashboards, roles, objects, and data within OBIEE/OAS/OAC environments.Administer and tune OBIEE/OAS/OAC environments, including Managed Servers, Admin Servers, WebLogic Configuration, and performance optimization.Create and maintain technical documentation, including data models, report specifications, and user guides.Write and optimize SQL queries for data extraction and analysis using relational databases such as Oracle or SQL Server.Follow best practices in BI architecture, data management, and data warehouse methodologies to ensure efficient, scalable BI solutions.Collaborate with cross-functional teams to support business intelligence needs and ensure data accuracy and consistency. Required Skills and Qualifications:612 years of professional experience in Business Intelligence and Analytics.Strong expertise in OBIEE, OAS, Oracle Analytics Cloud (OAC), and BI Publisher.Proficient in RPD development, security implementation, and OBIEE/OAS/OAC administration.Strong understanding of SQL, scripting, data warehousing, and performance tuning techniques.Experience with Oracle or SQL Server databases.Solid understanding of data modeling and BI architecture best practices.Excellent analytical, problem-solving, and communication skills.
INTERVIEW ASSURED IN 15 MINS
posted 2 months ago

Data Engineer - Analytics

Airbus India Private Limited
experience2 to 6 Yrs
location
Bangalore, Karnataka
skills
  • Python
  • SQL
  • Data Engineering
  • Data Integration
  • Data Analysis
  • Data Visualization
  • Application Development
  • Data Warehousing
  • Machine Learning
  • Agile Methodology
  • DevOps
  • Git
  • Docker
  • Palantir Skywise
  • ETLELT Processes
  • CICD Processes
Job Description
As an Associate Systems Engineer - Data Engineer - Analytics at Airbus Commercial Aircraft, you will play a crucial role in designing and building solutions that involve data engineering, integration, analysis, visualization, and application development within the Skywise Framework. Your primary responsibilities will include: - Working closely with the tech lead, Product Manager & Product Owners to understand processes, capture requirements, and solve business problems by leveraging data. - Designing, building, and maintaining robust analytics modules on the Palantir Skywise platform. - Engineering scalable and reliable data pipelines to ingest, transform, and model data from diverse enterprise sources. - Implementing complex business logic to power strategic KPIs and building user-facing visualizations. - Contributing to the "industrialization" of the platform by improving CI/CD processes, strengthening data governance, and implementing operational monitoring. - Developing and deploying AI/ML Models to forecast enterprise costs and identify strategic risks. - Driving intelligent features by going beyond reporting to build the platform's advanced capabilities. - Actively participating in the Agile-Scrum methodology to refine requirements, estimate effort, and deliver value every sprint. - Troubleshooting application issues, handling incidents/requests, and providing support on the developed tools. Qualifications & Experience: Required: - Bachelor/Master Degree in Computer Science, Computer Engineering, Information Technology, or relevant field. - Proficiency in Python, SQL, data modeling, data warehousing concepts, and ETL/ELT processes. - Hands-on experience with data platforms like Palantir, Databricks, Snowflake, or cloud services (AWS, Azure, GCP). - Ability to connect with various data sources and generate reports & dashboards. - Strong team player with experience in best coding practices, test plan creation, and working in an agile environment. Desired: - Direct experience with Palantir Foundry/Skywise. - Familiarity with front-end data visualization libraries or BI tools. - Experience with DevOps practices and tools. - Good written and verbal communication skills and excellent analytical abilities. Success Metrics: Your success will be measured by ensuring on-time delivery, innovative solutions, strong team bonding, and customer satisfaction. About the Company: Airbus India Private Limited pioneers sustainable aerospace for a safe and united world, fostering a culture of innovation, collaboration, and excellence. With a rich local heritage and a commitment to equal opportunities, Airbus is constantly seeking talented individuals to contribute to its diverse teams. Airbus in India also supports social initiatives to empower communities, including women in aviation. By submitting your application, you consent to Airbus using your information for monitoring purposes related to your application or future employment. Airbus is committed to equal opportunities and will not ask for any monetary exchange during the recruitment process. Flexible working arrangements are encouraged to stimulate innovative thinking at Airbus. (Note: The above job description is a summary based on the provided details and does not include any header information.),
ACTIVELY HIRING
posted 1 week ago
experience7 to 11 Yrs
location
Bangalore, Karnataka
skills
  • Data warehousing
  • Load
  • Data modeling
  • SQL
  • Python
  • Java
  • Cloud computing
  • Business intelligence
  • Data pipeline architecture
  • ETL Extract
  • Transform
Job Description
As a Senior Data Engineer at Smartsheet, you will play a crucial role in designing, developing, and maintaining robust and scalable data pipelines. Your responsibilities will include collaborating with business stakeholders to understand data requirements, implementing data quality checks, optimizing data pipelines for performance, and troubleshooting any issues that may arise. Here's what you will be doing: - Design, develop, and maintain robust and scalable data pipelines that ingest, transform, and load data from various sources into Smartsheet's data warehouse. - Collaborate with business stakeholders to understand data requirements and translate them into technical solutions. - Implement data quality checks and monitoring to ensure data accuracy and integrity. - Optimize data pipelines for performance and efficiency. - Troubleshoot and resolve data pipeline issues. - Stay up-to-date with emerging technologies and trends in data engineering. - Strategically apply and champion AI tools within your team's domain to improve project execution, system design, quality, and debugging, leading adoption of AI best practices and driving measurable productivity gains. - Perform other duties as assigned. To qualify for this role, you should have: - Bachelor's or Master's degree in Computer Science, Engineering, or a related field. - 7+ years of experience in data engineering or a similar role. - Strong proficiency in SQL and at least one programming language (e.g., Python, Java). - Experience with data pipeline tools and frameworks. - Experience with cloud-based data warehousing solutions (Snowflake). - Experience with AWS Kinesis, SNS, SQS. - Excellent problem-solving and analytical skills. - Strong communication and interpersonal skills. - Legally eligible to work in India on an ongoing basis. - Fluency in English is required. Key Skills required for this role include: - Data pipeline architecture. - Data warehousing. - ETL (Extract, Transform, Load). - Data modeling. - SQL. - Python or Java or Go. - Cloud computing. - Business intelligence. At Smartsheet, we value your ideas, support your potential, and ensure your contributions have a real impact. We encourage diversity of perspectives and welcome nontraditional paths because we believe that impactful work comes from individuals who care deeply and challenge thoughtfully. If you are looking for work that excites you, stretches you, and connects you to something bigger, let's build what's next, together.,
ACTIVELY HIRING
posted 3 weeks ago
experience5 to 9 Yrs
location
Bangalore, Karnataka
skills
  • JavaScript
  • HTML5
  • CSS
  • Java SE
  • Play Framework
  • MySQL
  • MongoDB
  • Highcharts
  • GitHub
  • AWS
  • UX design
  • Sprints
  • Agile
  • Jira
  • Microservices
  • RabbitMQ
  • Nginx
  • Jenkins
  • ReactJS
  • VueJS
  • SpringBoot
  • REST APIs
  • D3
  • Chartjs
  • Microsoft Azure Cloud Services
  • GCP Services
  • Apache HTTPD
  • Github Actions
Job Description
You would be part of a Fullstack Team with great leaders accelerating growth at Fractal, a leading AI & analytics organization. Enjoy a collaborative work environment, exceptional training, and career development with unlimited growth opportunities. With a Glassdoor rating of 4/5 and a customer NPS of 9/10, you'll thrive in this curious, supportive, high-performing team. **Responsibilities:** - Architect, estimate, manage, develop & maintain backend and frontend for various Data to Decision projects for Fortune 500 clients - Integrate algorithmic output from backend REST APIs with data science & engineering team - Create dynamic infographics with intuitive user controls in collaboration with business and product owners - Mentor junior engineers, deliver as per sprint plan, and support their career aspirations - Translate technical project journey and share with clients - Participate in UAT, diagnose & troubleshoot bugs and application integration issues - Create and maintain documentation related to developed processes and applications **Qualifications:** **Required Qualifications:** - 5+ years of demonstrable experience designing, building, and working as a Fullstack Engineer for enterprise web applications - Expert-level proficiency with JavaScript (ES6), HTML5 & CSS - Expert-level proficiency with ReactJS or VueJS - Expert-level proficiency with Java SE, SpringBoot or Play Framework - Familiarity with common databases (RDBMS such as MySQL & NoSQL such as MongoDB) and data warehousing concepts - Understanding of REST concepts and building/interacting with REST APIs - Deep understanding of UI concepts including cross-browser compatibility, responsive web design, and testing libraries like Jest and jUnit - Experience with common JS visualization libraries and core backend concepts - Experience with deploying and maintaining high traffic infrastructure - Problem-solving skills, and familiarity with code versioning tools such as GitHub **Preferred Qualifications:** - Familiarity with Microsoft Azure Cloud Services, AWS, or GCP Services - Experience working with UX designers and managing Sprints with Jira - Experience with Microservices, Messaging Brokers, and reverse proxy engines - Familiarity with CI/CD tools like Github Actions or Jenkins **Education:** - B.E/B.Tech/M.Tech in Computer Science or related technical degree OR Equivalent,
ACTIVELY HIRING
posted 2 months ago

Snowflake Developer

Numeric Technologies
experience2 to 6 Yrs
location
Bangalore, Karnataka
skills
  • Snowflake
  • DBT
  • Python
  • Unix
  • SQL
  • ETL
  • OLTP
  • OLAP
  • Data Modeling
  • AWS
  • Azure
  • Matillion
  • Snowpark
  • Data Warehouse
Job Description
As an experienced candidate with 5+ years of overall experience, including 3+ years in Snowflake and recent project experience in Snowflake, you will be expected to have a deep understanding of Snowflake and its utilities. Your 2+ years of relevant experience in DBT will also be crucial for this role. Additionally, having experience in Python, Matillion, and Snowpark will be considered an advantage. Key Responsibilities: - Design, develop, document, test, and debug new and existing software systems. - Write Snowflake SQL queries and develop scripts in Unix, Python, etc., for Extract, Load, and Transform data. - Utilize Snowflake utilities such as SnowSQL, SnowPipe, Snowpark, Python, Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing, and stored procedures. - Demonstrate an in-depth understanding of Data Warehouse/ODS, ETL concepts, and modeling structure principles. - Work on Data warehousing tasks including OLTP, OLAP, Dimensions, Facts, and Data modeling. - Gather and analyze system requirements effectively. - Collaborate with teams and function well in a cross-team environment. - Familiarity with data visualization tools like Tableau/Power BI will be beneficial. - Exposure to the AWS/Azure Data ecosystem would be a plus. Qualifications Required: - 5+ years of overall experience. - 3+ years of relevant experience in Snowflake with recent project experience. - 2+ years of relevant experience in DBT. - Experience in Python, Matillion, and Snowpark will be advantageous. - Good working knowledge of DBT, Snowflake, and data visualization tools. - Ability to work effectively in a team and gather system requirements. - Exposure to AWS/Azure Data ecosystem would be beneficial. This job will provide you with the opportunity to leverage your expertise in Snowflake, DBT, and related technologies to contribute to the development and optimization of software systems. Your role will involve working closely with data warehousing concepts and collaborating with teams to meet system requirements effectively.,
ACTIVELY HIRING
posted 3 weeks ago

Data Annotator

HORIBA PVT ENTERPRISES
experience3 to 8 Yrs
Salary18 - 30 LPA
location
Bangalore, Chennai+9

Chennai, Noida, Hyderabad, United States Of America, Gurugram, Kolkata, Pune, West Godavari, Mumbai City, Delhi

skills
  • analytical review
  • data analytics
  • engagement planning
  • control environment
  • continuous monitoring
  • annual budgeting
  • computer assisted audit
  • continuous controls monitoring
  • controls assessment
  • annual contract maintenance
Job Description
We are seeking a meticulous and organized Data Annotator for a 6-month contract, potentially extendable to 1 year. In this role, you will collaborate with our data science team and play a vital part in handling large textual data sets. Your primary responsibilities will include identifying and labeling named entities in text, classifying documents, validating machine learning model outputs, and identifying patterns in data. This position offers a chance to contribute significantly to the development of advanced machine learning models and to work on challenging tasks that have a broad impact. Responsibilities Identification and labeling of named entities in text, such as companies, locations, job titles, and skills. Classifying documents into various categories. Validating outputs of Machine Learning models. Identifying common patterns in datasets. Ensuring accuracy and reliability in data annotation.
posted 4 weeks ago

Supply Chain Manager

BHA FOODS PRIVATE LIMITED
experience5 to 10 Yrs
Salary6 - 14 LPA
location
Bangalore, Kochi+8

Kochi, Chennai, Ernakulam, Hyderabad, Gurugram, Pondicherry, Pune, Chandigarh, Mumbai City

skills
  • warehouse operations
  • distribution
  • demand
  • supply chain management
  • logistics
  • sourcing
  • inventory management
  • management
  • supply
  • planning
  • procurement
  • materials management
Job Description
We are looking for an experienced and organized Supply Chain Manager to manage the complete supply chain process from purchasing raw materials to delivering the final product. The ideal candidate will plan, coordinate, and monitor the movement of goods, ensuring operations run smoothly and efficiently. This role involves working with suppliers, production teams, and logistics partners to achieve business goals and customer satisfaction. Key Responsibilities Manage procurement, production planning, and logistics operations. Build strong relationships with suppliers and negotiate contracts. Monitor inventory levels and reduce waste or shortages. Coordinate with internal departments for smooth operations. Track shipments and ensure on-time delivery to customers. Analyze data to improve supply chain efficiency and reduce costs. Prepare reports and share regular updates with management. Desired Candidate Profile Bachelors degree in Supply Chain Management, Business, or a related field. 5+ years of experience in supply chain or operations management. Good knowledge of logistics, procurement, and inventory management. Strong communication, leadership, and problem-solving skills. Familiarity with ERP systems (SAP / Oracle / NetSuite preferred). Key Skills Supply Chain Management, Procurement, Vendor Management, Logistics, Inventory Control, Planning, Coordination, Forecasting, ERP Systems, Communication, Leadership. About the Company Our company is a growing organization offering exciting opportunities for professionals to build rewarding careers. We value teamwork, innovation, and operational excellence. Join us and be part of a dynamic team driving success through efficient supply chain management.
posted 2 weeks ago

Warehouse Manager

AWINMO INDIA MARKETING PRIVATE LIMITED
experience7 to 12 Yrs
Salary12 LPA
location
Bangalore, Chennai+8

Chennai, Hisar, Hyderabad, Kurukshetra, Kolkata, Bharuch, Pune, Silchar, Mumbai City

skills
  • control
  • management
  • compliance
  • workflow
  • analysis
  • performance
  • data
  • leadership
  • reporting
  • optimization
  • safety
  • appraisal
  • inventory
  • procedures
  • coaching
  • shipping
  • warehouse
  • attention
  • receiving
  • detail
  • accuracy
  • employees
  • motivating
  • to
  • team
Job Description
Responsibilities: Overseeing receiving, warehousing, and distribution operations. Implementing operational policies and procedures. Implementing and overseeing security operations. Ensuring effective and safe use of warehouse equipment. Ensuring the safety of staff. Motivating and disciplining staff. Maintaining documentation and keeping accurate records of warehouse activities. Maintaining awareness and knowledge of the condition and location of fleet vehicles. Assisting with deliveries where required.
logo

@ 2025 Shine.com | All Right Reserved

Connect with us:
  • LinkedIn
  • Instagram
  • Facebook
  • YouTube
  • Twitter