286 Big Data Architect Jobs in Chittoor

We are currently hiring for the role of Sales Manager/Engineer for one of our esteemed clients in Mumbai Location. Please find the detailed JD below: Position :- Big Data Developer Location :- Pune Experience : 5+ Years  Job Description A Big Data Developer specializes in designing, building, and managing systems that handle large amounts of data using technologies like Hadoop or Spark. Here's a breakdown of the role: Mandatory Skills-API Development & Integration, JAVA, Spark, BIG Data Development & Data Engineering. Key Responsibilities: - Designing and Building Big Data Applications: Collaborate with team members to create big data applications, requiring a wide range of skills, including Big Data, Python, Java, and data modelling. - Coding and Testing: Spend most of the day coding, testing, and fixing bugs in big data applications. - Data Management: Manage data processing systems, perform ETL tasks, and ensure data quality. - Infrastructure Management: Select and integrate Big Data tools and frameworks, monitor performance, and advise on infrastructure changes. If intrested Please share your updated CV and below details Total Exp in Big Data -Exp in SQL - Exp in Linux - Current CTC - Current Location -Notice Period - Reason for change -  -------------------------- Thanks & Regards,Evoke HR Solutions Pvt Ltd || +91 6358853287

Job Description We are looking for a skilled Big Data QA Engineer to join our team and ensure the quality and reliability of our data processing pipelines. This role involves designing and executing both automated and manual tests for batch workflows, validating data integrity across transformation stages, and maintaining a robust Python-based test automation framework. The ideal candidate will have hands-on experience with AWS services, big data formats, and a strong understanding of testing methodologies in a data-centric environment. Preferred Skills and Experience: Design, develop, and execute automated and manual batch test cases for data processing pipelines. Validate data integrity and transformation logic across multiple stages of batch workflows. Monitor and troubleshoot batch job failures, performance issues, and data mismatches. Maintain and enhance Python-based test automation suite and framework. Evaluates system performance, reproduces issues, and works with development teams to resolve identified problems. Collaborates effectively with peers and management to improve application quality and testing processes. Minimum 4 years of experience with a focus on batch testing and data validation. Strong proficiency in Python for test automation and scripting. Hands-on experience with AWS services such as S3, Lambda, EMR, and Athena. Experience with data formats like JSON, Parquet, and CSV, and tools like Pandas and PySpark. Familiarity with version control systems (e.g., Git) and CI/CD tools (e.g., Jenkins, GitHub Actions). Solid understanding of software testing methodologies, including regression, integration, and system testing. Ability to analyze logs and metrics to identify root causes of failures. Experience working with agile methodology. Excellent verbal and written communication skills, and ability to collaborate with cross-functional teams. Minimum 4 years of experience with a focus on batch testing and data validation. Strong proficiency in Python for test automation and scripting. Hands-on experience with AWS services such as S3, Lambda, EMR, and Athena. Experience with data formats like JSON, Parquet, and CSV, and tools like Pandas and PySpark. Familiarity with version control systems (e.g., Git) and CI/CD tools (e.g., Jenkins, GitHub Actions). Solid understanding of software testing methodologies, including regression, integration, and system testing. Ability to analyze logs and metrics to identify root causes of failures. Experience working with agile methodology. Excellent verbal and written communication skills, and ability to collaborate with cross-functional teams. Bachelors degree in Computer Science or equivalent preferred.   

Location: Bangalore, Chennai Employment Type: Full-Time Experience Level: Mid to Senior Level About the Role We are looking for a Big Data Engineer with strong experience in AWS cloud services, Python, and PySpark to design, build, and optimize large-scale data pipelines and data processing systems. The ideal candidate will work closely with data scientists, analysts, and platform engineers to ensure reliable, scalable, and efficient data infrastructure. Key Responsibilities Design, develop, and maintain big data processing pipelines using PySpark and AWS services (EMR, Glue, S3, Lambda, Redshift, Athena, etc.). Implement ETL/ELT data workflows to ingest, transform, and store structured and unstructured data. Optimize data processing jobs for performance, scalability, and cost efficiency in the cloud. Collaborate with data analysts and data scientists to support data modeling, feature engineering, and analytics use cases. Ensure data quality, governance, and security across all data environments. Monitor and troubleshoot data pipeline performance and production issues. Automate data workflows using Python, Airflow, or AWS Step Functions. Contribute to the development of best practices, reusable components, and documentation.

Location - LTIM Pan IndiaExperience - 5+to 12+ yrsGeneric JD-Mandatory Skills - Data Science, Gen AI, Python, RAG and Azure/AWS/GCP, AI/ML, NLP Secondary - (Any) Machine Learning, Deep Learning, ChatGPT, Langchain, Prompt, vector stores, RAG, llama, Computer vision, Deep learning, Machine learning, OCR, Transformer, regression, forecasting, classification, hyper parameter tunning, MLOps, Inference, Model training, Model DeploymentJD_ More than 6 years of experience in Data Engineering, Data Science and AI / ML domainExcellent understanding of machine learning techniques and algorithms, such as GPTs, CNN, RNN, k-NN, Naive Bayes, SVM, Decision Forests, etc.Experience using business intelligence tools (e.g. Tableau, PowerBI) and data frameworks (e.g. Hadoop)Experience in Cloud native skills.Knowledge of SQL and Python; familiarity with Scala, Java or C++ is an assetAnalytical mind and business acumen and Strong math skills (e.g. statistics, algebra)Experience with common data science toolkits, such as TensorFlow, KERAs, PyTorch, PANDAs, Microsoft CNTK, NumPy etc. Deep expertise in at least one of these is highly desirable.Experience with NLP, NLG and Large Language Models like BERT, LLaMa, LaMDA, GPT, BLOOM, PaLM, DALL-E, etc.Great communication and presentation skills. Should have experience in working in a fast-paced team culture.Experience with AIML and Big Data technologies like AWS SageMaker, Azure Cognitive Services, Google Colab, Jupyter Notebook, Hadoop, PySpark, HIVE, AWS EMR etc.Experience with NoSQL databases, such as MongoDB, Cassandra, HBase, Vector databasesGood understanding of applied statistics skills, such as distributions, statistical testing, regression, etc.Should be a data-oriented person with analytical mind and business acumen.

1. Billing Specialist Job Summary: The Billing Specialist is responsible for generating accurate invoices, ensuring timely billing, and resolving any discrepancies related to customer accounts. This role requires strong attention to detail and collaboration with internal teams and clients. Key Responsibilities: Prepare and issue invoices based on contract terms and service delivery. Validate billing data and ensure accuracy. Coordinate with sales, delivery, and finance teams to resolve billing issues. Maintain billing records and documentation. Monitor accounts receivable and follow up on outstanding payments. Assist in month-end closing and reporting.  2. Dispute Management Analyst Job Summary: The Dispute Management Analyst handles customer disputes related to billing, payments, and services. The role involves investigating discrepancies, coordinating with internal teams, and ensuring timely resolution to maintain customer satisfaction. Key Responsibilities: Review and analyze disputed invoices or payments. Communicate with customers to understand the nature of disputes. Collaborate with billing, sales, and delivery teams to resolve issues. Document dispute cases and maintain resolution logs. Provide regular updates to stakeholders on dispute status. Support audit and compliance requirements.  Cash Application Specialist Job Summary: The Cash Application Specialist is responsible for applying incoming payments to customer accounts accurately and timely. This role ensures proper reconciliation of accounts and supports the overall accounts receivable process. Key Responsibilities: Apply customer payments (checks, wire transfers, ACH) to appropriate invoices. Reconcile unapplied cash and resolve payment discrepancies. Work closely with collections and billing teams. Maintain accurate records of transactions. Assist in month-end and year-end closing activities. Generate reports on cash application metrics.

As a Big Data QA Engineer, you will be responsible for validating and testing large-scale data processing systems. Your main role will involve designing, executing, and maintaining automated and manual test suites focused on batch workflows, data integrity, and transformation validation. Working closely with data engineers, developers, and product teams, you will ensure high-quality, reliable, and scalable data pipelines. - Design, develop, and execute automated and manual batch test cases for big data pipelines. - Validate data integrity, schema accuracy, and transformation logic across multiple stages. - Monitor and troubleshoot batch job failures, performance issues, and data mismatches. - Maintain and enhance a Python-based test automation framework. - Reproduce data issues, analyze system performance, and collaborate with developers to implement fixes. - Analyze logs and metrics to determine the root cause of failures. - Work closely with cross-functional teams to improve testing processes and ensure high-quality deliveries. Qualifications Required: - Minimum 4 years of experience in Big Data testing, batch processing, and data validation. - Strong proficiency in Python for automation and scripting. - Hands-on experience with AWS services such as S3, Lambda, EMR, and Athena. - Experience working with big data formats: JSON, Parquet, CSV. - Practical knowledge of Pandas and PySpark for data analysis and validation. - Experience with version control tools (Git) and CI/CD pipelines (Jenkins, GitHub Actions). - Strong understanding of testing methodologies: regression, integration, system testing. - Ability to analyze logs/metrics and solve data quality issues. - Experience working in Agile/Scrum environments. - Excellent communication and collaboration skills. This role is ideal for individuals highly skilled in Python automation, AWS big data services, and batch data validation, with a passion for ensuring the accuracy and reliability of data pipelines.,

Role Overview: As a Senior Data Engineer, you will be responsible for designing, building, and optimizing scalable data pipelines for large-scale data processing. Your expertise in Python, Spark, Databricks, and Azure will be crucial in handling complex data engineering tasks. You will work with cloud platforms, specifically Azure, to process and analyze large datasets efficiently. Key Responsibilities: - Design, build, and optimize scalable data pipelines using Python and Apache Spark. - Utilize Azure Databricks and PySpark for big data processing and analysis. - Implement data integration and orchestration using Azure Data Factory. - Utilize Azure Data Lake Storage for big data analytics and transformation. - Write efficient Python code using libraries like Pandas and NumPy for data manipulation. - Work with Azure services such as Azure SQL Database, Azure Synapse Analytics, Azure Cosmos DB, and Azure Blob Storage. - Experience with Infrastructure as Code (IaC) tools like Terraform or Biceps for provisioning Azure infra resources. - Architectural experience is a plus. - Design and maintain complex SQL queries for relational databases. - Ensure high-quality data management, integrity, and security throughout data processing. - Collaborate with cross-functional teams to understand data requirements and build solutions. - Provide mentorship and guidance to junior team members. Key Skills & Qualifications: - Proficiency in Python, including knowledge of Pythonic principles, data structures, and algorithms. - In-depth knowledge of Azure services such as Azure SQL Database, Azure Synapse Analytics, Azure Cosmos DB, Azure Data Factory, Azure Blob Storage, and Azure Data Lake Storage. - Strong experience with Apache Spark using Azure Databricks and PySpark. - Strong SQL skills for querying and managing relational databases. - Excellent communication skills for effective collaboration and technical solution presentation. - Strong analytical and problem-solving skills for resolving complex data challenges. Qualification Required: - B.Tech in any branch or specialization.,

As a Software Engineer II at JPMorgan Chase within the Corporate Technology, you will be part of an agile team working to enhance, design, and deliver software components in a secure, stable, and scalable way. You will execute software solutions through design, development, and technical troubleshooting of multiple components within a technical product, application, or system, while gaining the skills and experience needed to grow within your role. You will also contribute to the team culture of diversity, equity, inclusion, and respect. - Executes standard software solutions, design, development, and technical troubleshooting - Writes secure and high-quality code using the syntax of at least one programming language with limited guidance - Designs, develops, codes, and troubleshoots with consideration of upstream and downstream systems and technical implications - Applies knowledge of tools within the Software Development Life Cycle toolchain to improve the value realized by automation - Applies technical troubleshooting to break down solutions and solve technical problems of basic complexity - Gathers, analyzes, and draws conclusions from large, diverse data sets to identify problems and contribute to decision-making in service of secure, stable application development - Learns and applies system processes, methodologies, and skills for the development of secure, stable code and systems Qualifications Required: - Formal training or certification on software engineering concepts and 2+ years applied experience - Hands-on practical experience in system design, application development, testing, and operational stability - Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages - Proficient in coding in Java, Python, and Spark - Knowledge on Restful Microservices using Spring Boot or Python web framework - Build data pipelines using Bigdata, Spark - Hands-on experience on AWS - Experience across the whole Software Development Life Cycle - Exposure to agile methodologies such as CI/CD, Application Resiliency, and Security - Emerging knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.) Additional Details: - Exposure to modern front-end technologies is preferred - Exposure to cloud technologies - Familiarity with terraform and containerization (Kubernetes/ECS),

Role Overview: As a Big Data & Data Engineering Module Lead with 5+ years of experience, your main responsibility will be to work with SnapLogic in at least one project and have hands-on experience in Snowflake. Additionally, you will be expected to have expertise in ETL tools like Datastage, strong knowledge in ETL, Data Modelling, Data warehousing, SQL, PL/SQL, and RDBMS. Your role will involve designing, developing, and deploying reliable solutions, working with business partners to provide lasting solutions, configuring clustered and distributed scalable parallel environments, having cloud platform knowledge (AWS or Azure), and proficiency in Python / Pyspark. You should also have knowledge in job controlling/scheduling tools with batch programming skills, the ability to work with developers and lead them to successful job completion, good analytical and troubleshooting skills, as well as excellent communication and strong interpersonal skills. Key Responsibilities: - Work with SnapLogic in at least one project - Hands-on experience in Snowflake - Experience with ETL tools like Datastage - Strong knowledge in ETL, Data Modelling, and Data warehousing - Proficiency in SQL, PL/SQL, and RDBMS - Design, develop, and deploy reliable solutions - Collaborate with business partners to provide long-lasting solutions - Configure clustered and distributed scalable parallel environments - Knowledge in cloud platforms like AWS or Azure - Proficiency in Python / Pyspark is preferred - Knowledge in job controlling/scheduling tools with batch programming skills - Work with developers and lead them in successful job completion - Strong analytical and troubleshooting skills - Excellent communication and strong interpersonal skills Qualifications Required: - 5+ years of experience in Big Data & Data Engineering - Hands-on experience with SnapLogic - Knowledge in Snowflake and ETL tools like Datastage - Strong understanding of ETL, Data Modelling, and Data warehousing - Proficiency in SQL, PL/SQL, and RDBMS - Experience in designing, developing, and deploying reliable solutions - Ability to work with business partners and provide long-lasting solutions - Knowledge in configuring clustered and distributed scalable parallel environments - Familiarity with cloud platforms like AWS or Azure - Proficiency in Python / Pyspark preferred - Understanding of job controlling/scheduling tools with batch programming skills - Ability to work with developers and lead them to successful job completion - Strong analytical and troubleshooting skills - Excellent communication and strong interpersonal skills,

As a Big Data Engineer with Gen AI, you will be responsible for the following: - Hands-on experience with Kafka/Kinesis for real-time data processing. - Strong SQL skills with a background in database design and data modeling. - Proficiency in working with Hadoop, Hive, and Spark (PySpark/Scala). - Comprehensive understanding of data warehousing, ETL processes, data migration, and integration. - Knowledge of Big Data technologies and distributed computing. - Exposure to GenAI/ML frameworks such as TensorFlow, PyTorch, prompt engineering, and RAG models. - Experience in cloud architecture, CI/CD pipelines, and automation. Please note that the job location for this position includes Hyderabad, Bangalore, NCR, and Pune with a notice period of 30 days.,

As a Big Data Architect, you will be responsible for designing and implementing scalable and reliable big data solutions. Your key responsibilities will include: - Demonstrating proficiency in Spark, Scala, Hadoop MapReduce/HDFS, PIG, HIVE, and AWS cloud computing. - Utilizing hands-on experience with tools such as EMR, EC2, Pentaho BI, Impala, ElasticSearch, Apache Kafka, Node.js, Redis, Logstash, statsD, Ganglia, Zeppelin, Hue, and KETTLE. - Sound expertise in Machine learning, Zookeeper, Bootstrap.js, Apache Flume, FluentD, Collectd, Sqoop, Presto, Tableau, R, GROK, MongoDB, Apache Storm, and HBASE. - Hands-on experience in Core Java & Advanced Java development. To qualify for this role, you must have: - A Bachelor's degree in Computer Science, Information Technology, or MCA. - Four years of relevant experience in a similar role. - Strong analytical and problem-solving skills. - Attention to detail with exceptional written and verbal communication abilities. - The capability to work both independently and collaboratively within a team environment. (Note: Additional Company Details are not provided in the Job Description),

You will be responsible for the following tasks: - Understand the Business Problem and the Relevant Data - Maintain an intimate understanding of company and department strategy - Translate analysis requirements into data requirements - Identify and understand the data sources that are relevant to the business problem - Develop conceptual models that capture the relationships within the data - Define the data-quality objectives for the solution - Be a subject matter expert in data sources and reporting options - Architect Data Management Systems - Leverage understanding of the business problem and the nature of the data to select appropriate data management system (Big Data, OLTP, OLAP, etc.) - Design and implement optimum data structures in the appropriate data management system (GCP, Snowflake, Hadoop, Teradata, SQL Server, etc.) to satisfy the data requirements - Plan methods for archiving/deletion of information - Develop, Automate, and Orchestrate an Ecosystem of ETL Processes for Varying Volumes of Data - Identify and select the optimum methods of access for each data source (real-time/streaming, delayed, static) - Determine transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical data model - Develop processes to efficiently load the transform data into the data management system - Prepare Data to Meet Analysis Requirements - Work with the data scientist to implement strategies for cleaning and preparing data for analysis (e.g., outliers, missing data, etc.) - Develop and code data extracts - Follow best practices to ensure data quality and data integrity - Ensure that the data is fit to use for data science applications Qualifications and Experience: - 5+ years developing, delivering, and/or supporting data engineering, advanced analytics or business intelligence solutions - Ability to work with multiple operating systems (e.g., MS Office, Unix, Linux, etc.) - Experienced in developing ETL/ELT processes using Apache Ni-Fi and Snowflake - Experienced in Cloud based solutions using AWS/AZURE/GCP/Snowflake. - Significant experience with big data processing and/or developing applications and data sources via Spark, etc. - Understanding of how distributed systems work - Familiarity with software architecture (data structures, data schemas, etc.) - Strong working knowledge of databases (Oracle, MSSQL, etc.) including SQL and NoSQL. - Strong mathematics background, analytical, problem solving, and organizational skills - Strong communication skills (written, verbal and presentation) - Experience working in a global, cross-functional environment - Minimum of 2 years experience in any of the following: At least one high-level client, object-oriented language (e.g., C#, C++, JAVA, Python, Perl, etc.); at least one or more web programming language (PHP, MySQL, Python, Perl, JavaScript, ASP, etc.); one or more Data Extraction Tools (SSIS, Informatica etc.) About Micron Technology, Inc.: Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence. With a relentless focus on customers, technology leadership, and operational excellence, Micron delivers a rich portfolio of memory and storage products through the Micron and Crucial brands. For more information, please visit micron.com/careers Please note that Micron prohibits the use of child labor and complies with all applicable laws and industry labor standards. Candidates are encouraged to use AI tools to enhance their resumes, but accuracy is crucial. To verify the authenticity of any communication claiming to be from Micron, please check the official Micron careers website.,

Role Overview: As a software engineer at Google, you will be developing the next-generation technologies that impact how billions of users connect, explore, and interact with information and each other. You will work on critical projects that cater to Google's needs, with the opportunity to switch teams and projects as both you and the fast-paced business evolve. Your role will involve handling information at massive scale and contributing to various areas such as information retrieval, distributed computing, system design, networking, security, artificial intelligence, UI design, and more. Key Responsibilities: - Develop big data pipelines with over 250 billion rows and report solutions ensuring low tolerances for data error. - Create data platform tooling for environment management, data management, pipeline alerting/monitoring, and data reconciliation. - Lead the design, data modeling, architecture, coding, performance tuning, testing, and support of analytical systems, taking ownership of the Software Development Life Cycle (SDLC) cycle. - Maintain development practices including technical design, solution development, systems configuration, test documentation/execution, issue resolution, and write modular and self-sustaining code. - Act as a site lead for a team. Qualifications Required: - Bachelor's degree or equivalent practical experience. - 8 years of experience with one or more general-purpose programming languages such as Java, C/C++, or Python. - 5 years of experience in testing and launching software products. - 8 years of experience with data structures and algorithms. - Experience working with big data platforms like BigQuery, F1, or Spanner. - Knowledge of data warehousing concepts and best practices.,

As a Big Data Engineer at the company, you will be responsible for working on scalable data solutions and demonstrating expertise in Python. Your role will be based at the customer location in Hyderabad, with a hybrid work setup allowing you to work from the office for 3 days a week. **Key Responsibilities:** - Utilize Python for data processing - Work with Big Data technologies such as Hive, Spark or Snowflake, and Kafka - Utilize SQL/SQLServer for data operations **Qualifications Required:** - Proficiency in Python for data processing - Experience with Big Data technologies like Hive, Spark or Snowflake, and Kafka - Strong knowledge of SQL/SQLServer If you are passionate about Big Data and have the required expertise, the company encourages you to apply for this position by sending your resume to samdarshi.singh@mwidm.com or by direct messaging. For more information, you can contact the company at +91 62392 61536.,

As a Technical Support Engineer for Big Data applications and systems in a Hadoop ecosystem, your responsibilities will include: - Providing technical support and troubleshooting for Big Data applications and systems built on the Hadoop ecosystem. - Monitoring system performance, analyzing logs, and identifying potential issues before they impact services. - Collaborating with engineering teams to deploy and configure Hadoop clusters and related components. - Assisting in maintenance and upgrades of Hadoop environments to ensure optimum performance and security. - Developing and maintaining documentation for processes, procedures, and system configurations. - Implementing data backup and recovery procedures to ensure data integrity and availability. - Participating in on-call rotations to provide after-hours support as needed. - Staying up to date with Hadoop technologies and support methodologies. - Assisting in the training and onboarding of new team members and users on Hadoop best practices. Qualifications required for this role: - Bachelor's degree in Computer Science, Information Technology, or a related field. - 3+ years of experience in Big Data support or system administration, specifically with the Hadoop ecosystem. - Strong understanding of Hadoop components (HDFS, MapReduce, Hive, Pig, etc.). - Experience with system monitoring and diagnostics tools. - Proficiency in Linux/Unix commands and scripting languages (Bash, Python). - Basic understanding of database technologies and data warehousing concepts. - Strong problem-solving skills and ability to work under pressure. - Excellent communication and interpersonal skills. - Ability to work independently as well as collaboratively in a team environment. - Willingness to learn new technologies and enhance skills. If you join our team, you will benefit from: - Competitive salary and benefits package. - Opportunity to work on cutting-edge technologies and solve complex challenges. - Dynamic and collaborative work environment with opportunities for growth and career advancement. - Regular training and professional development opportunities.,

As a lead developer, you will play a crucial role in developing new software products and enhancing existing ones. Your responsibilities will include: - Writing clean, high-quality, high-performance, and maintainable code - Developing and supporting software, such as applications, database integration, interfaces, and new functionality enhancements - Coordinating cross-functionally to ensure projects meet business objectives and compliance standards - Supporting the testing and deployment of new products and features - Participating in code reviews The ideal candidate for this role is a self-motivated, multi-tasker, and demonstrated team-player. You should excel in working with large-scale applications and frameworks, and possess outstanding communication and leadership skills. As a lead developer, you will play a crucial role in developing new software products and enhancing existing ones. Your responsibilities will include: - Writing clean, high-quality, high-performance, and maintainable code - Developing and supporting software, such as applications, database integration, interfaces, and new functionality enhancements - Coordinating cross-functionally to ensure projects meet business objectives and compliance standards - Supporting the testing and deployment of new products and features - Participating in code reviews The ideal candidate for this role is a self-motivated, multi-tasker, and demonstrated team-player. You should excel in working with large-scale applications and frameworks, and possess outstanding communication and leadership skills.

As a Data Scientist at Novartis, you will have the opportunity to understand complex and critical business problems from various stakeholders and business functions. You will formulate an integrated analytical approach to mine data sources, employ statistical methods, and utilize machine learning algorithms to contribute to solving unmet medical needs, discover actionable insights, and automate processes for reducing effort and time for repeated use. Your role will involve managing the definition, implementation, and adherence to the overall data lifecycle of enterprise data, ensuring the availability of useful, clean, and accurate data throughout its useful lifecycle. Additionally, you will need to have high agility to work across various business domains. **Key Responsibilities:** - Innovate by transforming the way problems are solved using effective data management, Data Science, and Artificial Intelligence. - Articulate solutions/recommendations to business users. - Provide pathways to manage data effectively for analytical uses. - Present analytical content concisely and effectively to non-technical audiences and influence non-analytical business leaders to drive major strategic decisions based on analytical inputs. - Collaborate with internal stakeholders, external partners, institutions, and cross-functional teams to solve critical business problems and propose operational efficiencies and innovative approaches. - Evaluate the need for technology and novel scientific software, visualization tools, and new computation approaches to increase efficiency and quality of Novartis data sciences practices. - Identify research articles, reproduce/apply methodology to Novartis business problems, and contribute to cross-industry work streams in external relevant working groups. - Ensure exemplary communication with all stakeholders, including senior business leaders. - Contribute to the development of Novartis data management and data science capabilities. **Qualifications Required:** - Work Experience: 10+ years of relevant experience in Data Science. - Skills: Apache Spark, Artificial Intelligence (AI), Big Data, Data Governance, Data Literacy, Data Management, Data Quality, Data Science, Data Strategy, Data Visualization, Machine Learning (ML), Master Data Management, Python (Programming Language), R (Programming Language), Statistical Analysis. If managing a team, you will be expected to empower the team, provide guidance and coaching with limited guidance from more senior managers. Additionally, you will be responsible for the reporting of technical complaints, adverse events, and special case scenarios related to Novartis products within 24 hours of receipt. **Why Novartis:** Novartis is committed to reimagine medicine to improve and extend people's lives, striving to become the most valued and trusted medicines company in the world. By joining Novartis, you will be part of a mission-driven organization where associates are the driving force behind reaching ambitious goals. For more information on benefits and rewards at Novartis, please refer to the Novartis Life Handbook: [Novartis Life Handbook](https://www.novartis.com/careers/benefits-rewards) **Diversity and Inclusion:** Novartis is dedicated to building an outstanding, inclusive work environment with diverse teams that are representative of the patients and communities they serve. **Accessibility and Accommodation:** Novartis is committed to working with and providing reasonable accommodation to individuals with disabilities. If you require accommodation during the recruitment process, please contact [email protected] with details of your request and the job requisition number. Join the Novartis Network to stay connected and learn about suitable career opportunities: [Novartis Network](https://talentnetwork.novartis.com/network),

You will be working on Python programming language with concepts like Multi-threading, Multi-Processing, Regular Expressions, Exception Handling, etc. You should be familiar with Python libraries such as Pandas, Scikit-Learn, Numpy, NLTK, Scipy, Requests, etc. Your role will involve Data Modelling and Data Transformation, Data Processing on Structured and Unstructured data, as well as working with Relational Databases. Query Optimization, Query building, and experience with ORMs like SQLAlchemy will be part of your responsibilities. Exposure to databases like MSSQL, Postgres, Oracle, etc. will be beneficial. Key Responsibilities: - Strong experience in Python - Proficiency in Python libraries like Pandas, Scikit-Learn, Numpy, NLTK, Scipy, Requests, etc. Qualifications Required: - Functional and Object Oriented Programming (OOPS) - Familiarity with Web services technologies (HTTP, SOAP, REST, XML, JSON) - Knowledge of AWS cloud services: EC2, S3, Batch, ECS, Secret Manager, EMR, etc. The company offers an opportunity to work on bleeding-edge projects, collaborate with a highly motivated and dedicated team, competitive salary, flexible schedule, benefits package including medical insurance, sports, corporate social events, professional development opportunities, and a well-equipped office. Please Note: The above qualifications and responsibilities are indicative and may be subject to change or modification based on business requirements.,

Role Overview: As a Big Data Engineer at Micron Technology, you will play a crucial role in transforming information into intelligence, inspiring advancements in learning, communication, and innovation. Your responsibilities will include developing ETL/ELT processes, building APIs for application integration, determining transformation requirements, collaborating with Data Scientists, and optimizing the performance of big data and machine learning systems. Key Responsibilities: - Understanding of Big Data Engineering/processing, Business Intelligence, and Advanced analytics - Developing ETL/ELT processes - Knowledge in databases and Data warehouse modeling - Knowledge in Cloud-based data engineering and Machine Learning Models - Knowledge in building APIs for application integration - Experience with Agile frameworks and processes - Determining transformation requirements and developing processes to bring structured and unstructured data to a new physical Data Model - Collaborating with Data Scientists to implement data cleaning strategies, develop data imputation algorithms, and optimize the performance of big data and machine learning systems Qualifications Required: - Above-average skills in Big Data Engineering and Processing using Hadoop stack (Hadoop, Hive, HDFS, Spark, and HBase etc.) - Developing ETL/ELT processing using Apache Ni-Fi - Strong background in SQL and databases - Programming skills in Python or Scala - Data analysis and validation skills Micron Technology, Inc. is an industry leader in innovative memory and storage solutions, delivering high-performance DRAM, NAND, and NOR memory and storage products through its Micron and Crucial brands. The company focuses on customer satisfaction, technology leadership, and operational excellence to fuel the data economy, enabling advancements in artificial intelligence and 5G applications. If you are excited about leveraging your skills in Big Data Engineering and Processing to drive innovation and transformation, Micron Technology could be the perfect place for you to grow and contribute to groundbreaking developments in the industry.,

As a Senior Data Engineer at Enable Data Incorporated, you will be a key player in designing, developing, and maintaining scalable and efficient data solutions in the cloud. Leveraging your expertise in cloud technologies, Spark, and Databricks, you will collaborate with cross-functional teams to gather data requirements, design and implement data processing pipelines, and ensure data quality and integrity. Your role will involve optimizing data infrastructure for clients and providing advanced analytics insights. If you are passionate about using cutting-edge technologies to solve complex data challenges, this is the perfect opportunity for you. **Key Responsibilities:** - Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. - Gather and analyze data requirements from business stakeholders to identify data-driven insights. - Build and optimize data pipelines for ingestion, processing, and integration using Spark and Databricks. - Ensure data quality, integrity, and security throughout the data lifecycle. - Collaborate with teams to design and implement data models, schemas, and storage solutions. - Optimize data processing and analytics performance by tuning Spark jobs and leveraging Databricks features. - Provide technical guidance to junior data engineers and developers. - Stay updated with emerging trends in cloud computing, big data, and data engineering. **Qualifications Required:** - Bachelor's or Master's degree in computer science, engineering, or related field. - 10+ years of experience in Data Engineering or similar roles focusing on cloud-based data solutions. - Strong expertise in cloud platforms like Azure or AWS. - Proficiency in Apache Spark and Databricks for large-scale data processing. - Experience in data processing pipelines design and implementation. - Knowledge of SQL, relational, and NoSQL databases. - Experience with data integration, ETL processes, and tools like Apache Airflow. - Understanding of data modeling, schema design, governance, and compliance. - Excellent problem-solving, communication, and collaboration skills. - Relevant certifications in cloud platforms, Spark, or Databricks are a plus.,