NOVARTIS - Date Engineer
Benchmark Engineering & Surveying LLC
အလုပ်တည်နေရာ
Madhavaram, Telangana
အလုပ်ခေါ်စာအသေးစိတ်
Client : Altimetrik
Project : Novartis ( PHARMA - gaint)
Work Module : Hybrid ( Altimetrik office )
Look for Immediate Joiners ( Only Immediate Joiner Need)
Open Positions
• Data Engineer Lead
• Data Engineer
• Sr. Data Engineer
• Data Architect + data modeler
• AWS Data Solutions Architect
Data engineer(Junior/Senior/Lead)
Experience – 5-10 years
• Ensuring proper execution of Team's duties and alignment with business vision and objectives
• Works closely with the business’s Data and Analytics teams and gathering technical requirements
• Experience in building and maintaining reliable and scalable ETL pipeline on big data/Cloud platform through the collection, storage, processing, and transformation of large data-sets
• Experience working with varied forms of data infrastructure inclusive of relational databases such as SQL, Hadoop, Spark
• Proficiency in scripting languages in python, pyspark
• Experience in Database design/data modeling.
• Must have strong experience in data warehouse concepts.
• Experience in AWS cloud
• Experience in Data bricks(not mandatory)
Notice period: 0-20 days
AWS Big Data Solution Architect
Roles & Responsibilities
• Taking leadership in the design and setup of the cloud/big data platform by...
• Provide top-quality solution design and execution and providing support in defining the scope and sizing of work.
• Utilize Big Data technologies to design, develop, and evolve scalable and fault-tolerant distributed components.
• Responsible for translating business requirements into big data technology solutions.
• Support for daily business activities on current and future platform to ensure all systems meet the business/client requirements.
• Design and implement end to end BI solutions such as data modelling, data loading and data governance on current and future platform.
• Integrate up-and-coming data management and software engineering technologies into existing data structures as a part of innovation of current platform.
• Support/enhance the overall improvement of our existing DWH&BI product.
• Improve documentation, quality, testing and operational standards
Skills Preferred
• 12-15+ years of overall IT experience with Cloud/ Big Data, Analytics, Data Warehousing and Business Intelligence.
• Linux expertise, experience in the set-up and administration of Apache Big Data platform & Cloud-Platform ( AWS (preferred), Azure or GCP)
• Having worked in AWS Cloud Data infrastructure environment is required.
• Good working knowledge of tools in the Cloud Ecosystem and Apache Big Data ecosystem like Databricks, Spark, Hive, HBase, Sqoop, Impala, Kafka, Flume, Oozie, MapReduce, etc.
• Understand (scripting) languages such as Scala, Python, or Shell Scripting, etc.
• Practical knowledge of end-to-end design and build process of Near-Real Time and Batch Data Pipelines
• Proficient with Apache Big Data/Hadoop ecosystem & Airflow Job Orchestration and architecture components
• Expertise with SQL and Data modeling working in Agile development process.
• Able to work with highly diverse data in multiple types and formats, and sources.
• Able to work with minimal supervision, and work in a team-oriented environment with people of diverse skill sets.
• Able to interact with business/technical users as needed; to gather Application Know-how necessary for design and development using Spark, Spark streaming, Kafka, and/or other Apache Big Data stack tools.
• Soft skills: good team spirit/team player and good communication skills
• * Experience with at least one Data Engineering Pipeline tool (e.g., Databricks Data Integration, Matillion, EMR Jobs, Informatica, Datastage), Data Quality Framework and Automation
Data Modeler
• * 8+ years of experience working as a data architect/data modeler in large, multi-national business environments
• * Hands-on experience in Data Architectural/Data Modelling, Metadata management
• * Good to have experience in the life-sciences or pharmaceutical industry
• * Deep knowledge in data modelling for EDW and Data lake projects
• concepts.
• * An asset to have strong knowledge of Semantic Data Modeling
• * Excellent background of working with multiple databases – relational, dimensional, graph, unstructured/file based etc.
• * Strong application design, development skills and data analysis skills.
• * Excellent communication skills with a strong emphasis on conceptualizing and designing architectures
• * Experience working in diverse multicultural environment
