Data bricks Architect
Job Title Data bricks ArchitectRelevant Experience (in Yrs) 8
YrsTechnical/Functional Skills Data Bricks EngineerExperience Required o 8
to 12 years of experience in Development, design, Architect implementation, and analytics solutions o 8
Years of Experience on Data Bricks o Hands on development Design and Develop applications using Databrickso Data Bricks Architecture experience is added advantage.
o 8
Years of Experience on AWSo From an AWS perspective, candidates need to be very well versed with Glue, Lambda, S3,EC2Rout53,Airflow and their usage and practical issues faced when dealing with them.
o At least 8
Experience on AWS (Glue, S3, lambda at the minimum)o Candidates need to have knowledge in Python core programming and Spark.
o Ability to design and demonstrate system Architecture with different environmentso Hands on experience on Data Warehousing and SQLo Experience on Pandaso Strong expertise in SQL is required.
o Solid experience with git software version control and goodunderstanding of code branching strategies and organization for code reuseo Very Strong Data Bricks Architecture/Development knowledgeo Experience with DevOps & CI/CD tools - Jenkins, Cloudbees, Please Build, etc.
o Proficiency working with large data stores and data setso Health care knowledge is preferred.
o Agile methodology (Jira Preferable)Roles & Responsibilities o Must have capability to understand the current Architecture o Coding, testing and implementation of cloud-based Data bricks appso support existing code thru enhancing, trouble shooting and maintaining per requirementso Support on Databricks migrationo Support to understand current ETL process Python or Scalao maintain consistent practices for source code management in githubo comply with established CICD practices, and participate in the creation of new CICD methodso attend daily scrum calls, and actively participate in updating/creating user stories and tasks in Jirao Work closely with business analysts.
o Lead innovation by exploring, investigating, recommending, benchmarking, and implementing data centric technologies for the platform.
o Collaborating within a project team to solve complex problems.
o Lead by example coaching and mentoring those of your peers and mentoring less experienced team members.
Operate as part of the extended management team.
o To be able to benchmark systems, analyse system bottlenecks and propose solutions to eliminate them;o To be able to clearly articulate pros and cons of various technologies and platforms;o To be able to document use cases, solutions and recommendations;o To be able to explain the work in plain language;o To be able to help program and project managers in the design, planning and governance of implementing projects of any kind;o To be able to perform detailed analysis of business problems and technical environments and use this in designing the solution;o To be able to work creatively and analytically in a problem-solving environment;o To be a self-starter;o To be able to work in teams, as a big data environment is developed in a team of employees with different disciplines;o To be able to work in a fast-paced agile development environment.
Recommended Skills Agile Methodology Apache Spark Architecture Benchmarking Big Data Cloudbees Estimated Salary: $20 to $28 per hour based on qualifications.
YrsTechnical/Functional Skills Data Bricks EngineerExperience Required o 8
to 12 years of experience in Development, design, Architect implementation, and analytics solutions o 8
Years of Experience on Data Bricks o Hands on development Design and Develop applications using Databrickso Data Bricks Architecture experience is added advantage.
o 8
Years of Experience on AWSo From an AWS perspective, candidates need to be very well versed with Glue, Lambda, S3,EC2Rout53,Airflow and their usage and practical issues faced when dealing with them.
o At least 8
Experience on AWS (Glue, S3, lambda at the minimum)o Candidates need to have knowledge in Python core programming and Spark.
o Ability to design and demonstrate system Architecture with different environmentso Hands on experience on Data Warehousing and SQLo Experience on Pandaso Strong expertise in SQL is required.
o Solid experience with git software version control and goodunderstanding of code branching strategies and organization for code reuseo Very Strong Data Bricks Architecture/Development knowledgeo Experience with DevOps & CI/CD tools - Jenkins, Cloudbees, Please Build, etc.
o Proficiency working with large data stores and data setso Health care knowledge is preferred.
o Agile methodology (Jira Preferable)Roles & Responsibilities o Must have capability to understand the current Architecture o Coding, testing and implementation of cloud-based Data bricks appso support existing code thru enhancing, trouble shooting and maintaining per requirementso Support on Databricks migrationo Support to understand current ETL process Python or Scalao maintain consistent practices for source code management in githubo comply with established CICD practices, and participate in the creation of new CICD methodso attend daily scrum calls, and actively participate in updating/creating user stories and tasks in Jirao Work closely with business analysts.
o Lead innovation by exploring, investigating, recommending, benchmarking, and implementing data centric technologies for the platform.
o Collaborating within a project team to solve complex problems.
o Lead by example coaching and mentoring those of your peers and mentoring less experienced team members.
Operate as part of the extended management team.
o To be able to benchmark systems, analyse system bottlenecks and propose solutions to eliminate them;o To be able to clearly articulate pros and cons of various technologies and platforms;o To be able to document use cases, solutions and recommendations;o To be able to explain the work in plain language;o To be able to help program and project managers in the design, planning and governance of implementing projects of any kind;o To be able to perform detailed analysis of business problems and technical environments and use this in designing the solution;o To be able to work creatively and analytically in a problem-solving environment;o To be a self-starter;o To be able to work in teams, as a big data environment is developed in a team of employees with different disciplines;o To be able to work in a fast-paced agile development environment.
Recommended Skills Agile Methodology Apache Spark Architecture Benchmarking Big Data Cloudbees Estimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
