Roles and Responsibilities

AWS Data Architect

Location: South Africa (Onsite)

Primary Responsibilities

• Managing projects / processes
• Ability to develop within a specific sought-after programming language
• Strong working knowledge with software development tools, techniques and approaches used to build application solutions
• Working knowledge with software development tools, techniques and approaches used to build application solutions
• Cloud computing technologies, Business drivers and emerging computing trends.
• Should be able to work independently and within team.
• Good written and oral communication skills.
• Experience working in Telecom / Banking Domain
• Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark.
• Experience with building data pipelines and applications to stream and process datasets at low latencies.
• Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.
• Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning of high-level data structures.
• Experience designing and supporting large-scale distributed systems in a production environment

Desired Candidate Profile

Technical Skills

• Specialties: Core Java, Spring, JMS, Hibernate, Java Script, React, HTML, CSS, JSP, XML, Webservices (REST), Junit,Unix, Spring Boot, Microservices, CI/CD, GitHub, Jira, Jenkins.
• AWS (S3, EC2, Lambda, Redshift), Financial Risk domain knowledge.
• Good scripting knowledge (python / shell / Perl)
• Strong Working knowledge with database technology such as MySQL, Oracle, and MongoDB.
• Working knowledge on JavaScript frameworks such as Angular JS, React, and Amber.
• Design and construction of our REST API
• Should have strong experience in data engineering tools such as Amazon Redshift, Big Query.
• Should have strong working Experience open-source technology for data engineering such as Apache Spark, Airflow and stitch.
• Strong working Experience Apache Kafka for real time streaming data pipelines and applications.
• Good Working Knowledge on Hadoop cluster.
• Strong programming language in Python.
• Strong working experience on data models, data mining, and segmentation techniques.