{"id":433,"date":"2020-12-05T06:47:02","date_gmt":"2020-12-05T06:47:02","guid":{"rendered":"https:\/\/www.rezilyens.com\/?post_type=current_openings&#038;p=433"},"modified":"2020-12-05T06:47:19","modified_gmt":"2020-12-05T06:47:19","slug":"principal-big-data-software-engineer","status":"publish","type":"current_openings","link":"https:\/\/www.rezilyens.com\/current_openings\/principal-big-data-software-engineer\/","title":{"rendered":"Principal Big Data Software Engineer"},"content":{"rendered":"<strong>The role<\/strong>\r\n\r\nThe individual filling the position will also define data requirements, develop mechanisms to gather and mine structured and unstructured data and will apply modeling and visualization techniques using related Big Data Programming Languages &amp; Technologies such as EMR, Hadoop, Map Reduce, NoSQL, Azure, AWS Cloud Tool Stack, DataBricks, Snowflake, Apache Spark, Flume, Kafka, PySpark, Python, Java and other distributed environment technologies.\r\n\r\n<strong>Your responsibilities<\/strong>\r\n<ul>\r\n \t<li>Exercises technical leadership to define and drive the evolving architecture of the entire solution, and is accountable for the success of the customer solutions<\/li>\r\n \t<li>Works closely with the business and cross-functional architects to ensure that individual program and product strategies align with business needs<\/li>\r\n \t<li>Design and implement a highly scalable system for data pipeline and data management: -Data discovery: Define data requirements, explore and assess suitable data sources -Data migration: Create Extract Transform Load pipelines to collect and mine large scales of structured and unstructured data for data processing<\/li>\r\n \t<li>Data Cleansing: Perform initial data quality checks on raw &amp; extracted data by running various data tools in the big data environment<\/li>\r\n \t<li>Data Transformation and Integration: Extract data from identified databases, process through ELT pipelines, and curate data to a structure that is relevant to the problem by selecting appropriate techniques<\/li>\r\n \t<li>Data Modelling: Conceptualize, design and develop logical and physical data models through analysis of complex data elements, systems, data flows, dependencies, and relationships -Develop and maintain data engineering best practices and contribute to insights on data analytics and visualization concepts, methods and techniques<\/li>\r\n \t<li>Present and review project technical objectives, status and learnings with senior leadership and develop mutually beneficial strategic alliances with customers<\/li>\r\n \t<li>Actively mentor junior members of engineering staff by openly sharing experience, perspective, and holding routine code review<\/li>\r\n<\/ul>\r\n<strong>The must-have skill sets<\/strong>\r\n<ul>\r\n \t<li>\u00a06+ years of experience related, relevant IT experience in the field of Big Data Distributed Technologies: EMR, Hadoop, Map Reduce, NoSQL, Azure, AWS Cloud Tool Stack, Event Hub, DataBricks, Snowflake<\/li>\r\n \t<li>Have strong technical knowledge in streaming technologies: Apache SPARK, Flume, Kafka<\/li>\r\n \t<li>Expert in programming languages: Python, Java, pySpark, Hive, Scalding, Cascalog, PyCascading<\/li>\r\n \t<li>Proficient in Azure \/AWS cloud tool stack using Blob, ADLS Gen2, Lambda, QuickSight, Azure ML<\/li>\r\n \t<li>Have strong experience designing, implementing, and integrating REST or GraphQL APIs<\/li>\r\n \t<li>\u00a0Have strong technical knowledge of 1 or more database technologies (MongoDB, Neo4j, PostgreSQL, etc) and maintain proficient knowledge of data structures.<\/li>\r\n \t<li>\u00a0Have experience deploying applications using Azure or AWS cloud providers and understanding key application metrics (e.g.; performance, security, etc.)<\/li>\r\n \t<li>\u00a0Have strong technical experience in data migrations, data cleansing, transformation, export, import<\/li>\r\n \t<li>\u00a0Have Broad experience in data modeling concepts \u2022 Expert in Extract Load Transform (ELT) pipelines, data mining, data warehouse and data store concepts<\/li>\r\n \t<li>\u00a0Able to apply principles of logical or scientific thinking to a wide range of intellectual and practical problems and work well in group problem solving situations<\/li>\r\n \t<li>\u00a0Proficient in communicating technical findings to non-technical stakeholders<\/li>\r\n \t<li>\u00a0Thrive in a fast-paced environment<\/li>\r\n \t<li>\u00a0Have pragmatic problem-solving skills, which enable you to navigate ambiguous or loosely defined requirements<\/li>\r\n \t<li>\u00a0Demonstrated an ability to drive adoption of technology recommendations which then have a direct measurable impact.<\/li>\r\n \t<li>\u00a0Able to define the software implementation strategy and visualize, architect, and implement high performing software solutions to meet business goals<\/li>\r\n<\/ul>\r\n<strong>Equal employment opportunity<\/strong>\r\n\r\nRezilyens is an equal opportunity employer and is dedicated to fostering an inclusive and diverse environment for employees from all walks of life. We hire based on talent and we\u2019re proud of our global perspective.<!-- AddThis Advanced Settings generic via filter on the_content --><!-- AddThis Share Buttons generic via filter on the_content -->","protected":false},"excerpt":{"rendered":"The role The individual filling the position will also define data requirements, develop mechanisms to gather and mine structured and unstructured data and will apply modeling and visualization techniques using related Big Data Programming Languages &amp; Technologies such as EMR, Hadoop, Map Reduce, NoSQL, Azure, AWS Cloud Tool Stack, DataBricks, Snowflake, Apache Spark, Flume, Kafka, [&hellip;]<!-- AddThis Advanced Settings generic via filter on get_the_excerpt --><!-- AddThis Share Buttons generic via filter on get_the_excerpt -->","protected":false},"featured_media":0,"parent":0,"template":"","meta":[],"currentopeningscategory":[9],"_links":{"self":[{"href":"https:\/\/www.rezilyens.com\/wp-json\/wp\/v2\/current_openings\/433"}],"collection":[{"href":"https:\/\/www.rezilyens.com\/wp-json\/wp\/v2\/current_openings"}],"about":[{"href":"https:\/\/www.rezilyens.com\/wp-json\/wp\/v2\/types\/current_openings"}],"wp:attachment":[{"href":"https:\/\/www.rezilyens.com\/wp-json\/wp\/v2\/media?parent=433"}],"wp:term":[{"taxonomy":"currentopeningscategory","embeddable":true,"href":"https:\/\/www.rezilyens.com\/wp-json\/wp\/v2\/currentopeningscategory?post=433"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}