Senior Data Engineer/Architect (Analytics & Data Science)
Location: Greater Boston, MA
Job Type: Analytics
IQ Workforce provides talent services for the analytics and data science community.
Our client is an industry leader in technology products and solutions. They are public company with over 15,000 employees and over $5 Billion in revenue last year.
We are working directly with their Head of Analytics in their Marketing and Sales COE to hire a Senior Data Engineer/Architect. This is a new role where the client is looking for an experienced data engineer with hands on skills and knowledge of data architecture to lead on the design and implementation of their new data infrastructure to meet the current and future needs of the business. This will include vendor selection, strategy and implementation.
Once the new data infrastructure is fully implemented and operational, the Sr. DE/ Architect will oversee the data infrastructure and data integration of digital intelligence and design the data models to enable their analytics programs and achieve profitable revenue growth. This Sr. Engineer will also set the process and standards of data collection, storage, usage, and ETL in collaboration with IT, analysts, and program managers.
Understand business requirements. Design and control the data flow to meet business requirements
Set data architecture principles, create models of data that enable the implementation of the intended business architecture
Bringing data fragments into the database from different sources across the company
Develop data map and data dictionary to help users to leverage and interpret the data
Mentor data engineers in design and development of complex ETL
Develop training plans and documents, and provide trainings on database, ETL, processes, and standards to different audiences and user groups
Collaborate with IT and consulting firms to plan and execute the implementation of a data lake to integrate data from different online/offline sources and channels for data mining
Manage and maintain the data infrastructure
Experience integrating third party APIs & Web services and solid programming background
Experience working with relational or OLAP database: Oracle, SQL Server, DB2 etc
Scripting/Programming skills – Python, Java, Scala, Go, etc
Knowledge and experience with ETL tools: Informatica, MSBI (SSIS), Datastage, SAP Data Integrator, etc
Solid knowledge in data modeling experience. Experience with data modeling tools like Power designer, ERWIN, etc
Familiarity with No SQL databases (i.e. MongoDB, Hadoop, Hive Spark, etc.), data streaming and integrating unstructured data will be plus
Familiar with Qlikview data models. 1+ years of experience in working with and developing datasets for Qlikview developers preferred
Experience Architecting Big Data platforms using Apache Hadoop, Cloudera, Hortonworks and MapR distributions will be plus
Experienced in Hadoop Ecosystem e.g. Data lifecycle, governance, tools, various type of data access e.g. Batch, Script, SQL, stream, in-mem etc, security and operations. MapReduce, HBase, Hive, Impala, Oozie, Zookeeper will be plus
Experience designing and architecting data solution in AWS, Azure or Google Cloud will be plus
Experience with statistic software and programming language, such as SAS and R will be plus
Must be eager to learn new tools and technologies
Experience working in a team of programmers as data scientists
Strong communication skills