Sr. Data Engineer
Machine Learning Engineer

Solutions Architect - Big Data Consulting

Full Time Minnesota Big Data Job


Are you inspired by innovation, hard work and a passion for data?   

If so, this may be the ideal opportunity to leverage your background in Big Data and Software Engineering, Data Engineering or Data Analytics experience to design, develop and innovate big data solutions for a diverse set of clients. 

At phData, our proven success has skyrocketed the demand for our services, resulting in quality growth and an expanded presence at our company headquarters conveniently located in Downtown Minneapolis (Fueled Collective).

As the world’s largest pure-play Big Data services firm, our team includes Apache committers, Spark experts and the most knowledgeable Scala development team in the industry. phData has earned the trust of customers by demonstrating our mastery of Hadoop services and our commitment to excellence.

In addition to a phenomenal growth and learning opportunity, we offer competitive compensation and excellent perks including base salary, annual bonus, extensive training, paid Cloudera certifications - in addition to generous PTO and employee equity.

As a Solution Architect on our Consulting Services Team, your responsibilities will include:

  • Design, develop, and innovative Hadoop solutions; partner with our internal Infrastructure Architects and Data Engineers to build creative solutions to tough big data problems. 
  • Determine the project road map, select the best tools, assign tasks and priorities, and assume general project management oversight for performance, data integration, ecosystem integration, and security of big data solutions
  • Work across a broad range of technologies – from infrastructure to applications – to ensure the ideal Hadoop solution is implemented and optimized
  • Integrate data from a variety of data sources (data warehouse, data marts) utilizing on-prem or cloud-based data structures (AWS); determine new and existing data sources
  • Design and implement streaming, data lake, and analytics big data solutions

  • Create and direct testing strategies including unit, integration, and full end-to-end tests of data pipelines

  • Select the right storage solution for a project - comparing Kudu, HBase, HDFS, and relational databases based on their strengths

  • Utilize ETL processes to build data repositories; integrate data into Hadoop data lake using Sqoop (batch ingest), Kafka (streaming), Spark, Hive or Impala (transformation)

  • Partner with our Managed Services team to design and install on prem or cloud based infrastructure including networking, virtual machines, containers, and software

  • Determine and select best tools to ensure optimized data performance; perform Data Analysis utilizing Spark, Hive, and Impala

  • Mentor and coach Developers and Data Engineers. Provide guidance with project creation, application structure, automation, code style, testing, and code reviews


  • 5+ years previous experience as a Software Engineer, Data Engineer or Data Analytics

  • Expertise in core Hadoop technologies including HDFS, Hive and YARN. 

  • Deep experience in one or more ecosystem products/languages such as HBase, Spark, Impala, Solr, Kudu, etc

  • Expert programming experience in Java, Scala, or other statically typed programming language

  • Ability to learn new technologies in a quickly changing field

  • Strong working knowledge of SQL and the ability to write, debug, and optimize distributed SQL queries

  • Excellent communication skills including proven experience working with key stakeholders and customers

  • Ability to translate “big picture” business requirements and use cases into a Hadoop solution, including ingestion of many data sources, ETL processing, data access and consumption, as well as custom analytics

  • Experience scoping activities on large scale, complex technology infrastructure projects

  • Customer relationship management including project escalations, and participating in executive steering meetings


If yes, you can apply directly at Livefront Careers or send me a note at and include any of the following and I will do an introduction for you: summary, resume, links to LinkedIn or GitHub.

If not, click => “Say Hello” and introduce yourself to me and we can talk about what you are looking for.


The comments to this entry are closed.