Walmart Big Data / Cloud Solutions Architect in APEX, North Carolina

1002098BRReq ID:1002098BRCompany Summary:Walmart Global eCommerce is comprised of, VUDU,, and our technical powerhouse @WalmartLabs. Here, innovators incubate next gen e-commerce solutions in real-time. We integrate online, physical, and mobile shopping experiences for billions of customers around the globe. How do we do it? We continuously build and invest in new technology including open source tools and big data innovations. Data scientists, front and back-end engineers, product managers, and web and UX/UI teams collaborate alongside e-commerce experts to envision, prototype, and bring revolutionary ideas to life in a dynamic, flexible and fun work culture.Job Title:Big Data / Cloud Solutions ArchitectPosition Summary:The WalmartLabs Big Data Platforms team is seeking a big data/cloud solutions technical architect to serve in a consulting role for the big data components of Walmart’s major application and project initiatives. We’re looking for an architect that has extensive experience building big data applications using the Hadoop ecosystem and related technologies, both on traditional clusters and cloud platforms, to collaborate with our internal product development teams constructing scalable and performant big data applications using cloud-based infrastructure.

Responsibilities include:

  • Collaborating closely with application team architects and engineers to identify technologies and platforms suitable for their big data processing requirements, and then assisting those teams with onboarding, development, deployment, and debugging on those platforms

  • Investigating new big data tools and technologies for their potential application to common use cases; establishing best practices, developing design patterns, and writing documentation to disseminate new capabilities to a broad technical audience; working with platform engineers and product managers to specify and deliver new major technology features

  • Providing technical assistance to a broad community of big data infrastructure users, such as software application engineers and data scientists, through research, investigation, collaboration, and hands-on debugging, often driven by specific use case requirements

  • Ensuring that application big data solutions adhere to best practices and enterprise standards for scalability, availability, efficiency, data lifecycle management, information security, fault tolerance, and disaster recoveryCity:APEXState:NCPosition Description:

  • Assists in the development of engineers and architects

  • Demonstrates and proves hardware or software technology concepts to other architects and management

  • Develops and implements product development strategies using Agile development processes

  • Drives the execution of multiple business plans and projects

  • Ensures business needs are being met

  • Identifies and implements strategies for service enabled technologies (for example, service oriented architecture)

  • Improves the hardware or software technology environment

  • Leads the creation and implementation of hardware or software technology solutions for the division

  • Oversees the development of conceptual, logical, or physical hardware or software designs

  • Promotes and supports company policies, procedures, mission, values, and standards of ethics and integrity

  • Provides supervision and development opportunities for associates

Minimum Qualifications:* Experience with software design process considerations throughout stages including requirements, architecture, design, development, quality assurance, deployment, and maintenance

  • Familiarity with big data concepts, Hadoop ecosystem components, and complimentary technologies such as HDFS, Hive, Spark, HBase, Oozie, and Kafka; as well as cloud technologies such as block storage, object storage, computational infrastructure services, and higher-level database services

  • Experience with scripting in languages such as Python, bash, Perl; or software development in Java or Scala

  • Familiarity with the differences between traditional Hadoop clusters and cloud-native Hadoop platformsAdditional Preferred Qualifications:* Hands-on experience with writing, debugging, and optimizing big data processing applications using Hadoop Streaming, Hive or Spark; ODBC/JDBC connectivity such as HiveServer and Thrift; and streaming data management using Kafka

  • Familiarity with the strengths, weaknesses, and idiosyncrasies of big data solutions of cluster-based platforms (e.g., Hortonworks, Cloudera, and MapR) as compared to as cloud resource providers (e.g., Google Cloud Platform, Microsoft Azure, and similar object storage and ephemeral compute paradigms)

  • Experience building and nurturing long-term technical advisory and consulting relationships with software engineering teams

  • Demonstrable proficiency with Linux tools at a shell command line, a basic understanding of the Java build processes used to compile and package Hadoop, and a justifiable preference between one of the following: vim/emacs, bash/fish, or screen/tmuxCategory:Software Development and Engineering Division:Walmart LabsDivision Summary:@WalmartLabs is the technical powerhouse behind Walmart Global eCommerce. We employ big data at scale -- from machine learning, data mining and optimization algorithms, to modeling and analyzing massive flows of data from online, social, mobile and offline commerce. We don’t just engineer cool websites, mobile apps, and new services; we use our own open source tools to create the framework. Deployment is automated and accelerated through our open cloud platform. This makes us incredibly nimble and able to adjust in real-time to our global customers.Employment Type:Full TimeRequisition Template:eCommerce