Big Data Platform Engineer
- Security, aerospace & defence
Are you ready to take the next step in your career?
Apply for this roleThis vacancy has now expired. Please see similar roles below...
Atkins has recently defined a “One Atkins 2020” Organisational strategy. To support this strategy, Atkins Group IS (GrIS) has defined an operating model for 2020 to revolutionise the way information services are provided to the organisation, moving from a BAU focus to a Business Value driven organisation. Key concepts include: moving to digital products, adopting agile across the organisation, leveraging cloud, and focusing on supporting bid and delivery.
Atkins Digital Services (ADS) operates within GrIS with a mission acquire, design, develop & deploy digital products that will add value to the business by enabling us to: win work at higher margins, deliver work more efficiently and at lower cost, develop new revenue streams, collaborate & share knowledge more effectively, manage our business and support our people. Supporting ADS is a global development team that delivers applications to both the business and clients.
Job Details
Atkins Digital Services (ADS) is looking to expand its capability by hiring Big Data Platform Engineer the new role will be part of a multi-disciplinary team that is responsible for new development, feature additions, maintenance and support of a number of key components of Big Data products and Platforms. The data platform will be cloud based, multitenanted and will support several analytical applications ranging from descriptive to predictive and cognitive.
The Big Data Platform Engineer will be responsible for management and administration of all Big data and distributed computing platforms in Atkins Global.
Working collaboratively with ADS colleagues and the wider Group IS team, you will bring creativity, technical knowledge and platform engineering experience that will support the development of new data products,
Key Deliverables/Responsibilities
• Ownership and accountability of the management and administration of the Big Data Platform.
• Manage and own the system upgrade and platform security on the Big data platform
• Plan, Manage and perform platform upgrades, connected ecosystem product upgrade as per roadmap; ensure alignment the new versions made available in open source and technology partner communities.
• Ownership and accountability of designing and implementing proactive capacity management
• Ownership of build, configuration, administration and management of Big data platforms and technologies.
• Ensures all components of the Big data service as a whole (and Hadoop with all ecosystem components in particular) is running normally and to SLA’s
• Troubleshoot cluster & ecosystem product issues as a priority with expertise & lead through to resolution working to SLA’s as defined within the Operational environment
• Troubleshoot network and infrastructure issues with expertise & lead through to resolution working to SLA’s as defined within the Operational environment
• Impact assessment of changes to the platform due to key projects.
• Define and build lightweight (low-overhead) monitoring system characteristics, in real time, and tools for correlating and analysing those statistics for the Big Data infrastructure to ensure good health of the infrastructure.
• Produce and manage advance workload characterization, benchmarks and metrics
• Instil a service mind-set and apply a strong focus on business continuity, Troubleshooting to ensure a good service
• First level go-to person for technical guidance, expertise support to consumer questions on operating services on the platform
• Serve as second level support to Big data operations for infrastructure and component services
• Work with engineering support on upgrades of the cluster participating in the installation, configuration and administration of multi-node Big data platforms
• Implementing new services to agreed SLA’s and ensuring transition to support or standardise services to Global services
•
Experience Required
Essential
• 3-4 years of experience building and managing complex end to end products/solutions with a strong background in IT infrastructure(Cloud Native), large scale enterprise business systems & distributed systems
• Experience developing solutions in cloud (Azure/AWS).
• 3+ years expert hands on experience working with Linux/Unix environment
• 1 year experience in Containerisation technologies like Docker, kubernetes.
• 1-2 yrs experience in managing Hadoop or any other distributed computing platforms/clusters with hundreds of servers
• Experience with running components in Hadoop eco system (Hive, Pig, Ambari, Oozie, Sqoop, Zookeeper, Mahout, Hadoop HDFS, YARN and MapReduce framework internals) and experience of hands on Java or Python.
• Experience building and managing NoSQL Database like HBase.
• Experience with managing security models for Big data platforms (Kerberos, Knox etc.)
• Demonstrable experience in working in a cloud environment
• Have in-depth knowledge of and hands on experience with a majority of the following:
- Distributed File Systems, cluster and parallel computer architectures
- Hadoop distributions (preferably Hortonworks), Map Reduce & Yarn
- Databases (MS SQL, MySQL etc)
- Server Operating systems internals, benchmarking and performance tuning (Linux)
- Multiple technologies including Java, C/C++, Unix Platforms and large scale implementations of programming theories/concepts with proven results.
• Ability to work occasional weekends and varied schedule (e.g. during go-live).
Desirable
· Contribution to industry/open source communities.
· Experience of working within a multi-cultural, global environment.
· Experience of working in a fast moving and changing large enterprise IT environment.
Are you ready to take the next step in your career?
Apply for this rolePreview
Middle EastContent type
BlogsPublish date
04/18/2024
Summary
In the vast expanse of the Saudi Arabian landscape, you’ll find a beacon of innovation, a vision for a better, greener tomorrow. NEOM sits in the heart of the Tabuk province and isn’t just anothe
Preview
Middle EastContent type
BlogsPublish date
04/18/2024
Summary
In the vast expanse of the Saudi Arabian landscape, you’ll find a beacon of innovation, a vision for a better, greener tomorrow. NEOM sits in the heart of the Tabuk province and isn’t just anothe
Related job roles
Salary
Location
Derby
Job Type
Full Time
Career Area
Engineering (Other)
Market
Transportation
Category
Permanent
Location
Derby
Description
Are you ready to take up a vital role in shaping some of our exciting projects? How about joining our talented team, where everyone has a voice, and together we face our clients' problems head-on. It'
Reference
R-113550
Expiry Date
01/01/0001
Author
Abhishek SahaAuthor
Abhishek SahaSalary
Location
Raleigh
Job Type
Full Time
Career Area
Union
Category
Permanent
Location
Raleigh
Description
JOIN US!Role: BuyerLocation: Raleigh, NCJob Overview Linxon is seeking a proactive and detail-oriented Buyer to join our team in Raleigh, NC. The Buyer will play a critical role in supporting the exec
Reference
R-114024
Expiry Date
01/01/0001
Salary
Location
Bangalore
Job Type
Full Time
Career Area
Civil engineering
Category
Permanent
Location
Bangalore
Description
We’re AtkinsRéalis, a world-leading Design, Engineering and Project Management organization. Created by the integration of long-standing organizations dating back to 1911, we are a world-leading profe
Reference
R-112967
Expiry Date
01/01/0001
Salary
Location
Cairo
Job Type
Full Time
Career Area
Civil engineering
Category
Permanent
Location
Cairo
Description
AtkinsRéalis is the trading name of SNC-Lavalin Group Inc., a Canadian company based in Montreal that provides engineering, procurement, and construction Management (EPCM) services to various industri
Reference
R-108756
Expiry Date
01/01/0001
Salary
Location
Epsom
Job Type
Part Time
Career Area
Civil engineering
Market
Nuclear
Category
Permanent
Location
Epsom
Description
Your purpose:Are you a principal (associate) civil or structural engineer or consultant who can apply their expertise in leading our people, our business and projects? Are you a technical or subject
Reference
R-113969
Expiry Date
01/01/0001
Author
Shaik Mohammed Touheed AhmedAuthor
Shaik Mohammed Touheed AhmedSalary
Location
Epsom
Job Type
Part Time
Career Area
Civil engineering
Market
Nuclear
Category
Permanent
Location
Epsom
Description
Your purpose:Part-time opportunities like this don’t come along very often.Are you an experienced and innovative senior civil or structural engineer, who’s built deep technical experience in highly re
Reference
R-113968
Expiry Date
01/01/0001
Author
Shaik Mohammed Touheed AhmedAuthor
Shaik Mohammed Touheed AhmedSalary
Location
Epsom
Job Type
Full Time
Career Area
Civil engineering
Market
Nuclear
Category
Permanent
Location
Epsom
Description
Your Purpose:Are you an innovative finite element specialist with experience in the modelling and assessment of civil or structural engineering structures? Do you excel in developing complex technical
Reference
R-113965
Expiry Date
01/01/0001
Author
Shaik Mohammed Touheed AhmedAuthor
Shaik Mohammed Touheed AhmedSalary
Location
Epsom
Job Type
Full Time
Career Area
Civil engineering
Market
Nuclear
Category
Permanent
Location
Epsom
Bristol
Description
Your purpose:Are you a principal (associate) civil or structural engineer or consultant who can apply their expertise in leading our people, our business and projects? Are you a technical or subject m
Reference
R-113962
Expiry Date
01/01/0001
Author
Shaik Mohammed Touheed AhmedAuthor
Shaik Mohammed Touheed AhmedSalary
Location
Epsom
Job Type
Flexible Working
Full Time
Career Area
Civil engineering
Market
Nuclear
Category
Permanent
Location
Epsom
Description
Use your power for a sustainable nuclear future.You might know us for the great work we do across our wide variety of projects. We're proud to say it's thanks to our people's diversity of thought, exp
Reference
R-113960
Expiry Date
01/01/0001
Author
Shaik Mohammed Touheed AhmedAuthor
Shaik Mohammed Touheed AhmedSalary
Location
Epsom
Job Type
Part Time
Career Area
Civil engineering
Market
Nuclear
Category
Permanent
Location
Epsom
Description
Your purpose:Part-time opportunities like this don’t come along very often.Are you an experienced civil or structural engineer, who’s built technical experience in highly regulated environments – we’r
Reference
R-113958
Expiry Date
01/01/0001
Author
Shaik Mohammed Touheed AhmedAuthor
Shaik Mohammed Touheed AhmedAtkinsRéalis
Talent community
Would you like to know more? Not ready to apply? Join our talent community to stay connected and engaged with us at AtkinsRéalis.
Find out more