CLOUD ARCHITECT - BIG DATA ––– Parma, Italy Full Time
IT Director
Mid-Senior Level
IT Infrastructure EngineeringWHAT TO EXPECT DAY TO DAY
This is an exciting opportunity for a Cloud Architect /Data Engineer with experience in Big Data systems to help build a cutting-edge Data Platform that will power mission critical data analysis and machine learning applications.You will work alongside Software Development, Data Engineering, Data Science, Product and Operations teams to provide the right tools to develop and deliver innovative data products.
You will deal with operating a variety of distributed data delivery and processing systems such as Pulsar, Spark, Airflow and more.Building flexible and user-friendly infrastructure that powers our data pipelines, centralized data lake and feature stores.
Developing easy to use data infrastructure for orchestrating ML training jobs.
Enabling our Data Engineers, Data Scientists and ML Engineers to seamlessly transition from experimentation to production
The ideal candidate will be someone who is ambitious and not afraid to take ownership, someone with strong technical problem-solving skills and who is collaborative with development teams and has a passion to automate away the mundane areas of development and deployment and will keep up to date with current trends in technology.
This position is based in Parma but may require very occasional visits to our other sites and offices.
The successful candidate must be available for participation in the on-call rotation schedule and occasional travel.
WHAT YOU WILL NEED TO SUCCEED
3+ years’ experience in a similar role (SRE, Big Data Infrastructure/Cloud infrastructure/Data Engineer)
Experience building data pipelines
Experience of AWS services
An understanding of the big data ecosystem
Experience to quickly grasp many different services and processes and know how to leverage them
Excellent written and verbal communication
Experience of producing technical and process documentation
Experience of container technologies (Docker or Podman)
Familiarity with Continuous Integration Pipelines (Gitlab CI, Travis CI, etc.)
Proficiency in one or more scripting languages (Python, Ruby, Shell, )
QUALIFICATIONS
Master of Science degree in Computer Science, Computer Engineering, or related technical field, equivalent work experience will be considered.
DESIRABLE
Experience building and operating large scale Spark data infrastructure used for machine learning in a production environment
Experience in Workflow and data pipeline orchestration (Airflow, Oozie, etc.)
Distributed messaging and streaming platforms (Apache Pulsar, Kafka)
SQL and NoSQL Databases (MongoDB, PostgreSQL, or MySQL)
Container Orchestration (Kubernetes, Docker Swarm)
Infrastructure as Code (Terraform)
WHAT WE LOOK FOR
We seek out individuals who are always looking for new ways to improve or do things differently.
We expect you to be proactive and be prepared to share open and honest feedback regularly.
We know that working collaboratively will help us reach our shared goals faster, so we always look for similar individuals who will be willing to help others.
Whether it is our customers, our markets, or each other, we like people to ask questions and listen to the answers so we can all learn and improve.
We expect individuals to take responsibility for their actions and make decisions based on what is right for people, profit and planet.COMPANY DESCRIPTION
Camlin is a global technology leader that operates with the vision of bringing revolutionary products to life for a wide range of industries, including power and rail, and also has interests in a number of R&D projects in a variety of scientific sectors.
At Camlin we believe in high quality engineering and design, allowing us to develop market leading products and services. In short, we love creating value for our customers by solving difficult problems.
As of today, the Camlin operation spans over 20 countries across the globe.BENEFITS
Competitive Salary
Company Pension & Life Assurance Schemes
Flexible / Remote Working
Wellness programmes
On-site parking
EQUAL EMPLOYMENT OPPORTUNITY STATEMENT
Individuals seeking employment at Camlin are considered without regards to race, colour, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, gender identity, or sexual orientation.
