Senior Software Engineer - Akamai Inference Cloud (Remote/Poland)

This a Full Remote job, the offer is available from: Europe, European Union, EMEA, Poland

Are you excited about building the systems that process and optimize AI inference requests at scale?

Do you want to work hands-on with cutting-edge AI serving technologies and large language models?

Join the Akamai Inference Cloud Team!

The Akamai Inference Cloud team develops AI platforms for inference models and applications within Akamai's Cloud Technology Group. The Inference Execution & Runtimes team manages the inference engine, AI runtime frameworks, model serving infrastructure, and execution environment. Their work impacts latency, throughput, and efficiency of AI workloads across Akamai's extensive global infrastructure.

Partner with the best

As a Senior Software Engineer on the Inference Execution & Runtimes team, contribute to prompt processing, tokenization, and request handling pipelines. Collaborate with experienced engineers to transform user requests into optimized model inputs. This role offers significant exposure to AI inference systems and opportunities to gain expertise in a rapidly evolving infrastructure engineering field.

As a Senior Software Engineer , you will be responsible for:

  • Developing and maintaining prompt processing and tokenization pipelines that prepare inference requests for efficient model execution.
  • Implementing request routing, scheduling, and batching logic that optimizes throughput and latency across concurrent inference workloads.
  • Contributing to the integration of new model architectures and serving backends into the runtime framework.
  • Writing well-tested, well-documented code and participating in code reviews to maintain high engineering standards across the inference stack.
  • Supporting operational readiness through monitoring, debugging, and performance analysis of runtime components.

Do what you love

To be successful in this role you will:

  • Have relevant experience and a Bachelor's degree or its equivalent in Computer Science or a related field.
  • Demonstrate proficiency in Python and at least one systems programming language such as C++, Go, or Rust.
  • Show understanding of natural language processing concepts including tokenization, encoding, and text processing pipelines.
  • Have familiarity with AI inference, model serving, or LLM deployment including inference frameworks (TensorRT, vLLM, TorchServe, Triton).
  • Demonstrate experience building high-throughput, low-latency data processing systems or services.
  • Show familiarity with Linux systems, containerized environments, and profiling or debugging tools.
  • Demonstrate a keen willingness to learn and grow within the AI inference and model serving field.

About us

At Akamai, we make life better for billions of people, trillions of times a day.
Whether you're streaming live events, scrolling social media, watching your favorite series, or managing your savings, we're the engine behind the scenes. We provide the world's most distributed platform from Cloud to Edge to help the giants of the digital world work faster and stay more secure, making the internet a better experience for everyone.

Our focus is simple:
Cloud and Edge: Running apps closer to users for instant performance.
Security: Neutralizing threats before they ever reach your data.
Content Delivery: Scaling the world's biggest moments without a glitch.
AI: Enabling our customers to build, secure, and scale AI apps on the world's most distributed cloud platform.

At Akamai, we don't just support the internet; we power and protect it, because behind every great digital experience is a massive hidden challenge. And we're the ones who solve it. When millions of people hit play or pay, Akamai ensures it just works.

Benefits at Akamai: We support your health, well-being, finances, and life beyond work. See our benefits.

FlexBase adapts to your job's needs

Akamai's FlexBase program is yet another way we show our commitment to providing employees with an exceptional workplace experience. It's not about telling employees where to work; it's about supporting employees to do their best work.

We trust our incredible employees to work in ways that suit them best: at home, in an office, or a combination of both.

Connect with us on social and see what life at Akamai is like! This offer from "Akamai Technologies" has been enriched by Jobgether.com and got a 0% flex score.
Back to blog

Other Jobs To Apply

Principal, CHQ Major Facilities Project Engineer 1 Remote / Telecommute Jobs

Automation & Controls Engineer - Critical Power Systems (Remote)

Lead Electrician – Petrochemical Plants

SNAP Policy Specialist

Apply Now: Remote FedEx Jobs: Work From Home Opportunities

Senior Rotating

Remote Director, Technical Services

Contract Negotiator: Lead Deal Support (TS/SCI CI Poly Crossover Remote / Telecommute Jobs

Remote Field Sales

Remote Contracts Director: AI

Remote Commercial Lines Client Service Manager

Technical Support Engineer (Remote/West Coast)

AI & Data Value Manager — Remote + Flexible WFH

Virtual Campus Tour Guide (Remote, Flexible Hours) | Vivaday | Handshake

Supply Chain Planning Specialist Remote / Telecommute Jobs

Palantir Forward Deployed Engineer – Full-Stack Software Enginee Jobs

Transpacific Trade Lead: FCL Growth

Entry-Level Contract Management Specialist Remote / Telecommute Jobs

Cyber Underwriter (VP) - Fully Remote / WeWork

Apple Business Solutions Engineer

Travel Advisor | Work From Anywhere

NYS Certified Special Education Teachers - Remote Opportunities

Virtual Hotel Reservationist

Data Entry Computer Job - Work from Home Part Time

Registered Nurse Multi Specialty (Remote Patient Monitoring-RPM)

Remote Membership Development Representative (Catholic/Christian Affiliated)

Telehealth Physical Therapist

Customer Service Representative (Galician-speaking) - Remote AV01

Manager - Digital Consulting (Life Sciences)

Software Engineer - Agent Team

Remote Customer Service Representative

Microsoft Active Directory Administrator, CDC Directory Services, Remote

Lead Product Manager - Agents (Image, Video & Formats)

Technical Support Specialist, Biology

Support Engineer III

Health Coach

Seasonal Sales Representative (Remote, select U.S. states)

Clinical Review Nurse - Prior Authorization

Partnerships Manager

Sr. Customer Success Manager

Environmental Science Tutor (m/f/d) – Remote | Flexible Hours

Group Head of Compliance

Job Posting Title Specialist Account Manager - Connected Communities

Digital Marketing Manager (Remote)

Patient Pathway Manager - East Germany

Sales Operations Analyst (Remote)

Consultant für Microsoft 365 (m/w/d) - Full-Remote - Deutschlandweit

Work From Home Hospitality Customer Service

Executive Assistant / Personal Assistant

Accounts Payable Specialist (Remote)

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...