Full-Stack AI Engineer (Agentic Solutions) | Remote | USC Only.

Experience: 6+ years in software engineering, including 2+ year building LLM or agent solutions The role You build, evaluate and deploy agentic solutions from an approved spec, using coding agents for most code, tests and documentation. You direct the agents, check their output and own the result. You deliver working software that is instrumented, evaluated, and ready for the business to accept. What you will do Size stories with the product owner, flag effort and risks, and confirm data and access early. Test the spec for buildability, prepare the repo and agent context, and record open questions. Slice stories into tasks, estimate in story points and commit the sprint with the POD. Build with coding agents: code, unit and integration tests, and documentation. Implement agents on Copilot Studio, Azure AI Foundry Agents or Microsoft Agent Framework, including prompts, tools, connectors, workflows and integrations. Build the data and retrieval layer: Document extraction pipelines with Azure AI Document Intelligence, including validation and confidence handling. Chunking, embedding, indexing and hybrid search in a vector store such as Azure AI Search. Calls to decision and rules APIs, with the LLM handling interpretation and drafting only. Apply context engineering: write and version prompts and instructions, manage context windows, memory and tool results, and keep token use within budget. Handle LLM calls reliably: structured outputs, retries, fallbacks, caching and rate limits. Build evaluation sets and run evals on every release: automated metrics, LLM-as-judge and human review samples. Fix findings and resubmit. Instrument every agent with OpenTelemetry. Build traces, dashboards and alerts for latency, token use, cost, errors and quality. Run A/B tests as the architect designs them: variant routing, metric capture and result readouts. Deploy through CI/CD, compile release evidence for go/no-go, and support the business through validation and handover. Must have Strong full-stack engineering in Python and/or C#/.NET, plus API and integration development. Hands-on delivery of LLM or agent applications: prompt design, function and tool calling, RAG and workflow orchestration. Practical experience with at least one of Azure AI Foundry, Copilot Studio or Microsoft Agent Framework. Experience with a document intelligence service (Azure AI Document Intelligence or similar) on real, messy documents. Experience with a vector database or search index: embeddings, chunking, hybrid search and relevance tuning. Working knowledge of context engineering and token handling. Evaluation practice: building golden datasets, running evals in CI, and interpreting results for non-deterministic output. OpenTelemetry instrumentation and use of Azure Monitor, Application Insights or an equivalent observability tool to diagnose agent failures. Familiarity with A/B testing, feature flags and traffic splitting. Daily use of AI coding agents (GitHub Copilot, Claude Code, Cursor or similar). You write clear specs and context files, review agent code critically and catch its mistakes. CI/CD, Git workflows, and Azure fundamentals (identity, secrets, networking, monitoring). Clear communication with business users and daily Agile collaboration. Microsoft certifications (Azure AI Engineer Associate / Azure AI Apps and Agents Developer Associate) Nice to have Natural-language-to-data solutions and data pipelines (Azure Data Factory, Databricks or Fabric, SQL). Rules engines or workflow automation (Power Automate, Logic Apps). Healthcare or payer exposure, including PHI handling.

Remote

Skills:
A/B Testing, Agile Programming Methodologies, Application Programming Interface (API), Artificial Intelligence (AI), Artificial Intelligence (AI) Agents, Automation, Budget Management, Business Support, Caching, Code Reviews, Communication Skills, Continuous Deployment/Delivery, Continuous Integration, Data Management, Data Recovery, Data Sets, Documentation, Git, GitHub, Healthcare, Instrumentation, Integration Testing, Memory Hardware, Metrics, Microsoft .NET, Microsoft Agent, Microsoft C# (C Sharp), Microsoft Certifications, Microsoft Windows Azure, Network Monitoring, Python Programming/Scripting Language, Reporting Dashboards, SLICE (Simulation Language with Integrated Circuit Emphasis), SQL (Structured Query Language), Semantic Reasoner, Software Design, Software Development, Software Engineering, Test Design, Testing, Traffic Shaping, Unit Test


Xlysi



Back to blog

Other Jobs To Apply

Online Amazon Work From Home Part Time Jobs (No Experience/Entry Level)

Video Editor - Internship

Delta Airlines Remote Customer Support - Work From Your Own Home

GMC Appointment Setter/Cold Caller - Permanent work from home, morning shift

Remote Virtual Assistant - Admin Support (No Experience Needed)

bolthires KDP Book Publishing VA/Virtual Assistants - No Experience Necessary - We Will Train You

amazon flex $15+/ Hour (Sign on Bonus)!

Remote Part-Time Night Customer Support Specialist - Flexible Night Shift Roles

Chat Moderator Job - No Prior Experience Needed, Earn $25-$35/Hour

Work From Home Product Tester – $25-$45/hr – No Experience Needed

Hourly pay Office Admin Assistant

Administrative Assistant - Data Entry (Remote)

[PART_TIME Remote] Target Remote Careers From Home $26/Hour

Senior Network Engineer, India Remote, Singapore Remote

Construction -Rebar entry level

Part-Time Virtual Assistant (2–3 hours per week)

Hiring Now: Remote Chat Agent (No Experience Necessary)

Representative II, Claims Processing - Scottsdale, Arizona (Onsite)

Amazon Customer Service Representative (Remote)

Remote College reputed company Intern – Part-Time Software reputed company & IT Solutions at reputed company

Student Loan Sales Intern (Flexible, Part-Time) | CampusReel

Hallmark Territory and Installation Supervisor (part-time) Beverly Hills, FL 34465

Medical Billing Clerk (Work From Home) - No Exp.

Part Time Work At Home Amex Virtual Assistant a...

Experienced Part-Time Remote Interview Specialist – Talent Acquisition and Educational Evaluator for brighthush

Remote Global Travel Coordinator

Online Hotel Booker No Experience Needed

amazon flex $15+/ Hour (Sign on Bonus)!

Licensed Pharmacy Technician – Data Entry Specialist – Remote reputed company Position at reputed company

Flexible Work From Home Jobs: Immediate Start, No Experience Needed

Experienced Part-Time Data Entry Specialist – Remote Administrative Support and Database Management at brighthush

**Experienced Remote Chat Agent – No Experience Needed – Work Remotely Worldwide**

E‑Commerce Account Growth Intern

reputed company: Online Jobs for 17 Year Old With No Experience

Real-Time Corporate Travel Concierge (Remote)

Senior Cloud Engineer

Live Customer Service - Evening Remote Part Time Jobs with Flexible Hours

Urgent Hiring for Remote Data Entry Jobs - Apply Today

Part Time Tutor Jobs in Sitiawan and Across Malaysia

Remote Social Media Customer Support Specialist – Engaging Audiences, Enhancing Brand Experience, and Delivering Exceptional Service for reputed company (reputed company / Part‑Time, Work‑From‑Home)

Assistant Team Leader - Premium Travel & Concierge

Remote Data Entry Associate – Student‑Friendly, No‑Experience Required, Flexible Home‑Based Schedule, Earn While You reputed company

Immediate Hiring: Online Content Typist and Transcription Specialist for Students to Earn Money Weekly from Home

Internship (We pay for each project closure) JobID JC0015821

Dynamic Part-Time Remote Customer Email Support Specialist – Flexible Schedule for College Students, Championing Women in Customer Service Excellence at brighthush

Remote Specialist - Leaves of Absence (LOA) & Workers Comp Programs (Remote Contractor)

Dominos Content Moderator Jobs (Remote, Part Time) $35/Hour

Professional Resident (Medicaid) (Remote)

SDET / QA 100% Remote

Hiring Now - Work from Home - No Experience

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...