Senior Staff AI Engineer - LLM inference optimization Job at Yoh, A Day & Zimmermann Company, San Jose, CA

MkRndlJJRmVWWVpzYm9VdkRXN3JKZDY3Nnc9PQ==
  • Yoh, A Day & Zimmermann Company
  • San Jose, CA

Job Description

Senior Staff AI Engineer – LLM inference optimization



Roles and Responsibilities:

  • Design and architect technical solutions to deliver foundational AIOS capabilities within SkyOS across ECU domains in electric vehicles (EVs).
  • Lead the development of proof-of-concept projects to evaluate architectural designs for functionality, performance, security, and reliability.
  • Collaborate closely with engineering teams to understand real-world development constraints and ensure high-quality implementation, validation, and integration of AIOS designs.
  • Define the technical roadmap for the evolution of AIOS solutions.
  • Develop and communicate clear requirements to guide the development team.
  • Continuously monitor industry trends and analyze competitors’ technical approaches.
Required Qualifications:
  • 5+ years of experience in software design and development focused on AI model inference optimization, and deployment.
  • Strong knowledge of Large Language Models (LLMs) with expertise in optimizing inference on resource-constrained edge devices. Vision-Language Models (VLMs) are a plus.
  • Hands-on experience with cutting-edge AI models and frameworks.
  • Solid background in GPU/NPU architectures and AI training frameworks such as PyTorch, TensorFlow, or similar.
  • 7+ years of experience building complex software systems.
  • Proficiency in C/C++ and Python programming languages.
Preferred Qualifications:
  • Expertise in optimizing AI models for inference on edge devices.
  • Experience with performance tuning and inference optimization for deep learning models across various hardware platforms.
  • Deep understanding of computer architectures, including CPU, MPU, GPU, and NPU technologies.
  • Solid foundation in embedded and mobile operating systems.
  • Familiarity with microkernel architectures, Linux kernel development, hypervisors, middleware, and application frameworks.


Estimated Min Rate : $200,000.00

Estimated Max Rate : $300,000.00

Note: Any pay ranges displayed are estimations. Actual pay is determined by an applicant's experience, technical expertise, and other qualifications as listed in the job description. All qualified applicants are welcome to apply.

Yoh, a Day & Zimmermann company, is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Visit  to contact us if you are an individual with a disability and require accommodation in the application process.

For California applicants, qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. All of the material job duties described in this posting are job duties for which a criminal history may have a direct, adverse, and negative relationship potentially resulting in the withdrawal of a conditional offer of employment.

Job Tags

Similar Jobs

Messer Construction

Carpenter - Framing / Construction Job at Messer Construction

Description Messer Construction Co. is an award-winning construction manager and general contractor that provides leadership for complex commercial building projects. We are currently accepting applications for seasoned Carpenters wanting to advance their construction...

China Global Connections

Director of Sports Job at China Global Connections

We are looking for a Director of Sports for an International School based in Shanghai. This is a full-time position starting from August 2025 academic year. About the schoolLocated in Minhang District, this bilingual boarding school for children aged 6-18 merges the Chinese... 

USC

Predoctoral Research Fellow Job at USC

 ...Angeles. As an employee ofUSC, you will be a part of a world-class research university and a member of the Trojan Family, which is...  ...staff and their family with access to the renowned university medical network; eligibility for retirement plans with employer contributions... 

The Doctors Center

HCC Risk Adjustment coder Job at The Doctors Center

Review and accurately code medical records and encounters for diagnoses and procedures related to Risk Adjustment and HCC coding guidelines...  ...Coder (CPC), or similar credential.Minimum of 2-3 years of experience in HCC/risk adjustment coding.Competence in basic computer... 

Positive Impact Dental Alliance

Hygiene Assistant Job at Positive Impact Dental Alliance

We Need a Hygiene Assistant with Good Vibes and Great Hustle! Location in Lawton, Oklahoma If you love organizing things, making...  ...new Hygiene Assistant . We're a chill but hard-working dental crew that loves what we do. Our hygienists are superheroes who...