Senior Staff AI Engineer - LLM inference optimization Job at Yoh, A Day & Zimmermann Company, San Jose, CA

MkRndlJJRmVWWVpzYm9VdkRXN3JKZDY3Nnc9PQ==
  • Yoh, A Day & Zimmermann Company
  • San Jose, CA

Job Description

Senior Staff AI Engineer – LLM inference optimization



Roles and Responsibilities:

  • Design and architect technical solutions to deliver foundational AIOS capabilities within SkyOS across ECU domains in electric vehicles (EVs).
  • Lead the development of proof-of-concept projects to evaluate architectural designs for functionality, performance, security, and reliability.
  • Collaborate closely with engineering teams to understand real-world development constraints and ensure high-quality implementation, validation, and integration of AIOS designs.
  • Define the technical roadmap for the evolution of AIOS solutions.
  • Develop and communicate clear requirements to guide the development team.
  • Continuously monitor industry trends and analyze competitors’ technical approaches.
Required Qualifications:
  • 5+ years of experience in software design and development focused on AI model inference optimization, and deployment.
  • Strong knowledge of Large Language Models (LLMs) with expertise in optimizing inference on resource-constrained edge devices. Vision-Language Models (VLMs) are a plus.
  • Hands-on experience with cutting-edge AI models and frameworks.
  • Solid background in GPU/NPU architectures and AI training frameworks such as PyTorch, TensorFlow, or similar.
  • 7+ years of experience building complex software systems.
  • Proficiency in C/C++ and Python programming languages.
Preferred Qualifications:
  • Expertise in optimizing AI models for inference on edge devices.
  • Experience with performance tuning and inference optimization for deep learning models across various hardware platforms.
  • Deep understanding of computer architectures, including CPU, MPU, GPU, and NPU technologies.
  • Solid foundation in embedded and mobile operating systems.
  • Familiarity with microkernel architectures, Linux kernel development, hypervisors, middleware, and application frameworks.


Estimated Min Rate : $200,000.00

Estimated Max Rate : $300,000.00

Note: Any pay ranges displayed are estimations. Actual pay is determined by an applicant's experience, technical expertise, and other qualifications as listed in the job description. All qualified applicants are welcome to apply.

Yoh, a Day & Zimmermann company, is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Visit  to contact us if you are an individual with a disability and require accommodation in the application process.

For California applicants, qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. All of the material job duties described in this posting are job duties for which a criminal history may have a direct, adverse, and negative relationship potentially resulting in the withdrawal of a conditional offer of employment.

Job Tags

Similar Jobs

ABFE

Head of Fundraising, Airbnb.org (San Francisco) Job at ABFE

 ...This new position is an opportunity to play a central role in building an early-stage nonprofit born out of one of the most innovative and value-driven companies in the world. As the Head of Fundraising, you will spearhead the development and implementation of a best-in... 

Addison Group

Front Desk Receptionist Job at Addison Group

 ...Job Title: Receptionist Bilingual (English/Spanish) required Location (city, state): Phoenix, AZ Industry: Roofing Pay: $2...  ...Hours: 8 AM - 5 PM or 9 AM - 4 PM (flexible) Interview Process: Virtual interview, onsite interview, then offer Perks:... 

Comphealth

Physician Radiology Job at Comphealth

 ...eateries. Taste the selections created in the barrels of the downtown brewery. Discover the art scene, military museums, and beautiful outdoors. CompHealth has opportunities available for physicians in many specialties. Positions with good pay, flexible schedules, minimal... 

Drury Hotels Company, LLC

Guest Service Agent Job at Drury Hotels Company, LLC

 ...year (we succeed together!) based on hotel results Work-life-balance - Flexible scheduling, paid time off, hotel discounts and free room nights Career growth - Mentorship, cross-training, development plans, management training, and more-over 200 internal promotions... 

RK Industries

Apprentice Electrician Job at RK Industries

 ...Electrical Apprenticeship Program Are you ready to start a rewarding career in the electrical trade with a company that invests in your...  ...to join our Electrical Apprenticeship Program no prior experience needed. We provide hands on training, a clear path for career...