Verified Job On Employer Career Site
Job Summary:
Meta builds technologies that help people connect, find communities, and grow businesses. They are seeking a Software Engineer to develop core PyTorch 2.0 technologies and advance ML compiler technologies, while engaging with users to enable new use cases for PyTorch Compiler technologies.
Responsibilities:
• Improve PyTorch performance via systematic solutions that benefit the entire community.
• Advance the PyTorch compiler technologies and maintain its long-term health.
• Explore the intersection of the PyTorch compiler and PyTorch distributed.
• Optimize Generative AI models across the stack (pre-training, fine-tuning, and inference)
• Conduct cutting-edge research on ML compilers and ML distributed technologies.
• Engage with users of PyTorch to enable new use cases of PyTorch Compiler technologies both inside and outside Meta.
Qualifications:
Required:
• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• Proficient in Python or CUDA programming
• 2+ years of research or industry experience in developing compilers, ML systems, ML accelerators, GPU performance, and similar.
Preferred:
• Expert knowledge of GPU or ML accelerator performance and developing kernels/libraries targeting ML HW.
• Experience with training or serving models or end-to-end optimizations for real models
• Experience with PT2 technologies (e.g., TorchInductor, TorchDynamo, Export) or distributed technologies (e.g., PyTorch distributed, communication collectives, parallelism)
• Experience in developing ML compilers (e.g., PyTorch Compiler, Triton, MLIR, JAX, XLA) or ML frameworks (e.g., JAX, vLLM, ONNX, TensorRT).
• Good understanding of the fast-moving Generative AI space
• Experience in building OSS communities and extensive social media presence in the ML Sys domain.
Company:
Meta is a social technology company that enables people to connect, find communities, and grow businesses. Founded in 2004, the company is headquartered in Menlo Park, California, USA, with a team of 10001+ employees. The company is currently Public Company. Meta has a track record of offering H1B sponsorships.